2023-12-19T09:26:27.358 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T09:26:27.358 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_matan@teuthology --verbose --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} --name matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi --archive /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697 -- /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/orig.config.yaml 2023-12-19T09:26:27.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T09:26:27.473 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697 branch: wip-matanb-crimson-testing-misc description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: null first_in_suite: false job_id: '7496697' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-misc ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson seastar smp: 3 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 729869e4a72e72e756b33d15b6f2fbf113fa1a2d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 729869e4a72e72e756b33d15b6f2fbf113fa1a2d workunit: branch: wip-matanb-crimson-testing-misc env: CRIMSON_COMPAT: '1' sha1: 729869e4a72e72e756b33d15b6f2fbf113fa1a2d owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 7274 sha1: 729869e4a72e72e756b33d15b6f2fbf113fa1a2d sleep_before_teardown: 0 suite: crimson-rados suite_branch: wip-matanb-crimson-testing-misc suite_path: /home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa suite_relpath: qa suite_repo: https://github.com/Matan-B/ceph.git suite_sha1: 729869e4a72e72e756b33d15b6f2fbf113fa1a2d targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLhy5buduEgAKA/hTqmvrHMnhhTc6k0NQ1Ff3TBwtq1DY9Vf3jtWxsMdVd88TYNMw9zVbXLYXBbmQ30J1qaCGw8= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzExhvom+tJHNN0eqDALyW6WRzh8m7vfqQlFVZhO7Bdsq9i1QbnrtbvG3ZP82mmGBOPbFruBr9HTuj7KQdcnFI= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_09:17:50 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T09:26:27.473 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa; will attempt to use it 2023-12-19T09:26:27.474 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa/tasks 2023-12-19T09:26:27.474 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T09:26:27.476 INFO:teuthology.task.internal:Checking packages... 2023-12-19T09:26:27.499 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '729869e4a72e72e756b33d15b6f2fbf113fa1a2d' 2023-12-19T09:26:27.499 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T09:26:27.499 INFO:teuthology.packaging:ref: None 2023-12-19T09:26:27.499 INFO:teuthology.packaging:tag: None 2023-12-19T09:26:27.499 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-misc 2023-12-19T09:26:27.499 INFO:teuthology.packaging:sha1: 729869e4a72e72e756b33d15b6f2fbf113fa1a2d 2023-12-19T09:26:27.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-misc 2023-12-19T09:26:27.640 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-231.g729869e4 2023-12-19T09:26:27.642 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T09:26:27.647 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T09:26:27.648 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T09:26:27.658 INFO:teuthology.task.internal:Saving configuration 2023-12-19T09:26:27.669 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T09:26:27.676 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T09:26:27.701 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 09:21:10.081254', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLhy5buduEgAKA/hTqmvrHMnhhTc6k0NQ1Ff3TBwtq1DY9Vf3jtWxsMdVd88TYNMw9zVbXLYXBbmQ30J1qaCGw8='} 2023-12-19T09:26:27.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 09:21:10.079904', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzExhvom+tJHNN0eqDALyW6WRzh8m7vfqQlFVZhO7Bdsq9i1QbnrtbvG3ZP82mmGBOPbFruBr9HTuj7KQdcnFI='} 2023-12-19T09:26:27.723 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T09:26:27.729 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2023-12-19T09:26:27.729 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-19T09:26:27.729 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T09:26:27.810 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa649725e50>, signals=[15]) 2023-12-19T09:26:27.810 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T09:26:27.817 INFO:teuthology.task.internal:Opening connections... 2023-12-19T09:26:27.818 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2023-12-19T09:26:27.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:26:27.904 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2023-12-19T09:26:27.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:26:27.991 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T09:26:27.999 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-12-19T09:26:28.015 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-12-19T09:26:28.015 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-12-19T09:26:28.071 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-12-19T09:26:28.071 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2023-12-19T09:26:28.071 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-12-19T09:26:28.071 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-12-19T09:26:28.071 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T09:26:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T09:26:28.073 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-12-19T09:26:28.094 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-12-19T09:26:28.111 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-12-19T09:26:28.111 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-12-19T09:26:28.171 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2023-12-19T09:26:28.171 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2023-12-19T09:26:28.171 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2023-12-19T09:26:28.171 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T09:26:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T09:26:28.172 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-12-19T09:26:28.194 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T09:26:28.203 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T09:26:28.209 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T09:26:28.209 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2023-12-19T09:26:28.211 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2023-12-19T09:26:28.231 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T09:26:28.237 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T09:26:28.237 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2023-12-19T09:26:28.267 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2023-12-19T09:26:28.355 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T09:26:28.413 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T09:26:28.434 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-19T09:26:28.435 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-19T09:26:28.435 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T09:26:28.437 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T09:26:28.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:26:28.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:26:28.457 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-12-19T09:26:28.457 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2023-12-19T09:26:28.514 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-361.el9.x86_64 2023-12-19T09:26:28.514 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-361.el9.x86_64 2023-12-19T09:26:28.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2023-12-19T09:26:28.517 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-361.el9.x86_64 2023-12-19T09:26:28.517 INFO:teuthology.task.kernel:Running kernel on smithi178: 5.14.0-361.el9.x86_64 2023-12-19T09:26:28.517 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum install -y kernel 2023-12-19T09:26:30.606 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-19T09:26:30.624 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-12-19T09:26:31.915 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS-9 - BaseOS 7.6 MB/s | 2.0 MB 00:00 2023-12-19T09:26:31.982 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2023-12-19T09:26:33.572 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 7.9 MB 00:01 2023-12-19T09:26:34.007 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 7.9 MB 00:01 2023-12-19T09:26:35.848 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 15 MB/s | 18 MB 00:01 2023-12-19T09:26:39.773 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 10 MB/s | 5.8 MB 00:00 2023-12-19T09:26:40.790 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 3.2 MB/s | 18 MB 00:05 2023-12-19T09:26:41.257 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-12-19T09:26:43.644 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 20 MB 00:02 2023-12-19T09:26:44.832 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 5.8 MB 00:00 2023-12-19T09:26:46.616 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 15 kB 00:00 2023-12-19T09:26:48.384 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-19T09:26:50.556 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-19T09:26:50.557 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-19T09:26:50.649 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:26:50.658 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:26:50.659 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:26:50.659 INFO:teuthology.orchestra.run.smithi178.stdout:Install 4 Packages 2023-12-19T09:26:50.659 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:26:50.659 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 96 M 2023-12-19T09:26:50.659 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 121 M 2023-12-19T09:26:50.659 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:26:52.151 INFO:teuthology.orchestra.run.smithi178.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 3.9 MB/s | 5.6 MB 00:01 2023-12-19T09:26:56.844 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 2.0 MB/s | 20 MB 00:10 2023-12-19T09:27:01.615 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-12-19T09:27:03.763 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-19T09:27:03.764 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-19T09:27:03.855 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:27:03.863 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:27:03.863 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 96 M 2023-12-19T09:27:03.864 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 121 M 2023-12-19T09:27:03.865 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:27:05.708 INFO:teuthology.orchestra.run.smithi178.stdout:(2/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 2.5 MB/s | 38 MB 00:14 2023-12-19T09:27:08.124 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 1.4 MB/s | 5.6 MB 00:04 2023-12-19T09:27:08.390 INFO:teuthology.orchestra.run.smithi178.stdout:(3/4): kernel-modules-core-5.14.0-391.el9.x86_6 2.0 MB/s | 32 MB 00:16 2023-12-19T09:27:09.949 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 3.4 MB/s | 20 MB 00:05 2023-12-19T09:27:14.990 INFO:teuthology.orchestra.run.smithi178.stdout:(4/4): kernel-core-5.14.0-391.el9.x86_64.rpm 858 kB/s | 20 MB 00:24 2023-12-19T09:27:14.990 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:27:14.990 INFO:teuthology.orchestra.run.smithi178.stdout:Total 4.0 MB/s | 96 MB 00:24 2023-12-19T09:27:15.840 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:27:16.232 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:27:16.232 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:27:17.561 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:27:17.562 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:27:20.450 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:27:21.100 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-19T09:27:21.273 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-19T09:27:23.522 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-modules-core-5.14.0-391.el9.x86_6 2.1 MB/s | 32 MB 00:15 2023-12-19T09:27:24.053 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-19T09:27:24.234 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-19T09:27:28.859 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-19T09:27:29.051 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:27:31.288 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 1.4 MB/s | 38 MB 00:27 2023-12-19T09:27:31.288 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:27:31.288 INFO:teuthology.orchestra.run.smithi099.stdout:Total 3.5 MB/s | 96 MB 00:27 2023-12-19T09:27:32.144 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:27:32.528 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:27:32.528 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:27:33.662 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:27:33.852 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:27:33.852 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:27:36.512 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:27:37.153 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-19T09:27:37.273 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-19T09:27:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-19T09:27:40.177 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-19T09:27:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-19T09:27:44.993 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:27:49.640 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:02.839 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:02.881 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:03.319 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:03.319 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-19T09:28:03.319 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-19T09:28:03.319 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-19T09:28:03.728 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:03.728 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:28:03.729 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:28:03.729 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-19T09:28:03.729 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-19T09:28:03.729 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-19T09:28:03.729 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-19T09:28:03.729 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:28:03.729 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:28:04.271 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2023-12-19T09:28:04.460 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-19T09:28:04.461 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-19T09:28:04.461 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-19T09:28:04.461 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-19T09:28:04.461 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-19T09:28:04.461 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-12-19T09:28:04.461 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=None, version=distro) 2023-12-19T09:28:04.461 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2023-12-19T09:28:04.579 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-19T09:28:04.580 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-19T09:28:04.580 DEBUG:teuthology.orchestra.run.smithi178:> sudo rpm -qi grub2-tools 2023-12-19T09:28:04.623 INFO:teuthology.orchestra.run.smithi178.stdout:Name : grub2-tools 2023-12-19T09:28:04.623 INFO:teuthology.orchestra.run.smithi178.stdout:Epoch : 1 2023-12-19T09:28:04.623 INFO:teuthology.orchestra.run.smithi178.stdout:Version : 2.06 2023-12-19T09:28:04.623 INFO:teuthology.orchestra.run.smithi178.stdout:Release : 68.el9 2023-12-19T09:28:04.624 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: x86_64 2023-12-19T09:28:04.624 INFO:teuthology.orchestra.run.smithi178.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T09:28:04.624 INFO:teuthology.orchestra.run.smithi178.stdout:Group : Unspecified 2023-12-19T09:28:04.624 INFO:teuthology.orchestra.run.smithi178.stdout:Size : 8264254 2023-12-19T09:28:04.624 INFO:teuthology.orchestra.run.smithi178.stdout:License : GPLv3+ 2023-12-19T09:28:04.624 INFO:teuthology.orchestra.run.smithi178.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T09:28:04.625 INFO:teuthology.orchestra.run.smithi178.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T09:28:04.625 INFO:teuthology.orchestra.run.smithi178.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T09:28:04.625 INFO:teuthology.orchestra.run.smithi178.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T09:28:04.625 INFO:teuthology.orchestra.run.smithi178.stdout:Packager : builder@centos.org 2023-12-19T09:28:04.625 INFO:teuthology.orchestra.run.smithi178.stdout:Vendor : CentOS 2023-12-19T09:28:04.625 INFO:teuthology.orchestra.run.smithi178.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T09:28:04.626 INFO:teuthology.orchestra.run.smithi178.stdout:Summary : Support tools for GRUB. 2023-12-19T09:28:04.626 INFO:teuthology.orchestra.run.smithi178.stdout:Description : 2023-12-19T09:28:04.626 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:28:04.626 INFO:teuthology.orchestra.run.smithi178.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T09:28:04.626 INFO:teuthology.orchestra.run.smithi178.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T09:28:04.627 INFO:teuthology.orchestra.run.smithi178.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T09:28:04.627 INFO:teuthology.orchestra.run.smithi178.stdout:hardware devices. 2023-12-19T09:28:04.627 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:28:04.627 INFO:teuthology.orchestra.run.smithi178.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T09:28:04.628 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T09:28:04.628 INFO:teuthology.task.kernel:Updating grub on smithi178 to boot 5.14.0-391.el9.x86_64 2023-12-19T09:28:04.629 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T09:28:05.269 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2023-12-19T09:28:06.616 INFO:teuthology.orchestra.run.smithi178.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T09:28:06.645 INFO:teuthology.orchestra.run.smithi178.stderr:done 2023-12-19T09:28:06.647 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2023-12-19T09:28:06.667 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.ObOlH9rMNp 2023-12-19T09:28:06.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ObOlH9rMNp 2023-12-19T09:28:06.735 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.ObOlH9rMNp 2023-12-19T09:28:06.874 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.ObOlH9rMNp is 6KB 2023-12-19T09:28:06.923 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.ObOlH9rMNp 2023-12-19T09:28:06.939 DEBUG:teuthology.orchestra.run.smithi178:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T09:28:07.012 INFO:teuthology.orchestra.run.smithi178.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T09:28:07.013 INFO:teuthology.orchestra.run.smithi178.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T09:28:07.013 INFO:teuthology.orchestra.run.smithi178.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T09:28:07.013 INFO:teuthology.orchestra.run.smithi178.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-19T09:28:07.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-19T09:28:07.171 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2023-12-19T09:28:18.373 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:18.414 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:18.865 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:18.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-19T09:28:18.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-19T09:28:18.865 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-19T09:28:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-19T09:28:19.304 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:28:19.304 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:28:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-19T09:28:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-19T09:28:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-19T09:28:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-19T09:28:19.305 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:28:19.305 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:28:19.825 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2023-12-19T09:28:20.011 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-19T09:28:20.012 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-19T09:28:20.012 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-19T09:28:20.012 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-19T09:28:20.012 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-19T09:28:20.012 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-19T09:28:20.012 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2023-12-19T09:28:20.012 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2023-12-19T09:28:20.132 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-19T09:28:20.132 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-19T09:28:20.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 68.el9 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8264254 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2023-12-19T09:28:20.167 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T09:28:20.168 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T09:28:20.169 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2023-12-19T09:28:20.169 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:28:20.169 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T09:28:20.170 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T09:28:20.170 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-391.el9.x86_64 2023-12-19T09:28:20.170 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T09:28:20.792 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2023-12-19T09:28:22.215 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T09:28:22.247 INFO:teuthology.orchestra.run.smithi099.stderr:done 2023-12-19T09:28:22.249 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-12-19T09:28:22.265 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.Ujb4b9EqhF 2023-12-19T09:28:22.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ujb4b9EqhF 2023-12-19T09:28:22.341 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.Ujb4b9EqhF 2023-12-19T09:28:22.478 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.Ujb4b9EqhF is 6KB 2023-12-19T09:28:22.527 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.Ujb4b9EqhF 2023-12-19T09:28:22.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T09:28:22.606 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T09:28:22.606 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T09:28:22.606 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T09:28:22.606 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-19T09:28:22.607 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-19T09:28:22.740 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2023-12-19T09:28:37.191 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-12-19T09:28:37.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-12-19T09:28:37.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:28:52.757 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-19T09:28:52.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T09:28:52.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:28:55.569 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-12-19T09:29:04.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-12-19T09:29:04.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:29:07.633 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-12-19T09:29:11.185 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T09:29:19.641 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-12-19T09:29:19.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:29:20.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T09:29:20.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:29:23.250 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-12-19T09:29:35.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T09:29:35.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:30:07.083 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-12-19T09:30:07.477 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T09:30:07.480 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-19T09:30:07.481 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2023-12-19T09:30:07.532 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-391.el9.x86_64 2023-12-19T09:30:07.533 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-19T09:30:07.533 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T09:30:07.533 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T09:30:08.534 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-19T09:30:08.534 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-19T09:30:08.610 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2023-12-19T09:30:08.661 DEBUG:teuthology.parallel:result is None 2023-12-19T09:30:19.646 DEBUG:teuthology.orchestra.remote:timed out 2023-12-19T09:30:34.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-12-19T09:30:34.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:30:35.168 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-12-19T09:30:35.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-12-19T09:30:35.500 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-391.el9.x86_64"... 2023-12-19T09:30:35.500 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-12-19T09:30:35.515 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-391.el9.x86_64 2023-12-19T09:30:35.515 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-19T09:30:35.515 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T09:30:35.515 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T09:30:36.517 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-12-19T09:30:36.517 DEBUG:teuthology.orchestra.run.smithi178:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-19T09:30:36.589 INFO:teuthology.orchestra.run.smithi178.stdout:ttyS1 2023-12-19T09:30:36.626 DEBUG:teuthology.parallel:result is None 2023-12-19T09:30:36.627 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T09:30:36.634 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T09:30:36.635 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T09:30:36.638 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T09:30:36.656 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T09:30:36.663 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T09:30:36.672 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T09:30:36.672 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T09:30:36.697 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T09:30:36.755 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T09:30:36.762 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T09:30:36.763 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T09:30:36.765 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T09:30:36.799 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T09:30:36.801 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T09:30:36.813 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T09:30:36.815 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T09:30:36.817 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T09:30:36.825 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T09:30:36.825 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T09:30:36.857 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T09:30:36.887 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T09:30:36.896 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T09:30:36.896 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T09:30:36.926 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T09:30:36.943 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T09:30:37.023 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T09:30:37.073 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T09:30:37.156 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T09:30:37.197 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:30:37.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T09:30:37.266 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T09:30:37.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T09:30:37.368 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T09:30:37.451 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T09:30:37.496 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:30:37.497 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T09:30:37.566 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2023-12-19T09:30:37.568 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2023-12-19T09:30:37.645 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T09:30:37.711 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T09:30:38.115 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T09:30:38.125 INFO:teuthology.task.internal:Starting timer... 2023-12-19T09:30:38.125 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T09:30:38.175 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T09:30:38.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2023-12-19T09:30:38.247 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2023-12-19T09:30:38.249 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2023-12-19T09:30:38.314 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2023-12-19T09:30:38.316 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T09:30:38.316 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2023-12-19T09:30:38.349 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2023-12-19T09:30:38.349 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2023-12-19T09:30:38.378 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2023-12-19T09:30:38.378 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive'} 2023-12-19T09:30:38.379 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T09:30:38.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:30:38.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T09:30:38.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:30:38.449 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T09:30:38.449 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2023-12-19T09:30:38.494 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2023-12-19T09:30:38.530 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T09:30:38.544 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-19T09:30:38.544 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T09:30:38.562 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T09:30:38.564 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T09:36:26.524 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2023-12-19T09:36:26.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T09:36:26.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:36:26.611 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-12-19T09:36:26.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-12-19T09:36:26.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-12-19T09:36:26.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T09:36:26.767 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-12-19T09:36:26.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-12-19T09:36:26.838 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T09:36:26.850 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T09:36:26.850 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T09:36:26.850 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T09:36:26.853 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T09:36:26.853 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T09:36:26.883 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T09:36:26.901 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T09:36:26.910 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T09:36:26.928 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T09:36:26.931 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2023-12-19T09:36:26.944 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2023-12-19T09:36:26.958 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2023-12-19T09:36:26.961 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T09:36:26.972 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2023-12-19T09:36:26.977 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T09:36:26.989 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T09:36:27.005 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T09:36:27.020 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-12-19T09:36:27.023 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T09:36:27.023 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-12-19T09:36:27.024 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.024 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.024 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.024 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.048 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2023-12-19T09:36:27.052 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T09:36:27.052 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-12-19T09:36:27.052 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.052 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.052 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.052 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:36:27.053 INFO:teuthology.run_tasks:Running task install... 2023-12-19T09:36:27.062 DEBUG:teuthology.task.install:project ceph 2023-12-19T09:36:27.062 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d'}} 2023-12-19T09:36:27.062 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d'} 2023-12-19T09:36:27.062 INFO:teuthology.task.install:Using flavor: crimson 2023-12-19T09:36:27.068 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T09:36:27.068 INFO:teuthology.task.install:extra packages: [] 2023-12-19T09:36:27.068 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d', 'tag': None, 'wait_for_package': False} 2023-12-19T09:36:27.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=729869e4a72e72e756b33d15b6f2fbf113fa1a2d 2023-12-19T09:36:27.071 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d', 'tag': None, 'wait_for_package': False} 2023-12-19T09:36:27.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=729869e4a72e72e756b33d15b6f2fbf113fa1a2d 2023-12-19T09:36:27.213 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/ 2023-12-19T09:36:27.213 INFO:teuthology.task.install.rpm:Package version is 19.0.0-231.g729869e4 2023-12-19T09:36:27.437 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/ 2023-12-19T09:36:27.437 INFO:teuthology.task.install.rpm:Package version is 19.0.0-231.g729869e4 2023-12-19T09:36:27.517 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T09:36:27.517 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:36:27.517 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T09:36:27.547 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-19T09:36:27.548 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T09:36:27.615 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T09:36:27.696 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T09:36:27.763 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2023-12-19T09:36:27.765 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2023-12-19T09:36:27.858 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-misc/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T09:36:27.858 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:36:27.859 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T09:36:27.891 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-19T09:36:27.891 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/729869e4a72e72e756b33d15b6f2fbf113fa1a2d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T09:36:27.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T09:36:28.003 INFO:teuthology.orchestra.run.smithi099.stdout:73 files removed 2023-12-19T09:36:28.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw 2023-12-19T09:36:28.044 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T09:36:28.112 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2023-12-19T09:36:28.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2023-12-19T09:36:28.417 INFO:teuthology.orchestra.run.smithi178.stdout:73 files removed 2023-12-19T09:36:28.444 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw 2023-12-19T09:36:29.165 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 100 kB/s | 82 kB 00:00 2023-12-19T09:36:29.790 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 80 kB/s | 82 kB 00:01 2023-12-19T09:36:29.833 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 15 kB/s | 9.5 kB 00:00 2023-12-19T09:36:30.367 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2023-12-19T09:36:30.507 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 14 kB/s | 9.5 kB 00:00 2023-12-19T09:36:30.760 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-19T09:36:31.366 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2023-12-19T09:36:31.810 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-19T09:36:32.143 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-12-19T09:36:33.260 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-12-19T09:36:33.368 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 7.9 MB 00:00 2023-12-19T09:36:36.518 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 7.9 MB 00:02 2023-12-19T09:36:39.171 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 18 MB 00:04 2023-12-19T09:36:44.406 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.8 MB 00:01 2023-12-19T09:36:45.965 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2023-12-19T09:36:57.641 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 931 kB/s | 18 MB 00:20 2023-12-19T09:37:01.600 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 5.8 MB 00:00 2023-12-19T09:37:01.958 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 1.2 MB/s | 20 MB 00:15 2023-12-19T09:37:03.284 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 15 kB 00:00 2023-12-19T09:37:06.655 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-19T09:37:09.120 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:37:09.135 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:37:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:37:09.135 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:37:09.135 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.0.0-231.g729869e4.el9 ceph 8.3 M 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.0.0-231.g729869e4.el9 ceph 3.1 M 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.0.0-231.g729869e4.el9 ceph 3.0 M 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.0.0-231.g729869e4.el9 ceph 6.6 M 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.0.0-231.g729869e4.el9 ceph 17 M 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.0.0-231.g729869e4.el9 ceph 24 k 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T09:37:09.136 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.0.0-231.g729869e4.el9 ceph 728 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.0.0-231.g729869e4.el9 ceph 469 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.0.0-231.g729869e4.el9 ceph 4.5 M 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.0.0-231.g729869e4.el9 ceph 45 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.0.0-231.g729869e4.el9 ceph 130 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.0.0-231.g729869e4.el9 ceph 162 k 2023-12-19T09:37:09.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.0.0-231.g729869e4.el9 ceph 321 k 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.0.0-231.g729869e4.el9 ceph 298 k 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.0.0-231.g729869e4.el9 ceph 100 k 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout:Install 27 Packages 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 2 Packages 2023-12-19T09:37:09.138 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:09.139 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 54 M 2023-12-19T09:37:09.139 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:37:10.672 INFO:teuthology.orchestra.run.smithi099.stdout:(1/29): ceph-base-19.0.0-231.g729869e4.el9.x86_ 4.5 MB/s | 6.6 MB 00:01 2023-12-19T09:37:10.714 INFO:teuthology.orchestra.run.smithi099.stdout:(2/29): ceph-selinux-19.0.0-231.g729869e4.el9.x 578 kB/s | 24 kB 00:00 2023-12-19T09:37:10.998 INFO:teuthology.orchestra.run.smithi099.stdout:(3/29): libcephfs2-19.0.0-231.g729869e4.el9.x86 2.5 MB/s | 728 kB 00:00 2023-12-19T09:37:11.106 INFO:teuthology.orchestra.run.smithi099.stdout:(4/29): ceph-radosgw-19.0.0-231.g729869e4.el9.x 4.4 MB/s | 8.3 MB 00:01 2023-12-19T09:37:11.131 INFO:teuthology.orchestra.run.smithi099.stdout:(5/29): libradosstriper1-19.0.0-231.g729869e4.e 3.4 MB/s | 469 kB 00:00 2023-12-19T09:37:11.207 INFO:teuthology.orchestra.run.smithi099.stdout:(6/29): python3-ceph-argparse-19.0.0-231.g72986 602 kB/s | 45 kB 00:00 2023-12-19T09:37:11.299 INFO:teuthology.orchestra.run.smithi099.stdout:(7/29): python3-ceph-common-19.0.0-231.g729869e 1.4 MB/s | 130 kB 00:00 2023-12-19T09:37:11.391 INFO:teuthology.orchestra.run.smithi099.stdout:(8/29): python3-cephfs-19.0.0-231.g729869e4.el9 1.7 MB/s | 162 kB 00:00 2023-12-19T09:37:11.549 INFO:teuthology.orchestra.run.smithi099.stdout:(9/29): python3-rados-19.0.0-231.g729869e4.el9. 2.0 MB/s | 321 kB 00:00 2023-12-19T09:37:11.708 INFO:teuthology.orchestra.run.smithi099.stdout:(10/29): python3-rbd-19.0.0-231.g729869e4.el9.x 1.8 MB/s | 298 kB 00:00 2023-12-19T09:37:11.808 INFO:teuthology.orchestra.run.smithi099.stdout:(11/29): librgw2-19.0.0-231.g729869e4.el9.x86_6 6.4 MB/s | 4.5 MB 00:00 2023-12-19T09:37:11.834 INFO:teuthology.orchestra.run.smithi099.stdout:(12/29): python3-rgw-19.0.0-231.g729869e4.el9.x 795 kB/s | 100 kB 00:00 2023-12-19T09:37:11.896 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 20 MB 00:08 2023-12-19T09:37:12.034 INFO:teuthology.orchestra.run.smithi099.stdout:(13/29): ceph-common-19.0.0-231.g729869e4.el9.x 6.1 MB/s | 17 MB 00:02 2023-12-19T09:37:12.093 INFO:teuthology.orchestra.run.smithi099.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 373 kB/s | 106 kB 00:00 2023-12-19T09:37:12.110 INFO:teuthology.orchestra.run.smithi099.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 917 kB/s | 44 kB 00:00 2023-12-19T09:37:12.143 INFO:teuthology.orchestra.run.smithi099.stdout:(16/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 559 kB/s | 159 kB 00:00 2023-12-19T09:37:12.210 INFO:teuthology.orchestra.run.smithi099.stdout:(17/29): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 661 kB 00:00 2023-12-19T09:37:12.244 INFO:teuthology.orchestra.run.smithi099.stdout:(18/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 282 kB 00:00 2023-12-19T09:37:12.261 INFO:teuthology.orchestra.run.smithi099.stdout:(19/29): python3-prettytable-0.7.2-27.el9.noarc 352 kB/s | 41 kB 00:00 2023-12-19T09:37:12.461 INFO:teuthology.orchestra.run.smithi099.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 130 kB/s | 26 kB 00:00 2023-12-19T09:37:12.569 INFO:teuthology.orchestra.run.smithi099.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 449 kB/s | 49 kB 00:00 2023-12-19T09:37:12.595 INFO:teuthology.orchestra.run.smithi099.stdout:(22/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 804 kB/s | 309 kB 00:00 2023-12-19T09:37:12.662 INFO:teuthology.orchestra.run.smithi099.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2023-12-19T09:37:12.762 INFO:teuthology.orchestra.run.smithi099.stdout:(24/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2023-12-19T09:37:12.788 INFO:teuthology.orchestra.run.smithi099.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2023-12-19T09:37:12.896 INFO:teuthology.orchestra.run.smithi099.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2023-12-19T09:37:13.530 INFO:teuthology.orchestra.run.smithi099.stdout:(27/29): librbd1-19.0.0-231.g729869e4.el9.x86_6 4.8 MB/s | 3.0 MB 00:00 2023-12-19T09:37:13.586 INFO:teuthology.orchestra.run.smithi099.stdout:(28/29): librados2-19.0.0-231.g729869e4.el9.x86 3.9 MB/s | 3.1 MB 00:00 2023-12-19T09:37:13.769 INFO:teuthology.orchestra.run.smithi099.stdout:(29/29): libarrow-9.0.0-10.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2023-12-19T09:37:13.773 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:37:13.774 INFO:teuthology.orchestra.run.smithi099.stdout:Total 12 MB/s | 54 MB 00:04 2023-12-19T09:37:13.774 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:37:13.810 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:37:13.810 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:37:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:37:14.269 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:37:15.631 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:37:15.976 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-19T09:37:16.121 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.0.0-231.g729869e4.el9.x86_64 2/31 2023-12-19T09:37:16.330 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.0.0-231.g729869e4.el9.x86_64 2/31 2023-12-19T09:37:16.418 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 3/31 2023-12-19T09:37:16.464 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 4/31 2023-12-19T09:37:16.527 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 4/31 2023-12-19T09:37:16.535 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-12-19T09:37:16.560 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2023-12-19T09:37:16.586 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2023-12-19T09:37:16.614 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2023-12-19T09:37:16.658 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.0.0-231.g729869e4.el9.x 8/31 2023-12-19T09:37:16.733 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 9/31 2023-12-19T09:37:16.767 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 10/31 2023-12-19T09:37:16.839 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 10/31 2023-12-19T09:37:16.886 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2023-12-19T09:37:16.990 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-19T09:37:17.026 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-19T09:37:17.067 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-19T09:37:17.099 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-19T09:37:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-19T09:37:17.476 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-19T09:37:17.477 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-19T09:37:17.515 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.0.0-231.g729869e4.el9.x86_64 19/31 2023-12-19T09:37:17.604 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.0.0-231.g729869e4.el9.x86_64 19/31 2023-12-19T09:37:17.645 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 20/31 2023-12-19T09:37:17.689 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-19T09:37:18.142 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-19T09:37:18.176 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.0.0-231.g729869e4.el9.x86_64 23/31 2023-12-19T09:37:18.247 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.0.0-231.g729869e4.el9.x86_64 23/31 2023-12-19T09:37:18.315 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 24/31 2023-12-19T09:37:18.345 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.0.0-231.g729869e4.el9.x86 25/31 2023-12-19T09:37:19.026 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:37:19.040 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:37:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:37:19.040 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:37:19.040 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:37:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:19.0.0-231.g729869e4.el9 ceph 8.3 M 2023-12-19T09:37:19.040 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2023-12-19T09:37:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:19.0.0-231.g729869e4.el9 ceph 3.1 M 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:19.0.0-231.g729869e4.el9 ceph 3.0 M 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:19.0.0-231.g729869e4.el9 ceph 6.6 M 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:19.0.0-231.g729869e4.el9 ceph 17 M 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:19.0.0-231.g729869e4.el9 ceph 24 k 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:19.0.0-231.g729869e4.el9 ceph 728 k 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T09:37:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:19.0.0-231.g729869e4.el9 ceph 469 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:19.0.0-231.g729869e4.el9 ceph 4.5 M 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:19.0.0-231.g729869e4.el9 ceph 45 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:19.0.0-231.g729869e4.el9 ceph 130 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:19.0.0-231.g729869e4.el9 ceph 162 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:19.0.0-231.g729869e4.el9 ceph 321 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:19.0.0-231.g729869e4.el9 ceph 298 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:19.0.0-231.g729869e4.el9 ceph 100 k 2023-12-19T09:37:19.042 INFO:teuthology.orchestra.run.smithi178.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout:Install 27 Packages 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 2 Packages 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:19.043 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 54 M 2023-12-19T09:37:19.044 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:37:20.387 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 26/31 2023-12-19T09:37:20.425 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 26/31 2023-12-19T09:37:21.179 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 26/31 2023-12-19T09:37:21.244 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 27/31 2023-12-19T09:37:21.312 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 27/31 2023-12-19T09:37:21.312 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T09:37:21.312 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T09:37:21.312 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:21.354 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 28/31 2023-12-19T09:37:21.784 INFO:teuthology.orchestra.run.smithi178.stdout:(1/29): ceph-radosgw-19.0.0-231.g729869e4.el9.x 3.6 MB/s | 8.3 MB 00:02 2023-12-19T09:37:21.901 INFO:teuthology.orchestra.run.smithi178.stdout:(2/29): ceph-selinux-19.0.0-231.g729869e4.el9.x 206 kB/s | 24 kB 00:00 2023-12-19T09:37:22.068 INFO:teuthology.orchestra.run.smithi178.stdout:(3/29): libcephfs2-19.0.0-231.g729869e4.el9.x86 4.3 MB/s | 728 kB 00:00 2023-12-19T09:37:22.185 INFO:teuthology.orchestra.run.smithi178.stdout:(4/29): libradosstriper1-19.0.0-231.g729869e4.e 3.9 MB/s | 469 kB 00:00 2023-12-19T09:37:22.811 INFO:teuthology.orchestra.run.smithi178.stdout:(5/29): librgw2-19.0.0-231.g729869e4.el9.x86_64 7.2 MB/s | 4.5 MB 00:00 2023-12-19T09:37:22.911 INFO:teuthology.orchestra.run.smithi178.stdout:(6/29): python3-ceph-argparse-19.0.0-231.g72986 452 kB/s | 45 kB 00:00 2023-12-19T09:37:23.003 INFO:teuthology.orchestra.run.smithi178.stdout:(7/29): python3-ceph-common-19.0.0-231.g729869e 1.4 MB/s | 130 kB 00:00 2023-12-19T09:37:23.096 INFO:teuthology.orchestra.run.smithi178.stdout:(8/29): python3-cephfs-19.0.0-231.g729869e4.el9 1.7 MB/s | 162 kB 00:00 2023-12-19T09:37:23.212 INFO:teuthology.orchestra.run.smithi178.stdout:(9/29): python3-rados-19.0.0-231.g729869e4.el9. 2.7 MB/s | 321 kB 00:00 2023-12-19T09:37:23.329 INFO:teuthology.orchestra.run.smithi178.stdout:(10/29): python3-rbd-19.0.0-231.g729869e4.el9.x 2.5 MB/s | 298 kB 00:00 2023-12-19T09:37:23.446 INFO:teuthology.orchestra.run.smithi178.stdout:(11/29): python3-rgw-19.0.0-231.g729869e4.el9.x 854 kB/s | 100 kB 00:00 2023-12-19T09:37:23.538 INFO:teuthology.orchestra.run.smithi178.stdout:(12/29): boost-program-options-1.75.0-8.el9.x86 1.1 MB/s | 106 kB 00:00 2023-12-19T09:37:23.580 INFO:teuthology.orchestra.run.smithi178.stdout:(13/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-19T09:37:23.614 INFO:teuthology.orchestra.run.smithi178.stdout:(14/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-19T09:37:23.664 INFO:teuthology.orchestra.run.smithi178.stdout:(15/29): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-19T09:37:23.698 INFO:teuthology.orchestra.run.smithi178.stdout:(16/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 8.3 MB/s | 282 kB 00:00 2023-12-19T09:37:23.731 INFO:teuthology.orchestra.run.smithi178.stdout:(17/29): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 41 kB 00:00 2023-12-19T09:37:24.298 INFO:teuthology.orchestra.run.smithi178.stdout:(18/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 545 kB/s | 309 kB 00:00 2023-12-19T09:37:24.524 INFO:teuthology.orchestra.run.smithi178.stdout:(19/29): ceph-common-19.0.0-231.g729869e4.el9.x 3.4 MB/s | 17 MB 00:05 2023-12-19T09:37:24.815 INFO:teuthology.orchestra.run.smithi178.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 89 kB/s | 26 kB 00:00 2023-12-19T09:37:25.366 INFO:teuthology.orchestra.run.smithi178.stdout:(21/29): libarrow-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2023-12-19T09:37:25.391 INFO:teuthology.orchestra.run.smithi178.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 84 kB/s | 49 kB 00:00 2023-12-19T09:37:25.474 INFO:teuthology.orchestra.run.smithi178.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2023-12-19T09:37:25.641 INFO:teuthology.orchestra.run.smithi178.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2023-12-19T09:37:25.717 INFO:teuthology.orchestra.run.smithi178.stdout:(25/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2023-12-19T09:37:26.017 INFO:teuthology.orchestra.run.smithi178.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 4.2 MB/s | 1.6 MB 00:00 2023-12-19T09:37:27.109 INFO:teuthology.orchestra.run.smithi178.stdout:(27/29): librados2-19.0.0-231.g729869e4.el9.x86 2.2 MB/s | 3.1 MB 00:01 2023-12-19T09:37:27.393 INFO:teuthology.orchestra.run.smithi178.stdout:(28/29): ceph-base-19.0.0-231.g729869e4.el9.x86 851 kB/s | 6.6 MB 00:07 2023-12-19T09:37:27.826 INFO:teuthology.orchestra.run.smithi178.stdout:(29/29): librbd1-19.0.0-231.g729869e4.el9.x86_6 1.7 MB/s | 3.0 MB 00:01 2023-12-19T09:37:27.829 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:37:27.829 INFO:teuthology.orchestra.run.smithi178.stdout:Total 6.1 MB/s | 54 MB 00:08 2023-12-19T09:37:27.829 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:37:27.861 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:37:27.861 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:37:28.309 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:37:28.309 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:37:29.653 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:37:30.091 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-19T09:37:30.137 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:19.0.0-231.g729869e4.el9.x86_64 2/31 2023-12-19T09:37:30.212 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:19.0.0-231.g729869e4.el9.x86_64 2/31 2023-12-19T09:37:30.308 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 3/31 2023-12-19T09:37:30.338 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 4/31 2023-12-19T09:37:30.417 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 4/31 2023-12-19T09:37:30.451 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/31 2023-12-19T09:37:30.476 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/31 2023-12-19T09:37:30.506 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.7-2.el9.x86_64 7/31 2023-12-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:19.0.0-231.g729869e4.el9.x 8/31 2023-12-19T09:37:30.622 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 9/31 2023-12-19T09:37:30.648 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 10/31 2023-12-19T09:37:30.735 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 10/31 2023-12-19T09:37:30.763 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.15.0-2.el9.x86_64 11/31 2023-12-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 28/31 2023-12-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2023-12-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2023-12-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2023-12-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2023-12-19T09:37:30.845 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2023-12-19T09:37:30.846 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2023-12-19T09:37:30.846 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2023-12-19T09:37:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:30.869 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-19T09:37:30.898 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-19T09:37:30.939 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-19T09:37:30.979 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-19T09:37:31.008 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-19T09:37:31.040 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-19T09:37:31.364 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-19T09:37:31.390 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:19.0.0-231.g729869e4.el9.x86_64 19/31 2023-12-19T09:37:31.479 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:19.0.0-231.g729869e4.el9.x86_64 19/31 2023-12-19T09:37:31.512 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 20/31 2023-12-19T09:37:31.547 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-19T09:37:31.694 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 29/31 2023-12-19T09:37:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 29/31 2023-12-19T09:37:31.718 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:37:31.718 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T09:37:31.718 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T09:37:31.718 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T09:37:31.718 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:31.720 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-19T09:37:31.821 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-19T09:37:31.821 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-19T09:37:31.974 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-19T09:37:32.000 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:19.0.0-231.g729869e4.el9.x86_64 23/31 2023-12-19T09:37:32.063 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:19.0.0-231.g729869e4.el9.x86_64 23/31 2023-12-19T09:37:32.130 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 24/31 2023-12-19T09:37:32.161 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:19.0.0-231.g729869e4.el9.x86 25/31 2023-12-19T09:37:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-19T09:37:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 1/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 2/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 3/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 4/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 5/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 6/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.0.0-231.g729869e4.el9.x86_64 7/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.0.0-231.g729869e4.el9.x 8/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.0.0-231.g729869e4.el9.x86 9/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 10/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 11/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 12/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 13/31 2023-12-19T09:37:32.957 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-19T09:37:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.0.0-231.g729869e4.el9.x86_64 28/31 2023-12-19T09:37:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-19T09:37:32.959 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.0.0-231.g729869e4.el9.x86_64 30/31 2023-12-19T09:37:34.134 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.135 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.136 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:34.137 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:37:34.190 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 26/31 2023-12-19T09:37:34.232 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 26/31 2023-12-19T09:37:34.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-test 2023-12-19T09:37:34.966 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 26/31 2023-12-19T09:37:35.009 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:29 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:37:35.060 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 27/31 2023-12-19T09:37:35.151 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 27/31 2023-12-19T09:37:35.151 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T09:37:35.151 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T09:37:35.151 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:35.162 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.0.0-231.g729869e4.el9 ceph 118 M 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T09:37:35.163 INFO:teuthology.orchestra.run.smithi099.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.0.0-231.g729869e4.el9 ceph 158 k 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout:Install 10 Packages 2023-12-19T09:37:35.164 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:37:35.165 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 120 M 2023-12-19T09:37:35.165 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 1.1 G 2023-12-19T09:37:35.165 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:37:35.188 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 28/31 2023-12-19T09:37:35.649 INFO:teuthology.orchestra.run.smithi099.stdout:(1/10): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 186 kB 00:00 2023-12-19T09:37:35.716 INFO:teuthology.orchestra.run.smithi099.stdout:(2/10): libasan-11.4.1-2.3.el9.x86_64.rpm 6.2 MB/s | 418 kB 00:00 2023-12-19T09:37:35.750 INFO:teuthology.orchestra.run.smithi099.stdout:(3/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-12-19T09:37:35.783 INFO:teuthology.orchestra.run.smithi099.stdout:(4/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2023-12-19T09:37:35.817 INFO:teuthology.orchestra.run.smithi099.stdout:(5/10): socat-1.7.4.1-5.el9.x86_64.rpm 8.8 MB/s | 300 kB 00:00 2023-12-19T09:37:35.850 INFO:teuthology.orchestra.run.smithi099.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-19T09:37:35.917 INFO:teuthology.orchestra.run.smithi099.stdout:(7/10): libcephsqlite-19.0.0-231.g729869e4.el9. 386 kB/s | 158 kB 00:00 2023-12-19T09:37:36.026 INFO:teuthology.orchestra.run.smithi099.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.1 MB/s | 122 kB 00:00 2023-12-19T09:37:36.159 INFO:teuthology.orchestra.run.smithi099.stdout:(9/10): cryptopp-8.6.0-1.el9.x86_64.rpm 4.1 MB/s | 1.3 MB 00:00 2023-12-19T09:37:44.375 INFO:teuthology.orchestra.run.smithi099.stdout:(10/10): ceph-test-19.0.0-231.g729869e4.el9.x86 13 MB/s | 118 MB 00:08 2023-12-19T09:37:44.377 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:37:44.378 INFO:teuthology.orchestra.run.smithi099.stdout:Total 13 MB/s | 120 MB 00:09 2023-12-19T09:37:44.378 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:37:44.400 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:37:44.400 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 28/31 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /root 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2023-12-19T09:37:44.710 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:45.224 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:37:45.224 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:37:45.552 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 29/31 2023-12-19T09:37:45.576 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 29/31 2023-12-19T09:37:45.576 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:37:45.577 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T09:37:45.577 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T09:37:45.577 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T09:37:45.577 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:45.578 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-19T09:37:45.654 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-19T09:37:45.654 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-19T09:37:46.336 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:37:46.435 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-12-19T09:37:46.466 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-12-19T09:37:46.514 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-12-19T09:37:46.554 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-12-19T09:37:46.595 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-12-19T09:37:46.624 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-16.el9.x86_64 6/10 2023-12-19T09:37:46.666 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-12-19T09:37:46.710 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-12-19T09:37:46.738 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 9/10 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 1/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 2/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 3/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 4/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 5/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 6/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:19.0.0-231.g729869e4.el9.x86_64 7/31 2023-12-19T09:37:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:19.0.0-231.g729869e4.el9.x 8/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:19.0.0-231.g729869e4.el9.x86 9/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 10/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 11/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 12/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 13/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-19T09:37:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:19.0.0-231.g729869e4.el9.x86_64 28/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-19T09:37:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:19.0.0-231.g729869e4.el9.x86_64 30/31 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T09:37:47.919 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.920 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:47.921 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:37:48.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-test 2023-12-19T09:37:48.748 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:00:32 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:37:48.897 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:37:48.897 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:37:48.897 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:37:48.897 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:19.0.0-231.g729869e4.el9 ceph 118 M 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: cryptopp x86_64 8.6.0-1.el9 epel 1.3 M 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: libasan x86_64 11.4.1-2.3.el9 CentOS-AppStream 418 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:19.0.0-231.g729869e4.el9 ceph 158 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: libubsan x86_64 11.4.1-2.3.el9 CentOS-AppStream 186 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2023-12-19T09:37:48.898 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:48.899 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:37:48.899 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:37:48.899 INFO:teuthology.orchestra.run.smithi178.stdout:Install 10 Packages 2023-12-19T09:37:48.899 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:37:48.899 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 120 M 2023-12-19T09:37:48.899 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 1.1 G 2023-12-19T09:37:48.900 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:37:49.242 INFO:teuthology.orchestra.run.smithi178.stdout:(1/10): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2023-12-19T09:37:49.358 INFO:teuthology.orchestra.run.smithi178.stdout:(2/10): libasan-11.4.1-2.3.el9.x86_64.rpm 3.5 MB/s | 418 kB 00:00 2023-12-19T09:37:49.409 INFO:teuthology.orchestra.run.smithi178.stdout:(3/10): libubsan-11.4.1-2.3.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-19T09:37:49.459 INFO:teuthology.orchestra.run.smithi178.stdout:(4/10): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-19T09:37:49.509 INFO:teuthology.orchestra.run.smithi178.stdout:(5/10): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-12-19T09:37:49.543 INFO:teuthology.orchestra.run.smithi178.stdout:(6/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2023-12-19T09:37:49.676 INFO:teuthology.orchestra.run.smithi178.stdout:(7/10): libcephsqlite-19.0.0-231.g729869e4.el9. 258 kB/s | 158 kB 00:00 2023-12-19T09:37:49.868 INFO:teuthology.orchestra.run.smithi178.stdout:(8/10): cryptopp-8.6.0-1.el9.x86_64.rpm 3.9 MB/s | 1.3 MB 00:00 2023-12-19T09:37:49.902 INFO:teuthology.orchestra.run.smithi178.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 540 kB/s | 122 kB 00:00 2023-12-19T09:38:03.284 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 9/10 2023-12-19T09:38:03.359 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 10/10 2023-12-19T09:38:09.183 INFO:teuthology.orchestra.run.smithi178.stdout:(10/10): ceph-test-19.0.0-231.g729869e4.el9.x86 5.8 MB/s | 118 MB 00:20 2023-12-19T09:38:09.185 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:38:09.186 INFO:teuthology.orchestra.run.smithi178.stdout:Total 5.9 MB/s | 120 MB 00:20 2023-12-19T09:38:09.186 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:38:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:38:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:38:10.022 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:38:10.022 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:38:11.167 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:38:11.265 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2023-12-19T09:38:11.307 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cryptopp-8.6.0-1.el9.x86_64 2/10 2023-12-19T09:38:11.352 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/10 2023-12-19T09:38:11.393 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/10 2023-12-19T09:38:11.443 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 5/10 2023-12-19T09:38:11.474 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : jq-1.6-16.el9.x86_64 6/10 2023-12-19T09:38:11.507 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libubsan-11.4.1-2.3.el9.x86_64 7/10 2023-12-19T09:38:11.560 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libasan-11.4.1-2.3.el9.x86_64 8/10 2023-12-19T09:38:11.588 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 9/10 2023-12-19T09:38:11.707 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 10/10 2023-12-19T09:38:11.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 1/10 2023-12-19T09:38:11.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 2/10 2023-12-19T09:38:11.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-16.el9.x86_64 3/10 2023-12-19T09:38:11.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 4/10 2023-12-19T09:38:11.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 5/10 2023-12-19T09:38:11.707 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/10 2023-12-19T09:38:11.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/10 2023-12-19T09:38:11.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/10 2023-12-19T09:38:11.708 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-12-19T09:38:12.187 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-12-19T09:38:12.187 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:12.187 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-16.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:12.188 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:38:12.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph 2023-12-19T09:38:13.045 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:07 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:38:13.199 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================== 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================== 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.0.0-231.g729869e4.el9 ceph 6.5 k 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.0.0-231.g729869e4.el9 ceph 2.0 M 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.0.0-231.g729869e4.el9 ceph 1.4 M 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 243 k 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.0.0-231.g729869e4.el9 ceph 8.9 M 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.0.0-231.g729869e4.el9 ceph 117 M 2023-12-19T09:38:13.202 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T09:38:13.203 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T09:38:13.204 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T09:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================== 2023-12-19T09:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:Install 35 Packages 2023-12-19T09:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 134 M 2023-12-19T09:38:13.205 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 1.4 G 2023-12-19T09:38:13.206 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:38:13.525 INFO:teuthology.orchestra.run.smithi099.stdout:(1/35): ceph-19.0.0-231.g729869e4.el9.x86_64.rp 24 kB/s | 6.5 kB 00:00 2023-12-19T09:38:14.383 INFO:teuthology.orchestra.run.smithi099.stdout:(2/35): ceph-mds-19.0.0-231.g729869e4.el9.x86_6 1.8 MB/s | 2.0 MB 00:01 2023-12-19T09:38:14.550 INFO:teuthology.orchestra.run.smithi099.stdout:(3/35): ceph-mgr-19.0.0-231.g729869e4.el9.x86_6 1.1 MB/s | 1.4 MB 00:01 2023-12-19T09:38:15.017 INFO:teuthology.orchestra.run.smithi099.stdout:(4/35): ceph-mgr-modules-core-19.0.0-231.g72986 521 kB/s | 243 kB 00:00 2023-12-19T09:38:15.125 INFO:teuthology.orchestra.run.smithi099.stdout:(5/35): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-12-19T09:38:15.159 INFO:teuthology.orchestra.run.smithi099.stdout:(6/35): python3-mako-1.1.4-6.el9.noarch.rpm 4.2 MB/s | 144 kB 00:00 2023-12-19T09:38:15.193 INFO:teuthology.orchestra.run.smithi099.stdout:(7/35): python3-markupsafe-1.1.1-12.el9.x86_64. 938 kB/s | 32 kB 00:00 2023-12-19T09:38:15.226 INFO:teuthology.orchestra.run.smithi099.stdout:(8/35): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-12-19T09:38:15.260 INFO:teuthology.orchestra.run.smithi099.stdout:(9/35): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-19T09:38:15.302 INFO:teuthology.orchestra.run.smithi099.stdout:(10/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-19T09:38:15.361 INFO:teuthology.orchestra.run.smithi099.stdout:(11/35): python3-cryptography-36.0.1-4.el9.x86_ 20 MB/s | 1.1 MB 00:00 2023-12-19T09:38:15.394 INFO:teuthology.orchestra.run.smithi099.stdout:(12/35): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-19T09:38:15.427 INFO:teuthology.orchestra.run.smithi099.stdout:(13/35): python3-pycparser-2.20-6.el9.noarch.rp 3.7 MB/s | 124 kB 00:00 2023-12-19T09:38:15.461 INFO:teuthology.orchestra.run.smithi099.stdout:(14/35): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-12-19T09:38:15.503 INFO:teuthology.orchestra.run.smithi099.stdout:(15/35): python3-urllib3-1.26.5-4.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2023-12-19T09:38:15.670 INFO:teuthology.orchestra.run.smithi099.stdout:(16/35): luarocks-3.9.2-1.el9.noarch.rpm 906 kB/s | 151 kB 00:00 2023-12-19T09:38:15.721 INFO:teuthology.orchestra.run.smithi099.stdout:(17/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 869 kB/s | 43 kB 00:00 2023-12-19T09:38:15.796 INFO:teuthology.orchestra.run.smithi099.stdout:(18/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2023-12-19T09:38:15.896 INFO:teuthology.orchestra.run.smithi099.stdout:(19/35): ceph-mon-19.0.0-231.g729869e4.el9.x86_ 3.7 MB/s | 8.9 MB 00:02 2023-12-19T09:38:15.922 INFO:teuthology.orchestra.run.smithi099.stdout:(20/35): python3-cherrypy-18.6.1-2.el9.noarch.r 2.8 MB/s | 358 kB 00:00 2023-12-19T09:38:15.964 INFO:teuthology.orchestra.run.smithi099.stdout:(21/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 160 kB/s | 11 kB 00:00 2023-12-19T09:38:15.981 INFO:teuthology.orchestra.run.smithi099.stdout:(22/35): python3-jaraco-classes-3.2.1-5.el9.noa 301 kB/s | 18 kB 00:00 2023-12-19T09:38:16.006 INFO:teuthology.orchestra.run.smithi099.stdout:(23/35): python3-jaraco-collections-3.0.0-8.el9 554 kB/s | 23 kB 00:00 2023-12-19T09:38:16.031 INFO:teuthology.orchestra.run.smithi099.stdout:(24/35): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2023-12-19T09:38:16.048 INFO:teuthology.orchestra.run.smithi099.stdout:(25/35): python3-jaraco-text-3.2.0-6.el9.noarch 468 kB/s | 20 kB 00:00 2023-12-19T09:38:16.098 INFO:teuthology.orchestra.run.smithi099.stdout:(26/35): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2023-12-19T09:38:16.115 INFO:teuthology.orchestra.run.smithi099.stdout:(27/35): python3-logutils-0.3.5-21.el9.noarch.r 553 kB/s | 46 kB 00:00 2023-12-19T09:38:16.157 INFO:teuthology.orchestra.run.smithi099.stdout:(28/35): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2023-12-19T09:38:16.174 INFO:teuthology.orchestra.run.smithi099.stdout:(29/35): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2023-12-19T09:38:16.208 INFO:teuthology.orchestra.run.smithi099.stdout:(30/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2023-12-19T09:38:16.225 INFO:teuthology.orchestra.run.smithi099.stdout:(31/35): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2023-12-19T09:38:16.267 INFO:teuthology.orchestra.run.smithi099.stdout:(32/35): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2023-12-19T09:38:16.317 INFO:teuthology.orchestra.run.smithi099.stdout:(33/35): python3-zc-lockfile-2.0-10.el9.noarch. 401 kB/s | 20 kB 00:00 2023-12-19T09:38:16.350 INFO:teuthology.orchestra.run.smithi099.stdout:(34/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2023-12-19T09:38:25.533 INFO:teuthology.orchestra.run.smithi099.stdout:(35/35): ceph-osd-19.0.0-231.g729869e4.el9.x86_ 11 MB/s | 117 MB 00:11 2023-12-19T09:38:25.537 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:38:25.537 INFO:teuthology.orchestra.run.smithi099.stdout:Total 11 MB/s | 134 MB 00:12 2023-12-19T09:38:25.537 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:38:25.578 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:38:25.578 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:38:26.617 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:38:26.617 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:38:27.816 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 9/10 2023-12-19T09:38:27.894 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 10/10 2023-12-19T09:38:28.504 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:38:28.568 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-19T09:38:28.601 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-19T09:38:28.633 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-19T09:38:28.724 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-19T09:38:28.819 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-19T09:38:28.861 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-19T09:38:28.932 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-19T09:38:29.011 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-19T09:38:29.050 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-19T09:38:29.098 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-19T09:38:29.153 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-19T09:38:29.333 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-19T09:38:29.378 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-19T09:38:29.414 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-19T09:38:29.452 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-19T09:38:29.482 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-19T09:38:29.556 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-19T09:38:29.592 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-19T09:38:29.625 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-19T09:38:29.674 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-19T09:38:29.709 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-19T09:38:29.743 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-19T09:38:29.839 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-19T09:38:29.888 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-19T09:38:29.961 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-19T09:38:30.096 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-19T09:38:30.215 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-19T09:38:30.381 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-231.g729869e4.el9.n 28/35 2023-12-19T09:38:30.412 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 29/35 2023-12-19T09:38:30.438 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 29/35 2023-12-19T09:38:30.438 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:38:30.438 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T09:38:30.438 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T09:38:30.439 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T09:38:30.439 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:30.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-19T09:38:36.150 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 10/10 2023-12-19T09:38:36.150 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 1/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 2/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : jq-1.6-16.el9.x86_64 3/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libasan-11.4.1-2.3.el9.x86_64 4/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libubsan-11.4.1-2.3.el9.x86_64 5/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/10 2023-12-19T09:38:36.151 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cryptopp-8.6.0-1.el9.x86_64 9/10 2023-12-19T09:38:36.607 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2023-12-19T09:38:36.607 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:38:36.607 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:38:36.607 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:38:36.607 INFO:teuthology.orchestra.run.smithi178.stdout: cryptopp-8.6.0-1.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: jq-1.6-16.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: libasan-11.4.1-2.3.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: libubsan-11.4.1-2.3.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:38:36.608 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:38:36.908 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph 2023-12-19T09:38:37.465 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:01:21 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:38:37.613 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:38:37.615 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================== 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================== 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:19.0.0-231.g729869e4.el9 ceph 6.5 k 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:19.0.0-231.g729869e4.el9 ceph 2.0 M 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:19.0.0-231.g729869e4.el9 ceph 1.4 M 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 243 k 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:19.0.0-231.g729869e4.el9 ceph 8.9 M 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:19.0.0-231.g729869e4.el9 ceph 117 M 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T09:38:37.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T09:38:37.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T09:38:37.618 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:38:37.619 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:38:37.619 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================== 2023-12-19T09:38:37.619 INFO:teuthology.orchestra.run.smithi178.stdout:Install 35 Packages 2023-12-19T09:38:37.619 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:38:37.620 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 134 M 2023-12-19T09:38:37.620 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 1.4 G 2023-12-19T09:38:37.620 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:38:37.977 INFO:teuthology.orchestra.run.smithi178.stdout:(1/35): ceph-19.0.0-231.g729869e4.el9.x86_64.rp 37 kB/s | 6.5 kB 00:00 2023-12-19T09:38:38.510 INFO:teuthology.orchestra.run.smithi178.stdout:(2/35): ceph-mds-19.0.0-231.g729869e4.el9.x86_6 2.8 MB/s | 2.0 MB 00:00 2023-12-19T09:38:38.544 INFO:teuthology.orchestra.run.smithi178.stdout:(3/35): ceph-mgr-19.0.0-231.g729869e4.el9.x86_6 2.0 MB/s | 1.4 MB 00:00 2023-12-19T09:38:38.652 INFO:teuthology.orchestra.run.smithi178.stdout:(4/35): ceph-mon-19.0.0-231.g729869e4.el9.x86_6 13 MB/s | 8.9 MB 00:00 2023-12-19T09:38:38.678 INFO:teuthology.orchestra.run.smithi178.stdout:(5/35): ceph-mgr-modules-core-19.0.0-231.g72986 1.8 MB/s | 243 kB 00:00 2023-12-19T09:38:38.795 INFO:teuthology.orchestra.run.smithi178.stdout:(6/35): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-12-19T09:38:38.812 INFO:teuthology.orchestra.run.smithi178.stdout:(7/35): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 144 kB 00:00 2023-12-19T09:38:38.837 INFO:teuthology.orchestra.run.smithi178.stdout:(8/35): python3-markupsafe-1.1.1-12.el9.x86_64. 759 kB/s | 32 kB 00:00 2023-12-19T09:38:38.862 INFO:teuthology.orchestra.run.smithi178.stdout:(9/35): python3-pytz-2021.1-5.el9.noarch.rpm 946 kB/s | 47 kB 00:00 2023-12-19T09:38:38.912 INFO:teuthology.orchestra.run.smithi178.stdout:(10/35): python3-toml-0.10.2-6.el9.noarch.rpm 514 kB/s | 39 kB 00:00 2023-12-19T09:38:38.938 INFO:teuthology.orchestra.run.smithi178.stdout:(11/35): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2023-12-19T09:38:38.988 INFO:teuthology.orchestra.run.smithi178.stdout:(12/35): python3-cryptography-36.0.1-4.el9.x86_ 15 MB/s | 1.1 MB 00:00 2023-12-19T09:38:39.013 INFO:teuthology.orchestra.run.smithi178.stdout:(13/35): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2023-12-19T09:38:39.030 INFO:teuthology.orchestra.run.smithi178.stdout:(14/35): python3-pycparser-2.20-6.el9.noarch.rp 2.9 MB/s | 124 kB 00:00 2023-12-19T09:38:39.055 INFO:teuthology.orchestra.run.smithi178.stdout:(15/35): python3-requests-2.25.1-7.el9.noarch.r 2.7 MB/s | 113 kB 00:00 2023-12-19T09:38:39.081 INFO:teuthology.orchestra.run.smithi178.stdout:(16/35): python3-urllib3-1.26.5-4.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2023-12-19T09:38:39.348 INFO:teuthology.orchestra.run.smithi178.stdout:(17/35): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 163 kB/s | 43 kB 00:00 2023-12-19T09:38:39.373 INFO:teuthology.orchestra.run.smithi178.stdout:(18/35): luarocks-3.9.2-1.el9.noarch.rpm 476 kB/s | 151 kB 00:00 2023-12-19T09:38:39.474 INFO:teuthology.orchestra.run.smithi178.stdout:(19/35): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2023-12-19T09:38:39.524 INFO:teuthology.orchestra.run.smithi178.stdout:(20/35): python3-jaraco-8.2.1-3.el9.noarch.rpm 214 kB/s | 11 kB 00:00 2023-12-19T09:38:39.574 INFO:teuthology.orchestra.run.smithi178.stdout:(21/35): python3-jaraco-classes-3.2.1-5.el9.noa 354 kB/s | 18 kB 00:00 2023-12-19T09:38:39.599 INFO:teuthology.orchestra.run.smithi178.stdout:(22/35): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2023-12-19T09:38:39.624 INFO:teuthology.orchestra.run.smithi178.stdout:(23/35): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2023-12-19T09:38:39.650 INFO:teuthology.orchestra.run.smithi178.stdout:(24/35): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2023-12-19T09:38:39.675 INFO:teuthology.orchestra.run.smithi178.stdout:(25/35): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2023-12-19T09:38:39.708 INFO:teuthology.orchestra.run.smithi178.stdout:(26/35): python3-logutils-0.3.5-21.el9.noarch.r 790 kB/s | 46 kB 00:00 2023-12-19T09:38:39.742 INFO:teuthology.orchestra.run.smithi178.stdout:(27/35): python3-more-itertools-8.12.0-2.el9.no 1.2 MB/s | 79 kB 00:00 2023-12-19T09:38:39.817 INFO:teuthology.orchestra.run.smithi178.stdout:(28/35): python3-portend-3.1.0-2.el9.noarch.rpm 219 kB/s | 16 kB 00:00 2023-12-19T09:38:39.969 INFO:teuthology.orchestra.run.smithi178.stdout:(29/35): python3-pyOpenSSL-21.0.0-1.el9.noarch. 599 kB/s | 90 kB 00:00 2023-12-19T09:38:40.052 INFO:teuthology.orchestra.run.smithi178.stdout:(30/35): python3-pecan-1.4.2-3.el9.noarch.rpm 794 kB/s | 272 kB 00:00 2023-12-19T09:38:40.077 INFO:teuthology.orchestra.run.smithi178.stdout:(31/35): python3-tempora-5.0.0-2.el9.noarch.rpm 329 kB/s | 36 kB 00:00 2023-12-19T09:38:40.294 INFO:teuthology.orchestra.run.smithi178.stdout:(32/35): python3-webob-1.8.7-6.el9.noarch.rpm 950 kB/s | 230 kB 00:00 2023-12-19T09:38:40.377 INFO:teuthology.orchestra.run.smithi178.stdout:(33/35): python3-zc-lockfile-2.0-10.el9.noarch. 240 kB/s | 20 kB 00:00 2023-12-19T09:38:40.611 INFO:teuthology.orchestra.run.smithi178.stdout:(34/35): python3-werkzeug-2.0.3-3.el9.1.noarch. 800 kB/s | 427 kB 00:00 2023-12-19T09:38:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:(35/35): ceph-osd-19.0.0-231.g729869e4.el9.x86_ 16 MB/s | 117 MB 00:07 2023-12-19T09:38:45.684 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:38:45.684 INFO:teuthology.orchestra.run.smithi178.stdout:Total 17 MB/s | 134 MB 00:08 2023-12-19T09:38:45.685 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:38:45.725 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:38:45.726 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:38:46.764 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:38:46.765 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:38:48.660 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:38:48.729 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/35 2023-12-19T09:38:48.761 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/35 2023-12-19T09:38:48.794 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/35 2023-12-19T09:38:48.885 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/35 2023-12-19T09:38:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-19T09:38:48.990 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/35 2023-12-19T09:38:48.997 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 32/35 2023-12-19T09:38:49.022 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 32/35 2023-12-19T09:38:49.022 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:38:49.022 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T09:38:49.022 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T09:38:49.022 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T09:38:49.022 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:49.030 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/35 2023-12-19T09:38:49.103 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/35 2023-12-19T09:38:49.155 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 8/35 2023-12-19T09:38:49.197 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 9/35 2023-12-19T09:38:49.243 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/35 2023-12-19T09:38:49.298 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/35 2023-12-19T09:38:49.489 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-19T09:38:49.532 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-19T09:38:49.565 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/35 2023-12-19T09:38:49.604 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/35 2023-12-19T09:38:49.635 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/35 2023-12-19T09:38:49.702 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/35 2023-12-19T09:38:49.737 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/35 2023-12-19T09:38:49.770 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/35 2023-12-19T09:38:49.810 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/35 2023-12-19T09:38:49.844 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/35 2023-12-19T09:38:49.871 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/35 2023-12-19T09:38:49.896 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 33/35 2023-12-19T09:38:49.919 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 33/35 2023-12-19T09:38:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:38:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T09:38:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T09:38:49.919 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T09:38:49.919 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:49.960 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/35 2023-12-19T09:38:49.994 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/35 2023-12-19T09:38:50.065 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/35 2023-12-19T09:38:50.122 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 34/35 2023-12-19T09:38:50.144 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 34/35 2023-12-19T09:38:50.145 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:38:50.145 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T09:38:50.145 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T09:38:50.145 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T09:38:50.145 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:38:50.208 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/35 2023-12-19T09:38:50.210 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.0.0-231.g729869e4.el9.x86_64 35/35 2023-12-19T09:38:50.326 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/35 2023-12-19T09:38:50.485 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-231.g729869e4.el9.n 28/35 2023-12-19T09:38:50.507 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 29/35 2023-12-19T09:38:50.533 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 29/35 2023-12-19T09:38:50.533 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:38:50.533 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T09:38:50.533 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T09:38:50.533 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T09:38:50.533 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:38:50.613 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/35 2023-12-19T09:39:00.366 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-2:19.0.0-231.g729869e4.el9.x86_64 35/35 2023-12-19T09:39:00.366 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.0.0-231.g729869e4.el9.x86_64 1/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 2/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 3/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 4/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 5/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-231.g729869e4.el9.n 6/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-19T09:39:00.367 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-19T09:39:00.368 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-19T09:39:00.369 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-19T09:39:00.369 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-19T09:39:00.369 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-19T09:39:00.369 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-19T09:39:00.370 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-19T09:39:00.370 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-19T09:39:00.370 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-19T09:39:01.291 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T09:39:01.292 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T09:39:01.293 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T09:39:01.294 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:01.295 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:01.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-base 2023-12-19T09:39:02.118 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:56 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:02.212 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:02.261 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:02.262 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:02.262 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:02.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install cephadm 2023-12-19T09:39:02.890 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:56 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:03.034 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 805 k 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:03.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:03.036 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 805 k 2023-12-19T09:39:03.036 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 823 k 2023-12-19T09:39:03.036 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:03.468 INFO:teuthology.orchestra.run.smithi099.stdout:cephadm-19.0.0-231.g729869e4.el9.noarch.rpm 1.8 MB/s | 805 kB 00:00 2023-12-19T09:39:03.468 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:03.469 INFO:teuthology.orchestra.run.smithi099.stdout:Total 1.8 MB/s | 805 kB 00:00 2023-12-19T09:39:03.469 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:03.474 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:03.474 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:03.480 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:03.480 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:03.553 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:03.911 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:04.014 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:04.700 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:04.701 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:04.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-immutable-object-cache 2023-12-19T09:39:05.517 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:59 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-231.g729869e4.el9 ceph 143 k 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 143 k 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 438 k 2023-12-19T09:39:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:05.973 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-immutable-object-cache-19.0.0-231.g729869e 468 kB/s | 143 kB 00:00 2023-12-19T09:39:05.973 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:05.974 INFO:teuthology.orchestra.run.smithi099.stdout:Total 466 kB/s | 143 kB 00:00 2023-12-19T09:39:05.974 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:05.981 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:05.981 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:06.032 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:06.032 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:06.184 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:06.240 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-231.g729869e4.e 1/1 2023-12-19T09:39:06.264 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-231.g729869e4.e 1/1 2023-12-19T09:39:06.264 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:06.264 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T09:39:06.264 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-231.g729869e4.e 1/1 2023-12-19T09:39:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:07.303 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:07.303 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:07.303 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:07.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr 2023-12-19T09:39:08.104 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:02 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:08.200 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:08.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-dashboard 2023-12-19T09:39:08.870 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:02 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:08.969 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : luarocks-3.9.2-1.el9.noarch 31/35 2023-12-19T09:39:09.014 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:09.014 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 1.8 M 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 28 k 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 15 k 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T09:39:09.015 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2023-12-19T09:39:09.016 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T09:39:09.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:09.016 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:09.016 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:09.016 INFO:teuthology.orchestra.run.smithi099.stdout:Install 7 Packages 2023-12-19T09:39:09.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:09.016 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.1 M 2023-12-19T09:39:09.017 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 8.7 M 2023-12-19T09:39:09.017 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:09.240 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 32/35 2023-12-19T09:39:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 32/35 2023-12-19T09:39:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T09:39:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T09:39:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T09:39:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:09.426 INFO:teuthology.orchestra.run.smithi099.stdout:(1/7): ceph-grafana-dashboards-19.0.0-231.g7298 112 kB/s | 28 kB 00:00 2023-12-19T09:39:09.451 INFO:teuthology.orchestra.run.smithi099.stdout:(2/7): ceph-prometheus-alerts-19.0.0-231.g72986 55 kB/s | 15 kB 00:00 2023-12-19T09:39:09.609 INFO:teuthology.orchestra.run.smithi099.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 49 kB/s | 9.0 kB 00:00 2023-12-19T09:39:09.743 INFO:teuthology.orchestra.run.smithi099.stdout:(4/7): ceph-mgr-dashboard-19.0.0-231.g729869e4. 3.1 MB/s | 1.8 MB 00:00 2023-12-19T09:39:09.769 INFO:teuthology.orchestra.run.smithi099.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 129 kB/s | 41 kB 00:00 2023-12-19T09:39:09.794 INFO:teuthology.orchestra.run.smithi099.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 167 kB/s | 31 kB 00:00 2023-12-19T09:39:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 779 kB/s | 188 kB 00:00 2023-12-19T09:39:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.1 MB/s | 2.1 MB 00:00 2023-12-19T09:39:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:09.996 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:09.996 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:10.071 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:10.072 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:10.149 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 33/35 2023-12-19T09:39:10.173 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 33/35 2023-12-19T09:39:10.173 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:10.173 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T09:39:10.173 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T09:39:10.173 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T09:39:10.174 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:10.367 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:10.374 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 34/35 2023-12-19T09:39:10.398 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 34/35 2023-12-19T09:39:10.398 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:10.398 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T09:39:10.398 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T09:39:10.398 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T09:39:10.398 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:10.437 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-19T09:39:10.463 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:19.0.0-231.g729869e4.el9.x86_64 35/35 2023-12-19T09:39:10.470 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-19T09:39:10.517 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-19T09:39:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-19T09:39:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-231.g729869e4.el9.no 5/7 2023-12-19T09:39:10.818 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-231.g729869e4.el9.n 6/7 2023-12-19T09:39:10.856 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 7/7 2023-12-19T09:39:11.392 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 7/7 2023-12-19T09:39:11.392 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-231.g729869e4.el9.n 1/7 2023-12-19T09:39:11.392 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 2/7 2023-12-19T09:39:11.392 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-231.g729869e4.el9.no 3/7 2023-12-19T09:39:11.392 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-19T09:39:11.392 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-19T09:39:11.392 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T09:39:11.698 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T09:39:11.699 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:11.699 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:11.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-19T09:39:12.540 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:06 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:12.684 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:12.685 INFO:teuthology.orchestra.run.smithi099.stdout:=========================================================================================== 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout:=========================================================================================== 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 7.4 M 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T09:39:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout:=========================================================================================== 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout:Install 12 Packages 2023-12-19T09:39:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:12.688 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 37 M 2023-12-19T09:39:12.688 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 209 M 2023-12-19T09:39:12.688 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:12.942 INFO:teuthology.orchestra.run.smithi099.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 250 kB/s | 32 kB 00:00 2023-12-19T09:39:12.967 INFO:teuthology.orchestra.run.smithi099.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 728 kB/s | 17 kB 00:00 2023-12-19T09:39:12.993 INFO:teuthology.orchestra.run.smithi099.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2023-12-19T09:39:13.051 INFO:teuthology.orchestra.run.smithi099.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-12-19T09:39:13.177 INFO:teuthology.orchestra.run.smithi099.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2023-12-19T09:39:13.252 INFO:teuthology.orchestra.run.smithi099.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-12-19T09:39:13.285 INFO:teuthology.orchestra.run.smithi099.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 217 kB 00:00 2023-12-19T09:39:13.353 INFO:teuthology.orchestra.run.smithi099.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-19T09:39:13.511 INFO:teuthology.orchestra.run.smithi099.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 61 MB/s | 16 MB 00:00 2023-12-19T09:39:13.536 INFO:teuthology.orchestra.run.smithi099.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-12-19T09:39:13.787 INFO:teuthology.orchestra.run.smithi099.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-2 7.6 MB/s | 7.4 MB 00:00 2023-12-19T09:39:13.812 INFO:teuthology.orchestra.run.smithi099.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 818 kB/s | 245 kB 00:00 2023-12-19T09:39:13.817 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:13.817 INFO:teuthology.orchestra.run.smithi099.stdout:Total 33 MB/s | 37 MB 00:01 2023-12-19T09:39:13.828 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:13.852 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:13.852 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:14.239 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:14.240 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:14.928 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:15.001 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-19T09:39:15.033 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-19T09:39:15.127 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-19T09:39:15.170 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-19T09:39:15.347 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-19T09:39:15.377 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-19T09:39:15.496 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-19T09:39:16.175 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-19T09:39:16.281 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-19T09:39:17.502 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-19T09:39:18.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-19T09:39:18.551 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-231.g729869 12/12 2023-12-19T09:39:20.666 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-2:19.0.0-231.g729869e4.el9.x86_64 35/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:19.0.0-231.g729869e4.el9.x86_64 1/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 2/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 3/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 4/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 5/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-231.g729869e4.el9.n 6/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/35 2023-12-19T09:39:20.667 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 18/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 19/35 2023-12-19T09:39:20.668 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 20/35 2023-12-19T09:39:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 21/35 2023-12-19T09:39:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 22/35 2023-12-19T09:39:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 23/35 2023-12-19T09:39:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 24/35 2023-12-19T09:39:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 25/35 2023-12-19T09:39:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 26/35 2023-12-19T09:39:20.669 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 27/35 2023-12-19T09:39:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 28/35 2023-12-19T09:39:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 29/35 2023-12-19T09:39:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 30/35 2023-12-19T09:39:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 31/35 2023-12-19T09:39:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 32/35 2023-12-19T09:39:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 33/35 2023-12-19T09:39:20.671 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 34/35 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-231.g729869 12/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-231.g729869 1/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-19T09:39:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-19T09:39:21.166 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-19T09:39:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-19T09:39:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:21.563 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T09:39:21.563 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:21.564 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:21.600 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 35/35 2023-12-19T09:39:21.600 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:21.600 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:21.600 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:21.600 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:21.600 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:21.600 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: lua-5.4.4-4.el9.x86_64 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T09:39:21.601 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T09:39:21.602 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T09:39:21.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T09:39:21.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T09:39:21.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T09:39:21.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T09:39:21.603 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T09:39:21.603 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:21.603 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:21.892 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-base 2023-12-19T09:39:21.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-rook 2023-12-19T09:39:22.443 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:06 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:22.528 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:16 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:22.537 INFO:teuthology.orchestra.run.smithi178.stdout:Package ceph-base-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:22.586 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:22.587 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:39:22.587 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:22.651 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install cephadm 2023-12-19T09:39:22.681 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 50 k 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T09:39:22.683 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout:Install 13 Packages 2023-12-19T09:39:22.684 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:22.685 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.0 M 2023-12-19T09:39:22.685 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 26 M 2023-12-19T09:39:22.685 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:22.885 INFO:teuthology.orchestra.run.smithi099.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 155 kB/s | 18 kB 00:00 2023-12-19T09:39:22.911 INFO:teuthology.orchestra.run.smithi099.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 172 kB/s | 24 kB 00:00 2023-12-19T09:39:22.953 INFO:teuthology.orchestra.run.smithi099.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2023-12-19T09:39:22.978 INFO:teuthology.orchestra.run.smithi099.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-12-19T09:39:23.003 INFO:teuthology.orchestra.run.smithi099.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-19T09:39:23.028 INFO:teuthology.orchestra.run.smithi099.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2023-12-19T09:39:23.087 INFO:teuthology.orchestra.run.smithi099.stdout:(7/13): ceph-mgr-rook-19.0.0-231.g729869e4.el9. 158 kB/s | 50 kB 00:00 2023-12-19T09:39:23.202 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:07 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi099.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 56 kB/s | 15 kB 00:00 2023-12-19T09:39:23.321 INFO:teuthology.orchestra.run.smithi099.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 101 kB/s | 32 kB 00:00 2023-12-19T09:39:23.346 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:23.346 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 805 k 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 805 k 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 823 k 2023-12-19T09:39:23.347 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:23.446 INFO:teuthology.orchestra.run.smithi099.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 473 kB/s | 59 kB 00:00 2023-12-19T09:39:23.530 INFO:teuthology.orchestra.run.smithi099.stdout:(11/13): python3-google-auth-2.23.4-1.el9.noarc 501 kB/s | 197 kB 00:00 2023-12-19T09:39:23.555 INFO:teuthology.orchestra.run.smithi099.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 825 kB/s | 90 kB 00:00 2023-12-19T09:39:23.647 INFO:teuthology.orchestra.run.smithi099.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.9 MB/s | 1.0 MB 00:00 2023-12-19T09:39:23.651 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:23.651 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.1 MB/s | 2.0 MB 00:00 2023-12-19T09:39:23.651 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:23.663 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:23.664 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:23.760 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:23.772 INFO:teuthology.orchestra.run.smithi178.stdout:cephadm-19.0.0-231.g729869e4.el9.noarch.rpm 1.9 MB/s | 805 kB 00:00 2023-12-19T09:39:23.772 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:23.773 INFO:teuthology.orchestra.run.smithi178.stdout:Total 1.8 MB/s | 805 kB 00:00 2023-12-19T09:39:23.773 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:23.778 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:23.778 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:23.784 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:23.784 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:23.862 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:24.282 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:24.307 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:24.410 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:24.443 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-19T09:39:24.497 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-19T09:39:24.561 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-19T09:39:24.599 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-19T09:39:24.640 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-19T09:39:24.732 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-19T09:39:24.819 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:24.841 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-19T09:39:24.900 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-19T09:39:25.111 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:25.111 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:25.112 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:25.112 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:25.112 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:25.112 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:25.363 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-immutable-object-cache 2023-12-19T09:39:25.625 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-19T09:39:25.680 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-19T09:39:25.722 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-19T09:39:25.770 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-19T09:39:25.801 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 13/13 2023-12-19T09:39:25.930 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:09 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:26.079 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:26.080 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:26.080 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2023-12-19T09:39:26.080 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-231.g729869e4.el9 ceph 143 k 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 143 k 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 438 k 2023-12-19T09:39:26.081 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:26.419 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-immutable-object-cache-19.0.0-231.g729869e 424 kB/s | 143 kB 00:00 2023-12-19T09:39:26.420 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:26.420 INFO:teuthology.orchestra.run.smithi178.stdout:Total 422 kB/s | 143 kB 00:00 2023-12-19T09:39:26.420 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:26.427 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:26.427 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:26.480 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:26.480 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:26.627 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:26.673 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 13/13 2023-12-19T09:39:26.673 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 1/13 2023-12-19T09:39:26.673 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-19T09:39:26.673 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-19T09:39:26.673 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-19T09:39:26.674 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-19T09:39:26.687 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-231.g729869e4.e 1/1 2023-12-19T09:39:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-231.g729869e4.e 1/1 2023-12-19T09:39:26.712 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:26.712 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T09:39:26.712 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:27.057 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T09:39:27.058 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T09:39:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T09:39:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T09:39:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T09:39:27.059 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:27.059 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:27.310 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-cephadm 2023-12-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-231.g729869e4.e 1/1 2023-12-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:27.869 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:21 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:27.931 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr 2023-12-19T09:39:28.015 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:28.015 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2023-12-19T09:39:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 133 k 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:28.016 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2023-12-19T09:39:28.017 INFO:teuthology.orchestra.run.smithi099.stdout:Install 6 Packages 2023-12-19T09:39:28.017 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:28.017 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 6.8 M 2023-12-19T09:39:28.017 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 33 M 2023-12-19T09:39:28.017 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:28.496 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:12 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:28.544 INFO:teuthology.orchestra.run.smithi099.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.2 MB/s | 228 kB 00:00 2023-12-19T09:39:28.590 INFO:teuthology.orchestra.run.smithi178.stdout:Package ceph-mgr-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:28.639 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:28.640 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:39:28.640 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:28.665 INFO:teuthology.orchestra.run.smithi099.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2023-12-19T09:39:28.700 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-dashboard 2023-12-19T09:39:28.732 INFO:teuthology.orchestra.run.smithi099.stdout:(3/6): ceph-mgr-cephadm-19.0.0-231.g729869e4.el 356 kB/s | 133 kB 00:00 2023-12-19T09:39:29.116 INFO:teuthology.orchestra.run.smithi099.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 133 kB/s | 51 kB 00:00 2023-12-19T09:39:29.141 INFO:teuthology.orchestra.run.smithi099.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 121 kB/s | 58 kB 00:00 2023-12-19T09:39:29.250 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:13 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:29.358 INFO:teuthology.orchestra.run.smithi099.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 674 kB/s | 548 kB 00:00 2023-12-19T09:39:29.360 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:29.360 INFO:teuthology.orchestra.run.smithi099.stdout:Total 5.0 MB/s | 6.8 MB 00:01 2023-12-19T09:39:29.360 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:29.370 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:29.370 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:29.391 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 1.8 M 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 28 k 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 15 k 2023-12-19T09:39:29.392 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout:Install 7 Packages 2023-12-19T09:39:29.393 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:29.394 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 2.1 M 2023-12-19T09:39:29.394 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 8.7 M 2023-12-19T09:39:29.394 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:29.461 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:29.462 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:29.763 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:29.806 INFO:teuthology.orchestra.run.smithi178.stdout:(1/7): ceph-prometheus-alerts-19.0.0-231.g72986 62 kB/s | 15 kB 00:00 2023-12-19T09:39:29.823 INFO:teuthology.orchestra.run.smithi178.stdout:(2/7): ceph-grafana-dashboards-19.0.0-231.g7298 107 kB/s | 28 kB 00:00 2023-12-19T09:39:29.873 INFO:teuthology.orchestra.run.smithi178.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2023-12-19T09:39:29.891 INFO:teuthology.orchestra.run.smithi178.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 610 kB/s | 41 kB 00:00 2023-12-19T09:39:29.931 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-19T09:39:29.932 INFO:teuthology.orchestra.run.smithi178.stdout:(5/7): ceph-mgr-dashboard-19.0.0-231.g729869e4. 4.8 MB/s | 1.8 MB 00:00 2023-12-19T09:39:29.958 INFO:teuthology.orchestra.run.smithi178.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 366 kB/s | 31 kB 00:00 2023-12-19T09:39:29.975 INFO:teuthology.orchestra.run.smithi178.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2023-12-19T09:39:29.976 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:29.977 INFO:teuthology.orchestra.run.smithi178.stdout:Total 3.5 MB/s | 2.1 MB 00:00 2023-12-19T09:39:29.977 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:29.984 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-19T09:39:29.985 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:29.985 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:30.054 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:30.054 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:30.356 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:30.426 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-19T09:39:30.459 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-19T09:39:30.500 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-19T09:39:30.505 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-19T09:39:30.538 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-19T09:39:30.560 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-231.g729869e4.el9.no 5/7 2023-12-19T09:39:30.587 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-19T09:39:30.647 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-19T09:39:30.671 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 6/6 2023-12-19T09:39:30.797 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-231.g729869e4.el9.n 6/7 2023-12-19T09:39:30.836 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 7/7 2023-12-19T09:39:31.390 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 7/7 2023-12-19T09:39:31.390 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-231.g729869e4.el9.n 1/7 2023-12-19T09:39:31.390 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 2/7 2023-12-19T09:39:31.390 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-231.g729869e4.el9.no 3/7 2023-12-19T09:39:31.390 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-19T09:39:31.391 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-19T09:39:31.391 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-19T09:39:31.481 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 6/6 2023-12-19T09:39:31.481 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/6 2023-12-19T09:39:31.481 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-19T09:39:31.481 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-19T09:39:31.481 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-19T09:39:31.482 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-19T09:39:31.721 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-19T09:39:31.721 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:31.721 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:31.721 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:31.721 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:31.721 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:31.721 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T09:39:31.722 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T09:39:31.722 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T09:39:31.722 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T09:39:31.722 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:31.722 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-19T09:39:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:31.790 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:31.790 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T09:39:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T09:39:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T09:39:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T09:39:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T09:39:31.791 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:31.791 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:31.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-19T09:39:32.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-fuse 2023-12-19T09:39:32.492 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:16 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:32.637 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:26 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:32.637 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================== 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================== 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 7.4 M 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T09:39:32.638 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout:=========================================================================================== 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout:Install 12 Packages 2023-12-19T09:39:32.639 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:32.640 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 37 M 2023-12-19T09:39:32.640 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 209 M 2023-12-19T09:39:32.640 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:32.780 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.0.0-231.g729869e4.el9 ceph 833 k 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:32.781 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:32.782 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:32.782 INFO:teuthology.orchestra.run.smithi099.stdout:Install 2 Packages 2023-12-19T09:39:32.782 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:32.782 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 911 k 2023-12-19T09:39:32.782 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 3.0 M 2023-12-19T09:39:32.782 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:32.898 INFO:teuthology.orchestra.run.smithi178.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 255 kB/s | 32 kB 00:00 2023-12-19T09:39:32.900 INFO:teuthology.orchestra.run.smithi099.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 666 kB/s | 79 kB 00:00 2023-12-19T09:39:32.931 INFO:teuthology.orchestra.run.smithi178.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 535 kB/s | 17 kB 00:00 2023-12-19T09:39:32.998 INFO:teuthology.orchestra.run.smithi178.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2023-12-19T09:39:33.032 INFO:teuthology.orchestra.run.smithi178.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 348 kB/s | 34 kB 00:00 2023-12-19T09:39:33.141 INFO:teuthology.orchestra.run.smithi178.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 33 MB/s | 4.7 MB 00:00 2023-12-19T09:39:33.207 INFO:teuthology.orchestra.run.smithi178.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-12-19T09:39:33.233 INFO:teuthology.orchestra.run.smithi178.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2023-12-19T09:39:33.292 INFO:teuthology.orchestra.run.smithi178.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 803 kB 00:00 2023-12-19T09:39:33.450 INFO:teuthology.orchestra.run.smithi178.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 65 MB/s | 16 MB 00:00 2023-12-19T09:39:33.475 INFO:teuthology.orchestra.run.smithi178.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-12-19T09:39:33.634 INFO:teuthology.orchestra.run.smithi099.stdout:(2/2): ceph-fuse-19.0.0-231.g729869e4.el9.x86_6 978 kB/s | 833 kB 00:00 2023-12-19T09:39:33.636 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:33.636 INFO:teuthology.orchestra.run.smithi099.stdout:Total 1.0 MB/s | 911 kB 00:00 2023-12-19T09:39:33.636 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:33.655 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:33.655 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:33.731 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:33.732 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:33.931 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:33.934 INFO:teuthology.orchestra.run.smithi178.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 508 kB/s | 245 kB 00:00 2023-12-19T09:39:34.077 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-19T09:39:34.151 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 2/2 2023-12-19T09:39:34.826 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 2/2 2023-12-19T09:39:34.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/2 2023-12-19T09:39:35.172 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-19T09:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-19T09:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:35.173 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:35.420 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-volume 2023-12-19T09:39:35.984 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:29 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:36.127 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 262 k 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 262 k 2023-12-19T09:39:36.128 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 1.2 M 2023-12-19T09:39:36.129 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:36.267 INFO:teuthology.orchestra.run.smithi178.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-2 2.1 MB/s | 7.4 MB 00:03 2023-12-19T09:39:36.270 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:36.270 INFO:teuthology.orchestra.run.smithi178.stdout:Total 10 MB/s | 37 MB 00:03 2023-12-19T09:39:36.284 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:36.310 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:36.310 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:36.396 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-volume-19.0.0-231.g729869e4.el9.noarch.rpm 981 kB/s | 262 kB 00:00 2023-12-19T09:39:36.397 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:36.397 INFO:teuthology.orchestra.run.smithi099.stdout:Total 976 kB/s | 262 kB 00:00 2023-12-19T09:39:36.397 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:36.405 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:36.405 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:36.438 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:36.438 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:36.653 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:36.689 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:36.689 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:36.740 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:36.756 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:36.756 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:36.756 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T09:39:36.756 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:37.384 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:37.448 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-19T09:39:37.479 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-19T09:39:37.575 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-19T09:39:37.624 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-19T09:39:37.803 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-19T09:39:37.806 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:37.806 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:37.806 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:37.806 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:37.807 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:37.807 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:37.839 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-19T09:39:37.931 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-19T09:39:38.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados-devel 2023-12-19T09:39:38.583 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-19T09:39:38.693 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-19T09:39:38.710 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:32 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:38.856 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:38.857 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2023-12-19T09:39:38.857 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:38.857 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.0.0-231.g729869e4.el9 ceph 127 k 2023-12-19T09:39:38.857 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:38.858 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:38.858 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:38.858 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:38.858 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:38.858 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 127 k 2023-12-19T09:39:38.858 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 456 k 2023-12-19T09:39:38.858 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:39.284 INFO:teuthology.orchestra.run.smithi099.stdout:librados-devel-19.0.0-231.g729869e4.el9.x86_64. 297 kB/s | 127 kB 00:00 2023-12-19T09:39:39.285 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:39.285 INFO:teuthology.orchestra.run.smithi099.stdout:Total 296 kB/s | 127 kB 00:00 2023-12-19T09:39:39.285 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:39.291 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:39.291 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:39.346 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:39.346 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:39.492 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:39.600 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:39.925 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-19T09:39:40.053 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:40.380 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:40.678 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs2 2023-12-19T09:39:40.960 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-19T09:39:40.989 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-231.g729869 12/12 2023-12-19T09:39:41.249 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:35 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:41.346 INFO:teuthology.orchestra.run.smithi099.stdout:Package libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:41.397 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:41.398 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:41.398 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:41.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs-devel 2023-12-19T09:39:42.024 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:36 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:42.170 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.0.0-231.g729869e4.el9 ceph 31 k 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:42.171 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:42.172 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:42.172 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:42.172 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 31 k 2023-12-19T09:39:42.172 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 140 k 2023-12-19T09:39:42.172 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:42.420 INFO:teuthology.orchestra.run.smithi099.stdout:libcephfs-devel-19.0.0-231.g729869e4.el9.x86_64 125 kB/s | 31 kB 00:00 2023-12-19T09:39:42.421 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:42.421 INFO:teuthology.orchestra.run.smithi099.stdout:Total 124 kB/s | 31 kB 00:00 2023-12-19T09:39:42.421 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:42.425 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:42.425 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:42.456 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:42.456 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:42.548 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:42.668 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:43.063 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:43.341 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:43.341 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:43.341 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:43.341 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:43.341 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:43.341 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:43.525 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados2 2023-12-19T09:39:43.620 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-231.g729869 12/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-231.g729869 1/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-19T09:39:43.621 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-19T09:39:44.085 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:38 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:44.097 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-19T09:39:44.097 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:44.097 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:44.097 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:44.097 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:44.098 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:44.178 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:44.228 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:44.229 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:44.229 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:44.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librbd1 2023-12-19T09:39:44.450 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-rook 2023-12-19T09:39:44.865 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:38 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:44.959 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:45.009 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:45.011 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:45.011 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:45.016 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:29 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:45.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rados 2023-12-19T09:39:45.160 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:45.161 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2023-12-19T09:39:45.161 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:39:45.161 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2023-12-19T09:39:45.161 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:45.161 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 50 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T09:39:45.162 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:45.163 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:45.163 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2023-12-19T09:39:45.163 INFO:teuthology.orchestra.run.smithi178.stdout:Install 13 Packages 2023-12-19T09:39:45.163 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:45.163 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 2.0 M 2023-12-19T09:39:45.163 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 26 M 2023-12-19T09:39:45.163 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:45.625 INFO:teuthology.orchestra.run.smithi178.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 213 kB/s | 24 kB 00:00 2023-12-19T09:39:45.642 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:39 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:45.642 INFO:teuthology.orchestra.run.smithi178.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 137 kB/s | 18 kB 00:00 2023-12-19T09:39:45.684 INFO:teuthology.orchestra.run.smithi178.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 174 kB 00:00 2023-12-19T09:39:45.709 INFO:teuthology.orchestra.run.smithi178.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-12-19T09:39:45.734 INFO:teuthology.orchestra.run.smithi178.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-19T09:39:45.735 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:45.760 INFO:teuthology.orchestra.run.smithi178.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2023-12-19T09:39:45.786 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:45.787 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:45.787 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:45.858 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rgw 2023-12-19T09:39:45.859 INFO:teuthology.orchestra.run.smithi178.stdout:(7/13): ceph-mgr-rook-19.0.0-231.g729869e4.el9. 143 kB/s | 50 kB 00:00 2023-12-19T09:39:45.943 INFO:teuthology.orchestra.run.smithi178.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 154 kB/s | 32 kB 00:00 2023-12-19T09:39:45.968 INFO:teuthology.orchestra.run.smithi178.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 72 kB/s | 15 kB 00:00 2023-12-19T09:39:46.019 INFO:teuthology.orchestra.run.smithi178.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 1.2 MB/s | 197 kB 00:00 2023-12-19T09:39:46.094 INFO:teuthology.orchestra.run.smithi178.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2023-12-19T09:39:46.119 INFO:teuthology.orchestra.run.smithi178.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2023-12-19T09:39:46.144 INFO:teuthology.orchestra.run.smithi178.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 719 kB/s | 90 kB 00:00 2023-12-19T09:39:46.148 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:46.148 INFO:teuthology.orchestra.run.smithi178.stdout:Total 2.1 MB/s | 2.0 MB 00:00 2023-12-19T09:39:46.148 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:46.161 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:46.161 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:46.257 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:46.257 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:46.413 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:40 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:46.506 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:46.557 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:46.557 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:46.558 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:46.628 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-cephfs 2023-12-19T09:39:46.779 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:46.950 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-19T09:39:47.004 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-19T09:39:47.068 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-19T09:39:47.105 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-19T09:39:47.146 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-19T09:39:47.184 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:41 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:47.238 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-19T09:39:47.278 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:47.328 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:47.329 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:47.329 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:47.356 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-19T09:39:47.400 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rbd 2023-12-19T09:39:47.405 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-19T09:39:47.954 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:41 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:48.048 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:39:48.097 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:48.098 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2023-12-19T09:39:48.098 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:48.129 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-19T09:39:48.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-fuse 2023-12-19T09:39:48.178 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-19T09:39:48.211 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-19T09:39:48.259 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-19T09:39:48.273 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 13/13 2023-12-19T09:39:48.728 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:42 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:48.872 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:48.874 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2023-12-19T09:39:48.874 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:48.874 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.0.0-231.g729869e4.el9 ceph 86 k 2023-12-19T09:39:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:48.874 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:48.875 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:48.875 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:48.875 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 86 k 2023-12-19T09:39:48.875 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 256 k 2023-12-19T09:39:48.875 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:49.071 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 13/13 2023-12-19T09:39:49.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 1/13 2023-12-19T09:39:49.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-19T09:39:49.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-19T09:39:49.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-19T09:39:49.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-19T09:39:49.071 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-19T09:39:49.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-19T09:39:49.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-19T09:39:49.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-19T09:39:49.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-19T09:39:49.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-19T09:39:49.072 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-19T09:39:49.098 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-fuse-19.0.0-231.g729869e4.el9.x86_64.rpm 386 kB/s | 86 kB 00:00 2023-12-19T09:39:49.099 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:49.099 INFO:teuthology.orchestra.run.smithi099.stdout:Total 383 kB/s | 86 kB 00:00 2023-12-19T09:39:49.100 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:49.106 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:49.106 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:49.161 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:49.161 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:49.308 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:49.397 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:49.439 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-19T09:39:49.439 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:49.439 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:49.439 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:49.439 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T09:39:49.439 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T09:39:49.439 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:49.440 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:49.687 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-mgr-cephadm 2023-12-19T09:39:49.813 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:50.129 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:50.129 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:50.129 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:50.129 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:50.130 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:50.130 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:50.248 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:34 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:50.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-mirror 2023-12-19T09:39:50.393 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 133 k 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T09:39:50.394 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T09:39:50.395 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T09:39:50.395 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:50.395 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:50.395 INFO:teuthology.orchestra.run.smithi178.stdout:======================================================================================= 2023-12-19T09:39:50.395 INFO:teuthology.orchestra.run.smithi178.stdout:Install 6 Packages 2023-12-19T09:39:50.395 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:50.395 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 6.8 M 2023-12-19T09:39:50.396 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 33 M 2023-12-19T09:39:50.396 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:50.645 INFO:teuthology.orchestra.run.smithi178.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.3 MB/s | 228 kB 00:00 2023-12-19T09:39:50.746 INFO:teuthology.orchestra.run.smithi178.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-12-19T09:39:50.926 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:44 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:50.954 INFO:teuthology.orchestra.run.smithi178.stdout:(3/6): ceph-mgr-cephadm-19.0.0-231.g729869e4.el 279 kB/s | 133 kB 00:00 2023-12-19T09:39:51.075 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:51.076 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:51.077 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2023-12-19T09:39:51.077 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:51.077 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:51.077 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.0.0-231.g729869e4.el9 ceph 3.0 M 2023-12-19T09:39:51.077 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:51.077 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:51.078 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:51.078 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:51.078 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:51.078 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 3.0 M 2023-12-19T09:39:51.078 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 13 M 2023-12-19T09:39:51.078 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:51.329 INFO:teuthology.orchestra.run.smithi178.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 103 kB/s | 58 kB 00:00 2023-12-19T09:39:51.505 INFO:teuthology.orchestra.run.smithi178.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 93 kB/s | 51 kB 00:00 2023-12-19T09:39:51.684 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-mirror-19.0.0-231.g729869e4.el9.x86_64.rpm 4.9 MB/s | 3.0 MB 00:00 2023-12-19T09:39:51.684 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:51.685 INFO:teuthology.orchestra.run.smithi099.stdout:Total 4.9 MB/s | 3.0 MB 00:00 2023-12-19T09:39:51.685 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:51.693 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:51.694 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:51.765 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:51.765 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:51.813 INFO:teuthology.orchestra.run.smithi178.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 470 kB/s | 548 kB 00:01 2023-12-19T09:39:51.817 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:51.818 INFO:teuthology.orchestra.run.smithi178.stdout:Total 4.8 MB/s | 6.8 MB 00:01 2023-12-19T09:39:51.818 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:51.827 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:51.827 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:51.917 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:51.918 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:52.194 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:52.217 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:52.251 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:52.276 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:52.276 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T09:39:52.276 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T09:39:52.276 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T09:39:52.276 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:52.404 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-19T09:39:52.456 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-19T09:39:52.980 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-19T09:39:53.067 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-19T09:39:53.128 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-19T09:39:53.161 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 6/6 2023-12-19T09:39:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:53.457 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:53.457 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:53.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-nbd 2023-12-19T09:39:53.958 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 6/6 2023-12-19T09:39:53.958 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 1/6 2023-12-19T09:39:53.958 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-19T09:39:53.958 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-19T09:39:53.958 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-19T09:39:53.958 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-19T09:39:54.278 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:02:48 ago on Tue 19 Dec 2023 09:37:06 AM UTC. 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T09:39:54.279 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T09:39:54.280 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T09:39:54.280 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:54.280 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:54.428 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2023-12-19T09:39:54.429 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2023-12-19T09:39:54.429 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.0.0-231.g729869e4.el9 ceph 169 k 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 169 k 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 537 k 2023-12-19T09:39:54.430 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2023-12-19T09:39:54.546 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-fuse 2023-12-19T09:39:54.787 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-nbd-19.0.0-231.g729869e4.el9.x86_64.rpm 474 kB/s | 169 kB 00:00 2023-12-19T09:39:54.788 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:54.788 INFO:teuthology.orchestra.run.smithi099.stdout:Total 472 kB/s | 169 kB 00:00 2023-12-19T09:39:54.788 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2023-12-19T09:39:54.796 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2023-12-19T09:39:54.797 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2023-12-19T09:39:54.854 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2023-12-19T09:39:54.855 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2023-12-19T09:39:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2023-12-19T09:39:55.108 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:39 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:55.253 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:19.0.0-231.g729869e4.el9 ceph 833 k 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout:Install 2 Packages 2023-12-19T09:39:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:55.255 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 911 k 2023-12-19T09:39:55.255 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 3.0 M 2023-12-19T09:39:55.255 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:55.373 INFO:teuthology.orchestra.run.smithi178.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 668 kB/s | 79 kB 00:00 2023-12-19T09:39:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:55.590 INFO:teuthology.orchestra.run.smithi178.stdout:(2/2): ceph-fuse-19.0.0-231.g729869e4.el9.x86_6 2.4 MB/s | 833 kB 00:00 2023-12-19T09:39:55.591 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:55.591 INFO:teuthology.orchestra.run.smithi178.stdout:Total 2.6 MB/s | 911 kB 00:00 2023-12-19T09:39:55.591 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:55.611 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:55.611 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:55.685 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:55.686 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:39:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:55.847 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2023-12-19T09:39:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:39:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:39:55.848 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2023-12-19T09:39:55.884 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:56.014 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-19T09:39:56.081 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 2/2 2023-12-19T09:39:56.115 DEBUG:teuthology.parallel:result is None 2023-12-19T09:39:56.809 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 2/2 2023-12-19T09:39:56.809 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/2 2023-12-19T09:39:57.134 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-19T09:39:57.135 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:57.135 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:57.135 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:19.0.0-231.g729869e4.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-19T09:39:57.135 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:57.135 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:39:57.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-volume 2023-12-19T09:39:57.971 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:41 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:39:58.117 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:19.0.0-231.g729869e4.el9 ceph-noarch 262 k 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:39:58.118 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:58.119 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 262 k 2023-12-19T09:39:58.119 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 1.2 M 2023-12-19T09:39:58.119 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:39:58.469 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-volume-19.0.0-231.g729869e4.el9.noarch.rpm 749 kB/s | 262 kB 00:00 2023-12-19T09:39:58.470 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:39:58.470 INFO:teuthology.orchestra.run.smithi178.stdout:Total 746 kB/s | 262 kB 00:00 2023-12-19T09:39:58.470 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:39:58.478 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:39:58.478 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:39:58.517 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:39:58.517 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:39:58.728 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:39:58.796 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:58.812 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:58.812 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:39:58.812 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T09:39:58.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:59.885 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 1/1 2023-12-19T09:39:59.885 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:59.885 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:39:59.885 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:19.0.0-231.g729869e4.el9.noarch 2023-12-19T09:39:59.885 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:39:59.885 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:00.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librados-devel 2023-12-19T09:40:00.767 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:44 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:00.913 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:00.914 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:00.914 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2023-12-19T09:40:00.914 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:00.914 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:40:00.914 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:19.0.0-231.g729869e4.el9 ceph 127 k 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 127 k 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 456 k 2023-12-19T09:40:00.915 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:40:01.133 INFO:teuthology.orchestra.run.smithi178.stdout:librados-devel-19.0.0-231.g729869e4.el9.x86_64. 582 kB/s | 127 kB 00:00 2023-12-19T09:40:01.133 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:40:01.133 INFO:teuthology.orchestra.run.smithi178.stdout:Total 578 kB/s | 127 kB 00:00 2023-12-19T09:40:01.133 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:40:01.139 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:40:01.139 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:40:01.193 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:40:01.194 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:40:01.332 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:40:01.431 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:01.892 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:02.245 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:02.245 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:02.245 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:40:02.245 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:40:02.246 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:02.246 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:02.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install libcephfs2 2023-12-19T09:40:03.043 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:47 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:03.139 INFO:teuthology.orchestra.run.smithi178.stdout:Package libcephfs2-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:40:03.189 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:03.190 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:40:03.190 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:03.269 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install libcephfs-devel 2023-12-19T09:40:03.832 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:47 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:03.980 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:03.980 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:03.980 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2023-12-19T09:40:03.980 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:03.980 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:40:03.980 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:19.0.0-231.g729869e4.el9 ceph 31 k 2023-12-19T09:40:03.980 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:03.981 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:40:03.981 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:03.981 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:40:03.981 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:03.981 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 31 k 2023-12-19T09:40:03.981 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 140 k 2023-12-19T09:40:03.981 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:40:04.152 INFO:teuthology.orchestra.run.smithi178.stdout:libcephfs-devel-19.0.0-231.g729869e4.el9.x86_64 182 kB/s | 31 kB 00:00 2023-12-19T09:40:04.153 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:40:04.153 INFO:teuthology.orchestra.run.smithi178.stdout:Total 181 kB/s | 31 kB 00:00 2023-12-19T09:40:04.153 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:40:04.157 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:40:04.157 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:40:04.178 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:40:04.178 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:40:04.266 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:40:04.392 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:04.770 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:05.051 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:05.051 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:05.052 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:40:05.052 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:40:05.052 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:05.052 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:05.246 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librados2 2023-12-19T09:40:05.824 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:49 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:05.919 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:40:05.969 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:05.970 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:40:05.970 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:06.045 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install librbd1 2023-12-19T09:40:06.609 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:50 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:06.703 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:40:06.753 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:06.753 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:40:06.754 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:06.829 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rados 2023-12-19T09:40:07.383 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:51 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:07.477 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rados-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:40:07.527 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:07.528 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:40:07.528 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:07.593 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rgw 2023-12-19T09:40:08.148 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:52 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:08.245 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rgw-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:40:08.293 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:08.294 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:40:08.294 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:08.357 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-cephfs 2023-12-19T09:40:08.911 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:52 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:09.006 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-cephfs-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:40:09.056 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:09.057 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:40:09.057 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:09.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install python3-rbd 2023-12-19T09:40:09.684 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:53 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:09.778 INFO:teuthology.orchestra.run.smithi178.stdout:Package python3-rbd-2:19.0.0-231.g729869e4.el9.x86_64 is already installed. 2023-12-19T09:40:09.829 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:09.829 INFO:teuthology.orchestra.run.smithi178.stdout:Nothing to do. 2023-12-19T09:40:09.830 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:09.900 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-fuse 2023-12-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:54 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:10.607 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:19.0.0-231.g729869e4.el9 ceph 86 k 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:40:10.608 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:10.609 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:40:10.609 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:10.609 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 86 k 2023-12-19T09:40:10.609 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 256 k 2023-12-19T09:40:10.609 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:40:10.831 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-fuse-19.0.0-231.g729869e4.el9.x86_64.rpm 390 kB/s | 86 kB 00:00 2023-12-19T09:40:10.831 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:40:10.831 INFO:teuthology.orchestra.run.smithi178.stdout:Total 388 kB/s | 86 kB 00:00 2023-12-19T09:40:10.831 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:40:10.838 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:40:10.838 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:40:10.892 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:40:10.893 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:40:11.038 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:40:11.145 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:11.533 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:11.861 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:11.861 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:11.862 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:40:11.862 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:40:11.862 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:11.862 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:12.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-mirror 2023-12-19T09:40:12.704 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:02:56 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:12.859 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:12.860 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:12.860 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repo Size 2023-12-19T09:40:12.860 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:12.860 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:40:12.860 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:19.0.0-231.g729869e4.el9 ceph 3.0 M 2023-12-19T09:40:12.860 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:12.861 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:40:12.861 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:12.861 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:40:12.861 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:12.861 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 3.0 M 2023-12-19T09:40:12.861 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 13 M 2023-12-19T09:40:12.861 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:40:13.784 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-mirror-19.0.0-231.g729869e4.el9.x86_64.rpm 3.2 MB/s | 3.0 MB 00:00 2023-12-19T09:40:13.784 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:40:13.785 INFO:teuthology.orchestra.run.smithi178.stdout:Total 3.2 MB/s | 3.0 MB 00:00 2023-12-19T09:40:13.785 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:40:13.794 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:40:13.794 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:40:13.866 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:40:13.866 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:40:14.295 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:40:14.368 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:14.393 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T09:40:14.393 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T09:40:14.393 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T09:40:14.393 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T09:40:14.393 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:15.574 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:15.574 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:15.574 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:40:15.574 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:40:15.574 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:15.574 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:15.798 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install rbd-nbd 2023-12-19T09:40:16.378 INFO:teuthology.orchestra.run.smithi178.stdout:Last metadata expiration check: 0:03:00 ago on Tue 19 Dec 2023 09:37:16 AM UTC. 2023-12-19T09:40:16.523 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2023-12-19T09:40:16.523 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:16.523 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:19.0.0-231.g729869e4.el9 ceph 169 k 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:Install 1 Package 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 169 k 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 537 k 2023-12-19T09:40:16.524 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2023-12-19T09:40:16.745 INFO:teuthology.orchestra.run.smithi178.stdout:rbd-nbd-19.0.0-231.g729869e4.el9.x86_64.rpm 767 kB/s | 169 kB 00:00 2023-12-19T09:40:16.746 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2023-12-19T09:40:16.746 INFO:teuthology.orchestra.run.smithi178.stdout:Total 761 kB/s | 169 kB 00:00 2023-12-19T09:40:16.746 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2023-12-19T09:40:16.754 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2023-12-19T09:40:16.754 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2023-12-19T09:40:16.809 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2023-12-19T09:40:16.809 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2023-12-19T09:40:16.959 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2023-12-19T09:40:17.068 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:17.512 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:17.799 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 1/1 2023-12-19T09:40:17.799 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:17.799 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2023-12-19T09:40:17.800 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:19.0.0-231.g729869e4.el9.x86_64 2023-12-19T09:40:17.800 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:17.800 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2023-12-19T09:40:18.052 DEBUG:teuthology.parallel:result is None 2023-12-19T09:40:18.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=729869e4a72e72e756b33d15b6f2fbf113fa1a2d 2023-12-19T09:40:19.194 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T09:40:19.219 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-231.g729869e4.el9 2023-12-19T09:40:19.220 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-231.g729869e4.el9 2023-12-19T09:40:19.220 INFO:teuthology.task.install:The correct ceph version 19.0.0-231.g729869e4 is installed. 2023-12-19T09:40:19.222 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=729869e4a72e72e756b33d15b6f2fbf113fa1a2d 2023-12-19T09:40:19.360 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T09:40:19.384 INFO:teuthology.orchestra.run.smithi178.stdout:19.0.0-231.g729869e4.el9 2023-12-19T09:40:19.384 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-231.g729869e4.el9 2023-12-19T09:40:19.384 INFO:teuthology.task.install:The correct ceph version 19.0.0-231.g729869e4 is installed. 2023-12-19T09:40:19.386 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T09:40:19.386 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:19.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T09:40:19.419 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:19.419 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T09:40:19.455 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T09:40:19.456 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:19.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T09:40:19.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T09:40:19.558 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:19.558 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T09:40:19.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T09:40:19.660 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T09:40:19.660 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:19.660 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T09:40:19.689 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T09:40:19.758 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:19.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T09:40:19.787 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T09:40:19.856 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T09:40:19.856 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:19.856 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T09:40:19.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T09:40:19.954 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:19.954 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T09:40:19.983 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T09:40:20.052 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T09:40:20.127 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T09:40:20.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2023-12-19T09:40:20.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2023-12-19T09:40:20.158 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T09:40:20.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T09:40:20.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T09:40:20.226 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T09:40:20.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T09:40:20.268 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T09:40:20.303 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T09:40:20.303 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T09:40:20.303 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697', 'branch': 'wip-matanb-crimson-testing-misc', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': None, 'first_in_suite': False, 'job_id': '7496697', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-misc'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d'}}, 'workunit': {'branch': 'wip-matanb-crimson-testing-misc', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 7274, 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'wip-matanb-crimson-testing-misc', 'suite_path': '/home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/Matan-B/ceph.git', 'suite_sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d', 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLhy5buduEgAKA/hTqmvrHMnhhTc6k0NQ1Ff3TBwtq1DY9Vf3jtWxsMdVd88TYNMw9zVbXLYXBbmQ30J1qaCGw8=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzExhvom+tJHNN0eqDALyW6WRzh8m7vfqQlFVZhO7Bdsq9i1QbnrtbvG3ZP82mmGBOPbFruBr9HTuj7KQdcnFI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '729869e4a72e72e756b33d15b6f2fbf113fa1a2d', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_09:17:50', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T09:40:20.304 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T09:40:20.337 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T09:40:20.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T09:40:20.392 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T09:40:20.418 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:20.419 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T09:40:20.472 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T09:40:20.472 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2023-12-19T09:40:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T09:40:20.527 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:20.527 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-19T09:40:20.528 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:20.528 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:20.528 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-19 09:39:52.514810707 +0000 2023-12-19T09:40:20.528 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-19 09:35:45.794970452 +0000 2023-12-19T09:40:20.528 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-19 09:35:45.794970452 +0000 2023-12-19T09:40:20.528 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-19 09:35:45.794970452 +0000 2023-12-19T09:40:20.528 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-19T09:40:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000179511 s, 2.9 MB/s 2023-12-19T09:40:20.594 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T09:40:20.650 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2023-12-19T09:40:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T09:40:20.705 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:20.705 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-19T09:40:20.706 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:20.706 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:20.706 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-19 09:39:52.514810707 +0000 2023-12-19T09:40:20.706 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-19 09:35:46.282959166 +0000 2023-12-19T09:40:20.706 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-19 09:35:46.282959166 +0000 2023-12-19T09:40:20.706 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-19 09:35:46.282959166 +0000 2023-12-19T09:40:20.706 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T09:40:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-19T09:40:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-19T09:40:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00023395 s, 2.2 MB/s 2023-12-19T09:40:20.772 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T09:40:20.827 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2023-12-19T09:40:20.881 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T09:40:20.881 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:20.881 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-19T09:40:20.882 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:20.882 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:20.882 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-19 09:39:52.515810684 +0000 2023-12-19T09:40:20.882 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-19 09:35:46.764948019 +0000 2023-12-19T09:40:20.882 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-19 09:35:46.764948019 +0000 2023-12-19T09:40:20.882 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-19 09:35:46.764948019 +0000 2023-12-19T09:40:20.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T09:40:20.946 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-19T09:40:20.947 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-19T09:40:20.947 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000203273 s, 2.5 MB/s 2023-12-19T09:40:20.948 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T09:40:21.005 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2023-12-19T09:40:21.060 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T09:40:21.060 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:21.060 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-19T09:40:21.060 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:21.060 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:21.061 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2023-12-19 09:39:52.515810684 +0000 2023-12-19T09:40:21.061 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2023-12-19 09:35:47.261936525 +0000 2023-12-19T09:40:21.061 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2023-12-19 09:35:47.261936525 +0000 2023-12-19T09:40:21.061 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2023-12-19 09:35:47.261936525 +0000 2023-12-19T09:40:21.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T09:40:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2023-12-19T09:40:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2023-12-19T09:40:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000181784 s, 2.8 MB/s 2023-12-19T09:40:21.128 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T09:40:21.183 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-19T09:40:21.184 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:21.184 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T09:40:21.203 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T09:40:21.203 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-12-19 09:40:14.647856536 +0000 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-12-19 09:35:45.772883396 +0000 2023-12-19T09:40:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-12-19 09:35:45.772883396 +0000 2023-12-19T09:40:21.263 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-12-19 09:35:45.772883396 +0000 2023-12-19T09:40:21.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T09:40:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-12-19T09:40:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-12-19T09:40:21.331 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000118409 s, 4.3 MB/s 2023-12-19T09:40:21.333 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T09:40:21.391 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2023-12-19T09:40:21.449 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T09:40:21.449 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-12-19 09:40:14.647856536 +0000 2023-12-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-12-19 09:35:46.261874594 +0000 2023-12-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-12-19 09:35:46.261874594 +0000 2023-12-19T09:40:21.450 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-12-19 09:35:46.261874594 +0000 2023-12-19T09:40:21.452 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T09:40:21.518 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-12-19T09:40:21.518 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-12-19T09:40:21.518 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000113606 s, 4.5 MB/s 2023-12-19T09:40:21.519 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T09:40:21.577 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2023-12-19T09:40:21.633 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T09:40:21.633 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:21.633 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-19T09:40:21.634 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:21.634 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:21.634 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-12-19 09:40:14.647856536 +0000 2023-12-19T09:40:21.634 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-12-19 09:35:46.740865972 +0000 2023-12-19T09:40:21.634 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-12-19 09:35:46.740865972 +0000 2023-12-19T09:40:21.634 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-12-19 09:35:46.740865972 +0000 2023-12-19T09:40:21.635 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T09:40:21.699 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-12-19T09:40:21.700 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-12-19T09:40:21.700 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000105609 s, 4.8 MB/s 2023-12-19T09:40:21.701 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T09:40:21.757 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2023-12-19T09:40:21.813 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T09:40:21.813 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T09:40:21.813 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-19T09:40:21.813 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T09:40:21.813 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T09:40:21.814 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-12-19 09:40:14.648856518 +0000 2023-12-19T09:40:21.814 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-12-19 09:35:47.200857691 +0000 2023-12-19T09:40:21.814 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-12-19 09:35:47.200857691 +0000 2023-12-19T09:40:21.814 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2023-12-19 09:35:47.200857691 +0000 2023-12-19T09:40:21.814 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T09:40:21.879 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-12-19T09:40:21.879 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-12-19T09:40:21.879 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 8.079e-05 s, 6.3 MB/s 2023-12-19T09:40:21.881 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T09:40:21.937 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-19T09:40:21.937 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-12-19T09:40:21.937 INFO:tasks.ceph:Generating config... 2023-12-19T09:40:21.938 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-12-19T09:40:21.938 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-12-19T09:40:21.938 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-12-19T09:40:21.938 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-12-19T09:40:21.938 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-12-19T09:40:21.939 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T09:40:21.939 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T09:40:21.939 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T09:40:21.939 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2023-12-19T09:40:21.939 INFO:tasks.ceph:[mon] osd pool default crimson = True 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] debug monc = 20 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] crimson seastar smp = 3 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] osd class default list = * 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] osd class load list = * 2023-12-19T09:40:21.939 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-19T09:40:21.939 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T09:40:21.940 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2023-12-19T09:40:21.940 INFO:tasks.ceph:[global] ms client mode = crc 2023-12-19T09:40:21.940 INFO:tasks.ceph:[global] ms cluster mode = crc 2023-12-19T09:40:21.940 INFO:tasks.ceph:[global] ms mon client mode = crc 2023-12-19T09:40:21.940 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2023-12-19T09:40:21.940 INFO:tasks.ceph:[global] ms mon service mode = crc 2023-12-19T09:40:21.940 INFO:tasks.ceph:[global] ms service mode = crc 2023-12-19T09:40:21.940 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T09:40:21.940 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T09:40:21.940 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T09:40:21.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T09:40:22.009 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T09:40:22.013 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T09:40:22.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T09:40:22.094 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99')] 2023-12-19T09:40:22.094 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson seastar smp': 3, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}} 2023-12-19T09:40:22.095 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:22.096 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T09:40:22.149 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:22.234+0000 7f7ea4e3ae80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:22.235 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:22.234+0000 7f7ea4e3ae80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:22.235+0000 7f7ea4e3ae80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = pacific 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:fsid 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2023-12-19T09:40:22.236164+0000 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:created 2023-12-19T09:40:22.236164+0000 2023-12-19T09:40:22.236 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 16 (pacific) 2023-12-19T09:40:22.237 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2023-12-19T09:40:22.237 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2023-12-19T09:40:22.237 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-12-19T09:40:22.238 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T09:40:22.252 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8e93e3b6-2270-4fce-ac6b-2175b078bbce... 2023-12-19T09:40:22.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T09:40:22.295 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2023-12-19T09:40:22.345 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.346 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2023-12-19T09:40:22.346 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2023-12-19T09:40:22.346 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.346 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2023-12-19T09:40:22.346 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2023-12-19T09:40:22.347 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.347 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T09:40:22.347 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2023-12-19T09:40:22.347 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.347 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T09:40:22.347 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T09:40:22.347 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2023-12-19T09:40:22.348 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2023-12-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2023-12-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2023-12-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T09:40:22.349 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.350 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2023-12-19T09:40:22.350 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.350 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2023-12-19T09:40:22.350 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.350 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2023-12-19T09:40:22.350 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2023-12-19T09:40:22.350 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = 172.21.15.99 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: ms client mode = crc 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: ms cluster mode = crc 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: ms mon client mode = crc 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: ms mon cluster mode = crc 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: ms mon service mode = crc 2023-12-19T09:40:22.351 INFO:teuthology.orchestra.run.smithi099.stdout: ms service mode = crc 2023-12-19T09:40:22.352 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:22.352 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.352 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2023-12-19T09:40:22.352 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2023-12-19T09:40:22.352 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.352 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2023-12-19T09:40:22.352 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2023-12-19T09:40:22.353 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2023-12-19T09:40:22.353 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.353 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2023-12-19T09:40:22.353 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2023-12-19T09:40:22.353 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.353 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2023-12-19T09:40:22.354 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2023-12-19T09:40:22.354 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2023-12-19T09:40:22.354 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2023-12-19T09:40:22.354 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.354 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2023-12-19T09:40:22.354 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2023-12-19T09:40:22.354 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.355 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2023-12-19T09:40:22.355 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.355 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2023-12-19T09:40:22.355 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.355 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: debug monc = 20 2023-12-19T09:40:22.356 INFO:teuthology.orchestra.run.smithi099.stdout: crimson seastar smp = 3 2023-12-19T09:40:22.357 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-19T09:40:22.357 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2023-12-19T09:40:22.357 INFO:teuthology.orchestra.run.smithi099.stdout: osd blocked scrub grace period = 3600 2023-12-19T09:40:22.357 INFO:teuthology.orchestra.run.smithi099.stdout: osd class default list = * 2023-12-19T09:40:22.357 INFO:teuthology.orchestra.run.smithi099.stdout: osd class load list = * 2023-12-19T09:40:22.357 INFO:teuthology.orchestra.run.smithi099.stdout: osd shutdown pgref assert = True 2023-12-19T09:40:22.358 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.358 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2023-12-19T09:40:22.358 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-19T09:40:22.358 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2023-12-19T09:40:22.358 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-12-19T09:40:22.358 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-12-19T09:40:22.358 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2023-12-19T09:40:22.359 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T09:40:22.360 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: mon min osdmap epochs = 50 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: mon osdmap full prune interval = 2 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: mon osdmap full prune min = 15 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: mon osdmap full prune txsize = 2 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: paxos service trim min = 10 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on pool no app = False 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default crimson = True 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:22.361 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2023-12-19T09:40:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2023-12-19T09:40:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2023-12-19T09:40:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2023-12-19T09:40:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T09:40:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T09:40:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2023-12-19T09:40:22.362 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2023-12-19T09:40:22.363 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-12-19T09:40:22.364 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-12-19T09:40:22.365 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-12-19T09:40:22.366 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-12-19T09:40:22.366 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-12-19T09:40:22.366 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-12-19T09:40:22.366 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-12-19T09:40:22.366 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T09:40:22.366 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T09:40:22.367 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-12-19T09:40:22.367 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.367 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T09:40:22.367 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.367 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-12-19T09:40:22.367 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.367 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-12-19T09:40:22.368 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.368 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-12-19T09:40:22.368 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-12-19T09:40:22.368 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-12-19T09:40:22.368 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = 172.21.15.99 2023-12-19T09:40:22.369 INFO:teuthology.orchestra.run.smithi178.stdout: enable experimental unrecoverable data corrupting features = crimson 2023-12-19T09:40:22.369 INFO:teuthology.orchestra.run.smithi178.stdout: ms client mode = crc 2023-12-19T09:40:22.369 INFO:teuthology.orchestra.run.smithi178.stdout: ms cluster mode = crc 2023-12-19T09:40:22.369 INFO:teuthology.orchestra.run.smithi178.stdout: ms mon client mode = crc 2023-12-19T09:40:22.369 INFO:teuthology.orchestra.run.smithi178.stdout: ms mon cluster mode = crc 2023-12-19T09:40:22.369 INFO:teuthology.orchestra.run.smithi178.stdout: ms mon service mode = crc 2023-12-19T09:40:22.370 INFO:teuthology.orchestra.run.smithi178.stdout: ms service mode = crc 2023-12-19T09:40:22.370 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:22.370 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.370 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-12-19T09:40:22.370 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-12-19T09:40:22.370 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.371 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-12-19T09:40:22.371 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-12-19T09:40:22.371 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2023-12-19T09:40:22.371 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.371 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-12-19T09:40:22.371 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-12-19T09:40:22.372 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.372 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-12-19T09:40:22.372 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-12-19T09:40:22.372 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-12-19T09:40:22.372 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2023-12-19T09:40:22.372 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.373 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-12-19T09:40:22.373 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-12-19T09:40:22.373 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.373 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-12-19T09:40:22.373 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.373 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-12-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-12-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-12-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-12-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.374 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-12-19T09:40:22.375 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-12-19T09:40:22.375 INFO:teuthology.orchestra.run.smithi178.stdout: debug monc = 20 2023-12-19T09:40:22.375 INFO:teuthology.orchestra.run.smithi178.stdout: crimson seastar smp = 3 2023-12-19T09:40:22.375 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-12-19T09:40:22.375 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-12-19T09:40:22.375 INFO:teuthology.orchestra.run.smithi178.stdout: osd blocked scrub grace period = 3600 2023-12-19T09:40:22.375 INFO:teuthology.orchestra.run.smithi178.stdout: osd class default list = * 2023-12-19T09:40:22.376 INFO:teuthology.orchestra.run.smithi178.stdout: osd class load list = * 2023-12-19T09:40:22.376 INFO:teuthology.orchestra.run.smithi178.stdout: osd shutdown pgref assert = True 2023-12-19T09:40:22.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.376 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-12-19T09:40:22.376 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-12-19T09:40:22.376 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-12-19T09:40:22.376 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-12-19T09:40:22.377 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-12-19T09:40:22.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-12-19T09:40:22.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-12-19T09:40:22.377 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-12-19T09:40:22.377 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.377 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-12-19T09:40:22.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T09:40:22.379 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T09:40:22.380 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T09:40:22.380 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.380 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2023-12-19T09:40:22.380 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2023-12-19T09:40:22.380 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.380 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2023-12-19T09:40:22.380 INFO:teuthology.orchestra.run.smithi178.stdout: mon min osdmap epochs = 50 2023-12-19T09:40:22.381 INFO:teuthology.orchestra.run.smithi178.stdout: mon osdmap full prune interval = 2 2023-12-19T09:40:22.381 INFO:teuthology.orchestra.run.smithi178.stdout: mon osdmap full prune min = 15 2023-12-19T09:40:22.381 INFO:teuthology.orchestra.run.smithi178.stdout: mon osdmap full prune txsize = 2 2023-12-19T09:40:22.381 INFO:teuthology.orchestra.run.smithi178.stdout: paxos service trim min = 10 2023-12-19T09:40:22.381 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on pool no app = False 2023-12-19T09:40:22.381 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default crimson = True 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T09:40:22.382 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-12-19T09:40:22.383 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-12-19T09:40:22.383 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T09:40:22.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T09:40:22.466 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T09:40:22.466 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:22.466 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T09:40:22.481 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:22.481 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T09:40:22.536 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2023-12-19T09:40:22.537 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:22.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T09:40:22.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T09:40:22.618 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:22.618 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:22.674 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2023-12-19T09:40:22.674 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:22.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T09:40:22.674 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T09:40:22.714 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:22.714 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:22.769 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T09:40:22.769 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T09:40:22.770 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T09:40:22.881 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T09:40:22.884 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T09:40:22.884 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T09:40:22.885 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T09:40:22.934 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T09:40:22.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-19T09:40:22.998 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-19T09:40:23.013 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T09:40:23.014 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2023-12-19T09:40:23.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T09:40:23.040 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-19T09:40:23.040 INFO:tasks.ceph:role: osd.0 2023-12-19T09:40:23.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-19T09:40:23.040 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T09:40:23.114 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T09:40:23.115 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T09:40:23.636 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-12-19T09:40:23.639 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-12-19T09:40:23.639 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T09:40:23.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T09:40:23.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T09:40:23.880 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2023-12-19T09:40:23.880 INFO:tasks.ceph:role: osd.1 2023-12-19T09:40:23.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-19T09:40:23.880 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T09:40:23.954 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T09:40:23.954 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T09:40:23.954 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T09:40:23.954 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T09:40:23.954 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T09:40:23.955 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2023-12-19T09:40:23.955 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T09:40:23.955 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T09:40:23.955 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T09:40:23.955 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T09:40:24.401 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2023-12-19T09:40:24.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2023-12-19T09:40:24.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T09:40:24.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T09:40:24.520 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:25.043 INFO:teuthology.orchestra.run.smithi099.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:25.044 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,044 seastar - Reactor backend: linux-aio 2023-12-19T09:40:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,064 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,064 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,064 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:25.064 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,064 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:25.066 INFO:teuthology.orchestra.run.smithi099.stderr:==80263==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:25.072 INFO:teuthology.orchestra.run.smithi099.stderr:==80263==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcddc35000; bottom 0x7fcbd08d5000; size: 0x00310d360000 (210675040256) 2023-12-19T09:40:25.072 INFO:teuthology.orchestra.run.smithi099.stderr:False positive error reports may follow 2023-12-19T09:40:25.073 INFO:teuthology.orchestra.run.smithi099.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:25.107 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,107 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-19T09:40:25.108 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,107 [shard 0] osd - get_early_config: set --smp 3 2023-12-19T09:40:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:Suppressions used: 2023-12-19T09:40:25.607 INFO:teuthology.orchestra.run.smithi099.stderr: count bytes template 2023-12-19T09:40:25.607 INFO:teuthology.orchestra.run.smithi099.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:25.607 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:25.607 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:40:25.662 INFO:teuthology.orchestra.run.smithi099.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:25.662 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,663 seastar - Reactor backend: linux-aio 2023-12-19T09:40:25.680 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,681 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:25.681 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,681 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:25.681 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,681 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:25.688 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:25,688 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:25.690 INFO:teuthology.orchestra.run.smithi099.stderr:==80261==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:25.696 INFO:teuthology.orchestra.run.smithi099.stderr:==80261==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffcddc35000; bottom 0x7fcbce6ce000; size: 0x00310f567000 (210710720512) 2023-12-19T09:40:25.696 INFO:teuthology.orchestra.run.smithi099.stderr:False positive error reports may follow 2023-12-19T09:40:25.696 INFO:teuthology.orchestra.run.smithi099.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:29.012 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:29.012 INFO:teuthology.orchestra.run.smithi099.stderr:Suppressions used: 2023-12-19T09:40:29.012 INFO:teuthology.orchestra.run.smithi099.stderr: count bytes template 2023-12-19T09:40:29.012 INFO:teuthology.orchestra.run.smithi099.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:29.012 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:29.012 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:40:29.013 INFO:teuthology.orchestra.run.smithi099.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:29.051 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T09:40:29.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:29.580 INFO:teuthology.orchestra.run.smithi099.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:29,581 seastar - Reactor backend: linux-aio 2023-12-19T09:40:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:29,597 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:29,597 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:29,597 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:29,597 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:==81071==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:==81071==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe584bd000; bottom 0x7fbd8bde7000; size: 0x0040cc6d6000 (278307627008) 2023-12-19T09:40:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:False positive error reports may follow 2023-12-19T09:40:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:29.631 INFO:teuthology.orchestra.run.smithi099.stderr:Reactor stalled for 32 ms on shard 0. Backtrace: 0x45d5d 0x2cbaab08 0x2cbabeb6 0x2cbad404 0x2cbad788 0x2cbad8d2 0x2cbadd28 0x54daf 0x39784 0x3a3ab 0x1ea39ea3 0x2045a555 0x231ab0bb 0x231acf95 0x231b3e09 0x22f9a630 0x22e5a31b 0x24ea3960 0x24eab116 0x24eada64 0x24eaec3d 0x229f6257 0x22a46eb6 0x22a6a991 0x2cb4ce23 0x2cbeac30 0x2ce0f7a1 0x2ce115eb 0x2c865ce0 0x2c867be9 0x1f076374 0x1f07f111 0x1eeed53a 0x3feaf 0x3ff5f 0x1e996a44 2023-12-19T09:40:29.631 INFO:teuthology.orchestra.run.smithi099.stderr:kernel callstack: 2023-12-19T09:40:29.639 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:29,639 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-19T09:40:29.639 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:29,639 [shard 0] osd - get_early_config: set --smp 3 2023-12-19T09:40:30.104 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:30.104 INFO:teuthology.orchestra.run.smithi099.stderr:Suppressions used: 2023-12-19T09:40:30.104 INFO:teuthology.orchestra.run.smithi099.stderr: count bytes template 2023-12-19T09:40:30.104 INFO:teuthology.orchestra.run.smithi099.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:30.104 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:30.105 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:40:30.158 INFO:teuthology.orchestra.run.smithi099.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:30.158 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:30,159 seastar - Reactor backend: linux-aio 2023-12-19T09:40:30.176 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:30,177 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:30,177 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:30,177 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:30.184 INFO:teuthology.orchestra.run.smithi099.stderr:INFO 2023-12-19 09:40:30,184 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:30.186 INFO:teuthology.orchestra.run.smithi099.stderr:==81069==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:30.192 INFO:teuthology.orchestra.run.smithi099.stderr:==81069==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe584bd000; bottom 0x7fbd89be0000; size: 0x0040ce8dd000 (278343307264) 2023-12-19T09:40:30.193 INFO:teuthology.orchestra.run.smithi099.stderr:False positive error reports may follow 2023-12-19T09:40:30.193 INFO:teuthology.orchestra.run.smithi099.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:Suppressions used: 2023-12-19T09:40:33.536 INFO:teuthology.orchestra.run.smithi099.stderr: count bytes template 2023-12-19T09:40:33.536 INFO:teuthology.orchestra.run.smithi099.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:----------------------------------------------------- 2023-12-19T09:40:33.536 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:40:33.536 INFO:teuthology.orchestra.run.smithi099.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:33.576 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T09:40:33.603 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T09:40:33.635 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-19T09:40:33.635 INFO:tasks.ceph:role: osd.2 2023-12-19T09:40:33.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2023-12-19T09:40:33.635 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T09:40:33.704 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T09:40:33.704 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T09:40:33.704 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T09:40:33.705 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T09:40:33.705 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T09:40:33.705 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-12-19T09:40:33.705 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T09:40:33.705 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T09:40:33.705 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T09:40:33.705 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T09:40:33.737 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-12-19T09:40:33.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-12-19T09:40:33.739 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-12-19T09:40:33.812 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T09:40:33.884 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T09:40:33.951 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2023-12-19T09:40:33.952 INFO:tasks.ceph:role: osd.3 2023-12-19T09:40:33.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2023-12-19T09:40:33.952 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T09:40:34.018 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T09:40:34.018 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T09:40:34.018 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T09:40:34.018 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T09:40:34.019 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T09:40:34.019 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-12-19T09:40:34.019 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T09:40:34.019 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T09:40:34.019 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T09:40:34.019 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T09:40:34.050 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2023-12-19T09:40:34.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-12-19T09:40:34.052 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2023-12-19T09:40:34.123 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T09:40:34.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:34.743 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:34.743 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:34,744 seastar - Reactor backend: linux-aio 2023-12-19T09:40:34.764 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:34,764 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:34.765 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:34,765 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:34.765 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:34,765 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:34.765 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:34,765 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:34.766 INFO:teuthology.orchestra.run.smithi178.stderr:==80674==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:34.773 INFO:teuthology.orchestra.run.smithi178.stderr:==80674==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff9091a000; bottom 0x7f64d5f70000; size: 0x009aba9aa000 (664555659264) 2023-12-19T09:40:34.773 INFO:teuthology.orchestra.run.smithi178.stderr:False positive error reports may follow 2023-12-19T09:40:34.773 INFO:teuthology.orchestra.run.smithi178.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:34.809 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:34,809 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-19T09:40:34.809 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:34,809 [shard 0] osd - get_early_config: set --smp 3 2023-12-19T09:40:35.312 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:35.313 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2023-12-19T09:40:35.313 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2023-12-19T09:40:35.313 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:35.313 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:35.313 INFO:teuthology.orchestra.run.smithi178.stderr: 2023-12-19T09:40:35.366 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:35.367 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:35,367 seastar - Reactor backend: linux-aio 2023-12-19T09:40:35.385 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:35,385 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:35.385 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:35,385 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:35.385 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:35,385 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:35.392 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:35,393 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:35.395 INFO:teuthology.orchestra.run.smithi178.stderr:==80665==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:35.401 INFO:teuthology.orchestra.run.smithi178.stderr:==80665==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7fff9091a000; bottom 0x7f64d3d69000; size: 0x009abcbb1000 (664591339520) 2023-12-19T09:40:35.401 INFO:teuthology.orchestra.run.smithi178.stderr:False positive error reports may follow 2023-12-19T09:40:35.401 INFO:teuthology.orchestra.run.smithi178.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:35.482 INFO:teuthology.orchestra.run.smithi178.stderr:Reactor stalled for 33 ms on shard 0. Backtrace: 0x45d5d 0x2cbaab08 0x2cbabeb6 0x2cbad404 0x2cbad788 0x2cbad8d2 0x2cbadd28 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x2670f1f8 0x26711841 0x26713652 0x26715eb7 0x265469df 0x1efab658 0x1ef1d065 0x1ef20ea6 0x2cf2f415 2023-12-19T09:40:35.482 INFO:teuthology.orchestra.run.smithi178.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffb226ab17 0xffffffffb2266447 0xffffffffb24000ea 2023-12-19T09:40:38.465 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:38.466 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2023-12-19T09:40:38.466 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2023-12-19T09:40:38.466 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:38.466 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:38.466 INFO:teuthology.orchestra.run.smithi178.stderr: 2023-12-19T09:40:38.466 INFO:teuthology.orchestra.run.smithi178.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:38.506 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T09:40:38.533 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:39.047 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:39.047 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,048 seastar - Reactor backend: linux-aio 2023-12-19T09:40:39.064 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,065 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,065 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,065 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:39.065 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,065 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:39.066 INFO:teuthology.orchestra.run.smithi178.stderr:==81483==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:39.073 INFO:teuthology.orchestra.run.smithi178.stderr:==81483==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe30b6a000; bottom 0x7f1a26141000; size: 0x00e40aa29000 (979430969344) 2023-12-19T09:40:39.073 INFO:teuthology.orchestra.run.smithi178.stderr:False positive error reports may follow 2023-12-19T09:40:39.073 INFO:teuthology.orchestra.run.smithi178.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:39.107 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,107 [shard 0] osd - bypassing the config fetch due to --no-mon-config 2023-12-19T09:40:39.107 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,107 [shard 0] osd - get_early_config: set --smp 3 2023-12-19T09:40:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2023-12-19T09:40:39.574 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2023-12-19T09:40:39.574 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:39.574 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:39.575 INFO:teuthology.orchestra.run.smithi178.stderr: 2023-12-19T09:40:39.628 INFO:teuthology.orchestra.run.smithi178.stderr:WARNING: debug mode. Not for benchmarking or production 2023-12-19T09:40:39.629 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,629 seastar - Reactor backend: linux-aio 2023-12-19T09:40:39.647 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,647 [shard 1] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000 2023-12-19T09:40:39.647 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,647 [shard 1] seastar - IO queue uses 0.75ms latency goal for device 0 2023-12-19T09:40:39.647 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,647 [shard 1] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647 2023-12-19T09:40:39.655 INFO:teuthology.orchestra.run.smithi178.stderr:INFO 2023-12-19 09:40:39,655 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000 2023-12-19T09:40:39.657 INFO:teuthology.orchestra.run.smithi178.stderr:==81481==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2023-12-19T09:40:39.663 INFO:teuthology.orchestra.run.smithi178.stderr:==81481==WARNING: ASan is ignoring requested __asan_handle_no_return: stack type: default top: 0x7ffe30b6a000; bottom 0x7f1a23f3a000; size: 0x00e40cc30000 (979466649600) 2023-12-19T09:40:39.663 INFO:teuthology.orchestra.run.smithi178.stderr:False positive error reports may follow 2023-12-19T09:40:39.663 INFO:teuthology.orchestra.run.smithi178.stderr:For details see https://github.com/google/sanitizers/issues/189 2023-12-19T09:40:39.757 INFO:teuthology.orchestra.run.smithi178.stderr:Reactor stalled for 33 ms on shard 0. Backtrace: 0x45d5d 0x2cbaab08 0x2cbabeb6 0x2cbad404 0x2cbad788 0x2cbad8d2 0x2cbadd28 0x54daf 0xce1ca 0x588c4 0xdb9f8 0x2670f1f8 0x26711841 0x26713652 0x26715eb7 0x265469df 0x1efab658 0x1ef1d065 0x1ef20ea6 0x2cf2f415 2023-12-19T09:40:39.758 INFO:teuthology.orchestra.run.smithi178.stderr:kernel callstack: 0xffffffffffffff80 0xffffffffb22758f4 0xffffffffb2275d8d 0xffffffffb17508ea 0xffffffffb226646c 0xffffffffb24000ea 2023-12-19T09:40:42.755 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:42.755 INFO:teuthology.orchestra.run.smithi178.stderr:Suppressions used: 2023-12-19T09:40:42.755 INFO:teuthology.orchestra.run.smithi178.stderr: count bytes template 2023-12-19T09:40:42.755 INFO:teuthology.orchestra.run.smithi178.stderr: 1 8 MallocExtension::Register 2023-12-19T09:40:42.755 INFO:teuthology.orchestra.run.smithi178.stderr:----------------------------------------------------- 2023-12-19T09:40:42.755 INFO:teuthology.orchestra.run.smithi178.stderr: 2023-12-19T09:40:42.755 INFO:teuthology.orchestra.run.smithi178.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:40:42.795 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T09:40:42.821 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T09:40:42.821 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:42.821 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T09:40:42.853 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:42.853 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T09:40:42.924 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:42.924 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T09:40:42.950 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:42.950 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T09:40:43.016 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:43.017 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T09:40:43.083 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:43.084 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T09:40:43.101 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:43.102 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-19T09:40:43.138 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T09:40:43.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAJZYFl3I5yLBAAEuBJ7/nGU4rhBorFv+mhNg== 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAOZYFl0kBtDhAATZW+kiu4QdZXx3V9DqnBxw== 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAGZYFl3oaSNBAAtPzaGtzfFeYchL8ZbEJ9FQ== 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2023-12-19T09:40:43.171 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQATZYFlpmHQGhAAmaLTPf4zLFeZGDLLMLiPsQ== 2023-12-19T09:40:43.172 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2023-12-19T09:40:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAXZYFleuU7KxAAE4Vm267oxG2UOUFry2oZ2w== 2023-12-19T09:40:43.172 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2023-12-19T09:40:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAGZYFlkv+zNxAAAedxH3XfN1HZfbrghZTsEA== 2023-12-19T09:40:43.172 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2023-12-19T09:40:43.172 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQAGZYFlMiSHOxAAkq0xZ+ykVk5CC0QgYe80aw== 2023-12-19T09:40:43.173 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T09:40:43.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T09:40:43.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T09:40:43.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T09:40:43.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T09:40:43.513 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T09:40:43.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T09:40:43.635 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T09:40:43.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T09:40:43.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T09:40:43.765 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:43.764+0000 7fe0da834980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:43.765 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:43.764+0000 7fe0da834980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:43.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T09:40:43.807 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T09:40:43.862 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T09:40:43.862 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T09:40:43.862 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T09:40:43.905 INFO:tasks.ceph.mon.a:Started 2023-12-19T09:40:43.905 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T09:40:43.905 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T09:40:43.905 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T09:40:43.908 INFO:tasks.ceph.mgr.x:Started 2023-12-19T09:40:43.908 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T09:40:43.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T09:40:43.983 INFO:tasks.ceph.mon.a.smithi099.stderr:2023-12-19T09:40:43.982+0000 7eff9ca3b980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:43.983 INFO:tasks.ceph.mon.a.smithi099.stderr:2023-12-19T09:40:43.982+0000 7eff9ca3b980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:43.983 INFO:tasks.ceph.mon.a.smithi099.stderr:2023-12-19T09:40:43.983+0000 7eff9ca3b980 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.004 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:44.004+0000 7f40e6f6df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.014 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.008+0000 7fb11155e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.014+0000 7fb11155e640 1 Processor -- start 2023-12-19T09:40:44.015 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.014+0000 7fb11155e640 1 -- start start 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb11155e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 0x7fb10c132f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb11155e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0a1870 con 0x7fb10c1334c0 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb11155e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c09cb90 con 0x7fb10c0a1040 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10affd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 0x7fb10c132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10affd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 0x7fb10c132f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59184/0 (socket says 172.21.15.99:59184) 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10affd640 1 -- 172.21.15.99:0/1682706766 learned_addr learned my addr 172.21.15.99:0/1682706766 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10a7fc640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb10c1334c0 0x7fb10c1382c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57426/0 (socket says 172.21.15.99:57426) 2023-12-19T09:40:44.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10affd640 1 -- 172.21.15.99:0/1682706766 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 msgr2=0x7fb10c132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10affd640 1 -- 172.21.15.99:0/1682706766 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 msgr2=0x7fb10c132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10affd640 1 --2- 172.21.15.99:0/1682706766 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 0x7fb10c132f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T09:40:44.017 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.015+0000 7fb10affd640 1 --2- 172.21.15.99:0/1682706766 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 0x7fb10c132f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242953270 0 0) 0x7fb10c0a1870 con 0x7fb10c1334c0 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f40034f0 con 0x7fb10c1334c0 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 617441252 0 0) 0x7fb0f40034f0 con 0x7fb10c1334c0 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 msgr2=0x7fb10c132f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 --2- 172.21.15.99:0/1682706766 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 0x7fb10c132f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c1300a0 con 0x7fb10c1334c0 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 139634355 0 0) 0x7fb1000015a0 con 0x7fb10c1334c0 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 >> v1:172.21.15.99:6789/0 conn(0x7fb10c1334c0 legacy=0x7fb10c1382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 --2- 172.21.15.99:0/1682706766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb0f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:44.035 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c09cb90 con 0x7fb0f4003940 2023-12-19T09:40:44.036 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.033+0000 7fb10affd640 1 --2- 172.21.15.99:0/1682706766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb0f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:44.036 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.034+0000 7fb10affd640 1 -- 172.21.15.99:0/1682706766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f40034f0 con 0x7fb0f4003940 2023-12-19T09:40:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.035+0000 7fb10affd640 1 --2- 172.21.15.99:0/1682706766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb0f4003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4cf96e9de45421 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.035+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb104009600 con 0x7fb0f4003940 2023-12-19T09:40:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.035+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb10400c040 con 0x7fb0f4003940 2023-12-19T09:40:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.035+0000 7fb109ffb640 1 -- 172.21.15.99:0/1682706766 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb104009ca0 con 0x7fb0f4003940 2023-12-19T09:40:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 -- 172.21.15.99:0/1682706766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 msgr2=0x7fb0f4003d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 --2- 172.21.15.99:0/1682706766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb0f4003d90 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.037 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 -- 172.21.15.99:0/1682706766 shutdown_connections 2023-12-19T09:40:44.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 --2- 172.21.15.99:0/1682706766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb0f4003d90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 --2- 172.21.15.99:0/1682706766 >> v2:172.21.15.99:3300/0 conn(0x7fb10c0a1040 0x7fb10c132f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 -- 172.21.15.99:0/1682706766 >> 172.21.15.99:0/1682706766 conn(0x7fb10c06c9c0 msgr2=0x7fb10c06cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:44.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 -- 172.21.15.99:0/1682706766 shutdown_connections 2023-12-19T09:40:44.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 1 -- 172.21.15.99:0/1682706766 wait complete. 2023-12-19T09:40:44.038 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.036+0000 7fb11155e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.039 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:44.037+0000 7f40e6f6df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.039 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:44.037+0000 7f40e6f6df00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.038+0000 7fb11155e640 1 Processor -- start 2023-12-19T09:40:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.038+0000 7fb11155e640 1 -- start start 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.038+0000 7fb11155e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb10c1c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.038+0000 7fb11155e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c1c7b80 con 0x7fb0f4003940 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.038+0000 7fb10affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb10c1c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.038+0000 7fb10affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb10c1c8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59202/0 (socket says 172.21.15.99:59202) 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.038+0000 7fb10affd640 1 -- 172.21.15.99:0/1608706961 learned_addr learned my addr 172.21.15.99:0/1608706961 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb10affd640 1 -- 172.21.15.99:0/1608706961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c11cef0 con 0x7fb0f4003940 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb10affd640 1 --2- 172.21.15.99:0/1608706961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb10c1c8150 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb0f37fe640 1 -- 172.21.15.99:0/1608706961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb1040094a0 con 0x7fb0f4003940 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb0f37fe640 1 -- 172.21.15.99:0/1608706961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb104014d00 con 0x7fb0f4003940 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb0f37fe640 1 -- 172.21.15.99:0/1608706961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb104009600 con 0x7fb0f4003940 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c1c7db0 con 0x7fb0f4003940 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c11dec0 con 0x7fb0f4003940 2023-12-19T09:40:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb0f37fe640 1 -- 172.21.15.99:0/1608706961 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fb104016430 con 0x7fb0f4003940 2023-12-19T09:40:44.042 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.039+0000 7fb0f37fe640 1 -- 172.21.15.99:0/1608706961 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (crc 0 0 0) 0x7fb10401b040 con 0x7fb0f4003940 2023-12-19T09:40:44.042 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.040+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c067c60 con 0x7fb0f4003940 2023-12-19T09:40:44.042 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.042+0000 7fb0f37fe640 1 -- 172.21.15.99:0/1608706961 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7fb10400f040 con 0x7fb0f4003940 2023-12-19T09:40:44.106 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.105+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb10c062350 con 0x7fb0f4003940 2023-12-19T09:40:44.107 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb0f37fe640 1 -- 172.21.15.99:0/1608706961 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (crc 0 0 0) 0x7fb1040169c0 con 0x7fb0f4003940 2023-12-19T09:40:44.107 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2023-12-19T09:40:44.108 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 msgr2=0x7fb10c1c8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:44.108 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb11155e640 1 --2- 172.21.15.99:0/1608706961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb10c1c8150 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.108 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 shutdown_connections 2023-12-19T09:40:44.108 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb11155e640 1 --2- 172.21.15.99:0/1608706961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0f4003940 0x7fb10c1c8150 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.108 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 >> 172.21.15.99:0/1608706961 conn(0x7fb10c06c9c0 msgr2=0x7fb10c0a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:44.108 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 shutdown_connections 2023-12-19T09:40:44.109 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.107+0000 7fb11155e640 1 -- 172.21.15.99:0/1608706961 wait complete. 2023-12-19T09:40:44.118 INFO:tasks.ceph:check_enable_crimson: True 2023-12-19T09:40:44.118 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2023-12-19T09:40:44.119 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2023-12-19T09:40:44.221 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.216+0000 7f0b5d013640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.222 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.221+0000 7f0b5d013640 1 Processor -- start 2023-12-19T09:40:44.222 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.221+0000 7f0b5d013640 1 -- start start 2023-12-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b5d013640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b58097960 0x7f0b5812f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b5d013640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b58098960 con 0x7f0b58097d70 2023-12-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b5d013640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5809a2a0 con 0x7f0b58097960 2023-12-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b56d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b58097960 0x7f0b5812f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b5659c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0b58097d70 0x7f0b5812f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57438/0 (socket says 172.21.15.99:57438) 2023-12-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b56d9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b58097960 0x7f0b5812f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59216/0 (socket says 172.21.15.99:59216) 2023-12-19T09:40:44.223 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b5659c640 1 -- 172.21.15.99:0/2605939409 learned_addr learned my addr 172.21.15.99:0/2605939409 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:44.224 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b56d9d640 1 -- 172.21.15.99:0/2605939409 >> v1:172.21.15.99:6789/0 conn(0x7f0b58097d70 legacy=0x7f0b5812f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:44.224 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b56d9d640 1 -- 172.21.15.99:0/2605939409 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b58072800 con 0x7f0b58097960 2023-12-19T09:40:44.224 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b56d9d640 1 --2- 172.21.15.99:0/2605939409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b5812f240 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89df55e5a3859dce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:44.224 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b55d9b640 1 -- 172.21.15.99:0/2605939409 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0b4800e040 con 0x7f0b58097960 2023-12-19T09:40:44.224 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b55d9b640 1 -- 172.21.15.99:0/2605939409 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0b48007670 con 0x7f0b58097960 2023-12-19T09:40:44.224 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.222+0000 7f0b55d9b640 1 -- 172.21.15.99:0/2605939409 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0b48007910 con 0x7f0b58097960 2023-12-19T09:40:44.225 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 1 -- 172.21.15.99:0/2605939409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 msgr2=0x7f0b5812f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:44.225 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 1 --2- 172.21.15.99:0/2605939409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b5812f240 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.225 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 1 -- 172.21.15.99:0/2605939409 shutdown_connections 2023-12-19T09:40:44.225 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 1 --2- 172.21.15.99:0/2605939409 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b5812f240 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:44.225 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 1 -- 172.21.15.99:0/2605939409 >> 172.21.15.99:0/2605939409 conn(0x7f0b5809dff0 msgr2=0x7f0b5809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:44.225 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 1 -- 172.21.15.99:0/2605939409 shutdown_connections 2023-12-19T09:40:44.225 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 1 -- 172.21.15.99:0/2605939409 wait complete. 2023-12-19T09:40:44.226 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.223+0000 7f0b5d013640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:44.226 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.225+0000 7f0b5d013640 1 Processor -- start 2023-12-19T09:40:44.226 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.225+0000 7f0b5d013640 1 -- start start 2023-12-19T09:40:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.225+0000 7f0b5d013640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b58126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.225+0000 7f0b5d013640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581271e0 con 0x7f0b58097960 2023-12-19T09:40:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.225+0000 7f0b56d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b58126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.225+0000 7f0b56d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b58126040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59232/0 (socket says 172.21.15.99:59232) 2023-12-19T09:40:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.225+0000 7f0b56d9d640 1 -- 172.21.15.99:0/501385780 learned_addr learned my addr 172.21.15.99:0/501385780 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b56d9d640 1 -- 172.21.15.99:0/501385780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5812fcd0 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b56d9d640 1 --2- 172.21.15.99:0/501385780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b58126040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b3f7fe640 1 -- 172.21.15.99:0/501385780 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0b4800e040 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b3f7fe640 1 -- 172.21.15.99:0/501385780 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0b48012a80 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b58134c30 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b3f7fe640 1 -- 172.21.15.99:0/501385780 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0b48012d20 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b58128cd0 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b3f7fe640 1 -- 172.21.15.99:0/501385780 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f0b480156f0 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.226+0000 7f0b3f7fe640 1 -- 172.21.15.99:0/501385780 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (crc 0 0 0) 0x7f0b48014650 con 0x7f0b58097960 2023-12-19T09:40:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.227+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b58062350 con 0x7f0b58097960 2023-12-19T09:40:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.229+0000 7f0b3f7fe640 1 -- 172.21.15.99:0/501385780 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f0b48015b80 con 0x7f0b58097960 2023-12-19T09:40:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:44.302+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0b580670b0 con 0x7f0b58097960 2023-12-19T09:40:44.303 INFO:tasks.ceph.mon.a.smithi099.stderr:2023-12-19T09:40:44.302+0000 7eff93df1640 -1 WARNING: experimental feature 'crimson' is enabled 2023-12-19T09:40:44.303 INFO:tasks.ceph.mon.a.smithi099.stderr:Please be aware that this feature is experimental, untested, 2023-12-19T09:40:44.303 INFO:tasks.ceph.mon.a.smithi099.stderr:unsupported, and may result in data corruption, data loss, 2023-12-19T09:40:44.304 INFO:tasks.ceph.mon.a.smithi099.stderr:and/or irreparable damage to your cluster. Do not use 2023-12-19T09:40:44.304 INFO:tasks.ceph.mon.a.smithi099.stderr:feature with important data. 2023-12-19T09:40:44.304 INFO:tasks.ceph.mon.a.smithi099.stderr: 2023-12-19T09:40:44.476 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:44.476+0000 7f40e6f6df00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T09:40:44.526 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:44.526+0000 7f40e6f6df00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T09:40:45.061 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.061+0000 7f40e6f6df00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T09:40:45.108 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.107+0000 7f0b3f7fe640 1 -- 172.21.15.99:0/501385780 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) v1 ==== 99+0+0 (crc 0 0 0) 0x7f0b48015d20 con 0x7f0b58097960 2023-12-19T09:40:45.109 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.108+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 msgr2=0x7f0b58126040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.109 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.108+0000 7f0b5d013640 1 --2- 172.21.15.99:0/501385780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b58126040 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.109 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.108+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 shutdown_connections 2023-12-19T09:40:45.110 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.108+0000 7f0b5d013640 1 --2- 172.21.15.99:0/501385780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b58097960 0x7f0b58126040 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.110 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.109+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 >> 172.21.15.99:0/501385780 conn(0x7f0b5809dff0 msgr2=0x7f0b5809b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:45.110 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.109+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 shutdown_connections 2023-12-19T09:40:45.110 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:45.109+0000 7f0b5d013640 1 -- 172.21.15.99:0/501385780 wait complete. 2023-12-19T09:40:45.113 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.113+0000 7f40e6f6df00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T09:40:45.122 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T09:40:45.123 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:45.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T09:40:45.152 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:40:45.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T09:40:45.162 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.162+0000 7f40e6f6df00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T09:40:45.218 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.219+0000 7f40e6f6df00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T09:40:45.221 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:45.221 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T09:40:45.248 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-12-19T09:40:45.248 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T09:40:45.264 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.264+0000 7f40e6f6df00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T09:40:45.290 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 774e1dc8-872f-44c8-9e3e-aabe7df13883 0 2023-12-19T09:40:45.372 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.372+0000 7f40e6f6df00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T09:40:45.434 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.429+0000 7f9b7c22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:45.435 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b7c22d640 1 Processor -- start 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b7c22d640 1 -- start start 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b7c22d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b74118180 0x7f9b74111e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b7c22d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b74118800 con 0x7f9b74112340 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b7c22d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b74112750 con 0x7f9b74118180 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b797c8640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9b74112340 0x7f9b7411cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.178:38254/0 (socket says 172.21.15.178:38254) 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b79fc9640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b74118180 0x7f9b74111e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.435+0000 7f9b797c8640 1 -- 172.21.15.178:0/1359325468 learned_addr learned my addr 172.21.15.178:0/1359325468 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b78fc7640 1 -- 172.21.15.178:0/1359325468 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646299169 0 0) 0x7f9b74118800 con 0x7f9b74112340 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b78fc7640 1 -- 172.21.15.178:0/1359325468 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b600034f0 con 0x7f9b74112340 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b79fc9640 1 -- 172.21.15.178:0/1359325468 >> v1:172.21.15.99:6789/0 conn(0x7f9b74112340 legacy=0x7f9b7411cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b79fc9640 1 -- 172.21.15.178:0/1359325468 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b741128c0 con 0x7f9b74118180 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b79fc9640 1 --2- 172.21.15.178:0/1359325468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74118180 0x7f9b74111e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d70d1c7bdf76242 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:45.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b78fc7640 1 -- 172.21.15.178:0/1359325468 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b64009ce0 con 0x7f9b74118180 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b78fc7640 1 -- 172.21.15.178:0/1359325468 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9b64009e40 con 0x7f9b74118180 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.436+0000 7f9b78fc7640 1 -- 172.21.15.178:0/1359325468 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b6400e360 con 0x7f9b74118180 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1359325468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74118180 msgr2=0x7f9b74111e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 1 --2- 172.21.15.178:0/1359325468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74118180 0x7f9b74111e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1359325468 shutdown_connections 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 1 --2- 172.21.15.178:0/1359325468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74118180 0x7f9b74111e00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1359325468 >> 172.21.15.178:0/1359325468 conn(0x7f9b7410dd70 msgr2=0x7f9b74110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1359325468 shutdown_connections 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1359325468 wait complete. 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.437+0000 7f9b7c22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.438+0000 7f9b7c22d640 1 Processor -- start 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.438+0000 7f9b7c22d640 1 -- start start 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.438+0000 7f9b7c22d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74112340 0x7f9b741a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:45.441 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.438+0000 7f9b7c22d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b741a72f0 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.438+0000 7f9b79fc9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74112340 0x7f9b741a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.438+0000 7f9b79fc9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74112340 0x7f9b741a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.178:53378/0 (socket says 172.21.15.178:53378) 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.438+0000 7f9b79fc9640 1 -- 172.21.15.178:0/1894025809 learned_addr learned my addr 172.21.15.178:0/1894025809 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b79fc9640 1 -- 172.21.15.178:0/1894025809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b741a7430 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b79fc9640 1 --2- 172.21.15.178:0/1894025809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74112340 0x7f9b741a6db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b6a7fc640 1 -- 172.21.15.178:0/1894025809 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b64014540 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b6a7fc640 1 -- 172.21.15.178:0/1894025809 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9b640146a0 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b6a7fc640 1 -- 172.21.15.178:0/1894025809 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9b64014940 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b741a7680 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b741ab4b0 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b6a7fc640 1 -- 172.21.15.178:0/1894025809 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f9b64013400 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.439+0000 7f9b6a7fc640 1 -- 172.21.15.178:0/1894025809 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 747+0+0 (crc 0 0 0) 0x7f9b64014df0 con 0x7f9b74112340 2023-12-19T09:40:45.442 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.440+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b741a7810 con 0x7f9b74112340 2023-12-19T09:40:45.443 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.442+0000 7f9b6a7fc640 1 -- 172.21.15.178:0/1894025809 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f9b64013890 con 0x7f9b74112340 2023-12-19T09:40:45.446 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.446+0000 7f40e6f6df00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T09:40:45.494 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.494+0000 7f40e6f6df00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T09:40:45.514 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.514+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "774e1dc8-872f-44c8-9e3e-aabe7df13883", "id": 0} v 0) v1 -- 0x7f9b74112c30 con 0x7f9b74112340 2023-12-19T09:40:45.516 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.516+0000 7f9b6a7fc640 1 -- 172.21.15.178:0/1894025809 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "774e1dc8-872f-44c8-9e3e-aabe7df13883", "id": 0}]=0 v4) v1 ==== 112+0+2 (crc 0 0 0) 0x7f9b64013b00 con 0x7f9b74112340 2023-12-19T09:40:45.516 INFO:teuthology.orchestra.run.smithi178.stdout:0 2023-12-19T09:40:45.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.517+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74112340 msgr2=0x7f9b741a6db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.517+0000 7f9b7c22d640 1 --2- 172.21.15.178:0/1894025809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74112340 0x7f9b741a6db0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.517+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 shutdown_connections 2023-12-19T09:40:45.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.517+0000 7f9b7c22d640 1 --2- 172.21.15.178:0/1894025809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b74112340 0x7f9b741a6db0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.517+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 >> 172.21.15.178:0/1894025809 conn(0x7f9b7410dd70 msgr2=0x7f9b74113e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:45.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.517+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 shutdown_connections 2023-12-19T09:40:45.517 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.517+0000 7f9b7c22d640 1 -- 172.21.15.178:0/1894025809 wait complete. 2023-12-19T09:40:45.528 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 842562c8-a91c-40f8-9fd3-349029d8a22f 1 2023-12-19T09:40:45.549 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.549+0000 7f40e6f6df00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T09:40:45.599 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:45.599+0000 7f40e6f6df00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T09:40:45.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.649+0000 7f3dfc19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:45.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.655+0000 7f3dfc19e640 1 Processor -- start 2023-12-19T09:40:45.655 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.655+0000 7f3dfc19e640 1 -- start start 2023-12-19T09:40:45.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.655+0000 7f3dfc19e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3df4112510 0x7f3df411db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:45.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.655+0000 7f3dfc19e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df4118800 con 0x7f3df4118180 2023-12-19T09:40:45.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.655+0000 7f3dfc19e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df4112920 con 0x7f3df4112510 2023-12-19T09:40:45.656 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df9739640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3df4112510 0x7f3df411db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df9f3a640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3df4118180 0x7f3df4111e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.178:38264/0 (socket says 172.21.15.178:38264) 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df9f3a640 1 -- 172.21.15.178:0/3263911219 learned_addr learned my addr 172.21.15.178:0/3263911219 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df9739640 1 -- 172.21.15.178:0/3263911219 >> v1:172.21.15.99:6789/0 conn(0x7f3df4118180 legacy=0x7f3df4111e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df9739640 1 -- 172.21.15.178:0/3263911219 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4112a90 con 0x7f3df4112510 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df9739640 1 --2- 172.21.15.178:0/3263911219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df411db60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf82c730a7f85cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df8f38640 1 -- 172.21.15.178:0/3263911219 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3de4009ce0 con 0x7f3df4112510 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df8f38640 1 -- 172.21.15.178:0/3263911219 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3de4009e40 con 0x7f3df4112510 2023-12-19T09:40:45.657 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.656+0000 7f3df8f38640 1 -- 172.21.15.178:0/3263911219 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3de400e360 con 0x7f3df4112510 2023-12-19T09:40:45.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 1 -- 172.21.15.178:0/3263911219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 msgr2=0x7f3df411db60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 1 --2- 172.21.15.178:0/3263911219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df411db60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 1 -- 172.21.15.178:0/3263911219 shutdown_connections 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 1 --2- 172.21.15.178:0/3263911219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df411db60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 1 -- 172.21.15.178:0/3263911219 >> 172.21.15.178:0/3263911219 conn(0x7f3df410dd70 msgr2=0x7f3df4110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 1 -- 172.21.15.178:0/3263911219 shutdown_connections 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 1 -- 172.21.15.178:0/3263911219 wait complete. 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.657+0000 7f3dfc19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.658+0000 7f3dfc19e640 1 Processor -- start 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.658+0000 7f3dfc19e640 1 -- start start 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.658+0000 7f3dfc19e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df41a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.658+0000 7f3dfc19e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df41a73c0 con 0x7f3df4112510 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.658+0000 7f3df9f3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df41a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.658+0000 7f3df9f3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df41a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.178:53390/0 (socket says 172.21.15.178:53390) 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.658+0000 7f3df9f3a640 1 -- 172.21.15.178:0/4207438881 learned_addr learned my addr 172.21.15.178:0/4207438881 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-12-19T09:40:45.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3df9f3a640 1 -- 172.21.15.178:0/4207438881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df41a7500 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3df9f3a640 1 --2- 172.21.15.178:0/4207438881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df41a6df0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3dea7fc640 1 -- 172.21.15.178:0/4207438881 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3df00059d0 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3dea7fc640 1 -- 172.21.15.178:0/4207438881 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3df0005b30 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df41a77b0 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3dea7fc640 1 -- 172.21.15.178:0/4207438881 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3df0005dd0 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df41ab6f0 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3dea7fc640 1 -- 172.21.15.178:0/4207438881 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f3df00073b0 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.659+0000 7f3dea7fc640 1 -- 172.21.15.178:0/4207438881 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 862+0+0 (crc 0 0 0) 0x7f3df000f5f0 con 0x7f3df4112510 2023-12-19T09:40:45.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.660+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df41a79a0 con 0x7f3df4112510 2023-12-19T09:40:45.662 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.662+0000 7f3dea7fc640 1 -- 172.21.15.178:0/4207438881 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f3df41a79a0 con 0x7f3df4112510 2023-12-19T09:40:45.734 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.734+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "842562c8-a91c-40f8-9fd3-349029d8a22f", "id": 1} v 0) v1 -- 0x7f3df41ac160 con 0x7f3df4112510 2023-12-19T09:40:45.735 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.735+0000 7f3dea7fc640 1 -- 172.21.15.178:0/4207438881 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "842562c8-a91c-40f8-9fd3-349029d8a22f", "id": 1}]=0 v5) v1 ==== 112+0+2 (crc 0 0 0) 0x7f3df000c860 con 0x7f3df4112510 2023-12-19T09:40:45.736 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-12-19T09:40:45.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.736+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 msgr2=0x7f3df41a6df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.736+0000 7f3dfc19e640 1 --2- 172.21.15.178:0/4207438881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df41a6df0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.736+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 shutdown_connections 2023-12-19T09:40:45.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.736+0000 7f3dfc19e640 1 --2- 172.21.15.178:0/4207438881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df4112510 0x7f3df41a6df0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.736+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 >> 172.21.15.178:0/4207438881 conn(0x7f3df410dd70 msgr2=0x7f3df4113ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:45.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.736+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 shutdown_connections 2023-12-19T09:40:45.737 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.736+0000 7f3dfc19e640 1 -- 172.21.15.178:0/4207438881 wait complete. 2023-12-19T09:40:45.747 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 7e895fab-1cdf-4c49-80ca-f2b0afb4c81d 2 2023-12-19T09:40:45.853 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.848+0000 7f9757d1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:45.854 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.854+0000 7f9757d1e640 1 Processor -- start 2023-12-19T09:40:45.854 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.854+0000 7f9757d1e640 1 -- start start 2023-12-19T09:40:45.854 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.854+0000 7f9757d1e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9750118180 0x7f9750111e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:45.855 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.854+0000 7f9757d1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9750118800 con 0x7f9750112340 2023-12-19T09:40:45.855 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.854+0000 7f9757d1e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9750112750 con 0x7f9750118180 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9755aba640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9750118180 0x7f9750111e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f97552b9640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9750112340 0x7f975011cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.178:38280/0 (socket says 172.21.15.178:38280) 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f97552b9640 1 -- 172.21.15.178:0/2496025190 learned_addr learned my addr 172.21.15.178:0/2496025190 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9754ab8640 1 -- 172.21.15.178:0/2496025190 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505578461 0 0) 0x7f9750118800 con 0x7f9750112340 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9754ab8640 1 -- 172.21.15.178:0/2496025190 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f973c0034f0 con 0x7f9750112340 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9755aba640 1 -- 172.21.15.178:0/2496025190 >> v1:172.21.15.99:6789/0 conn(0x7f9750112340 legacy=0x7f975011cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9755aba640 1 -- 172.21.15.178:0/2496025190 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97501128c0 con 0x7f9750118180 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9755aba640 1 --2- 172.21.15.178:0/2496025190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750118180 0x7f9750111e00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5b676fb85d04c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9754ab8640 1 -- 172.21.15.178:0/2496025190 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f974c009ce0 con 0x7f9750118180 2023-12-19T09:40:45.856 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.855+0000 7f9754ab8640 1 -- 172.21.15.178:0/2496025190 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f974c009e40 con 0x7f9750118180 2023-12-19T09:40:45.857 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.856+0000 7f9754ab8640 1 -- 172.21.15.178:0/2496025190 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f974c00e360 con 0x7f9750118180 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.856+0000 7f9757d1e640 1 -- 172.21.15.178:0/2496025190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750118180 msgr2=0x7f9750111e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.856+0000 7f9757d1e640 1 --2- 172.21.15.178:0/2496025190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750118180 0x7f9750111e00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.856+0000 7f9757d1e640 1 -- 172.21.15.178:0/2496025190 shutdown_connections 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.856+0000 7f9757d1e640 1 --2- 172.21.15.178:0/2496025190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750118180 0x7f9750111e00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.856+0000 7f9757d1e640 1 -- 172.21.15.178:0/2496025190 >> 172.21.15.178:0/2496025190 conn(0x7f975010dd70 msgr2=0x7f9750110190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.857+0000 7f9757d1e640 1 -- 172.21.15.178:0/2496025190 shutdown_connections 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.857+0000 7f9757d1e640 1 -- 172.21.15.178:0/2496025190 wait complete. 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.857+0000 7f9757d1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.857+0000 7f9757d1e640 1 Processor -- start 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.857+0000 7f9757d1e640 1 -- start start 2023-12-19T09:40:45.859 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9757d1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750112340 0x7f97501a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9757d1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501a72f0 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9755aba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750112340 0x7f97501a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9755aba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750112340 0x7f97501a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.178:53414/0 (socket says 172.21.15.178:53414) 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9755aba640 1 -- 172.21.15.178:0/3452362949 learned_addr learned my addr 172.21.15.178:0/3452362949 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9755aba640 1 -- 172.21.15.178:0/3452362949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97501a7430 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9755aba640 1 --2- 172.21.15.178:0/3452362949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750112340 0x7f97501a6db0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f97467fc640 1 -- 172.21.15.178:0/3452362949 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f974c014540 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f97467fc640 1 -- 172.21.15.178:0/3452362949 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f974c0146a0 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97501a7680 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.858+0000 7f97467fc640 1 -- 172.21.15.178:0/3452362949 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f974c014940 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.859+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97501ab4b0 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.859+0000 7f97467fc640 1 -- 172.21.15.178:0/3452362949 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f974c013400 con 0x7f9750112340 2023-12-19T09:40:45.860 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.859+0000 7f97467fc640 1 -- 172.21.15.178:0/3452362949 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 977+0+0 (crc 0 0 0) 0x7f974c013af0 con 0x7f9750112340 2023-12-19T09:40:45.861 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.860+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97501a7810 con 0x7f9750112340 2023-12-19T09:40:45.862 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.862+0000 7f97467fc640 1 -- 172.21.15.178:0/3452362949 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f974c013d00 con 0x7f9750112340 2023-12-19T09:40:45.934 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.934+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e895fab-1cdf-4c49-80ca-f2b0afb4c81d", "id": 2} v 0) v1 -- 0x7f9750112c30 con 0x7f9750112340 2023-12-19T09:40:45.935 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.935+0000 7f97467fc640 1 -- 172.21.15.178:0/3452362949 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e895fab-1cdf-4c49-80ca-f2b0afb4c81d", "id": 2}]=0 v6) v1 ==== 112+0+2 (crc 0 0 0) 0x7f974c0136b0 con 0x7f9750112340 2023-12-19T09:40:45.935 INFO:teuthology.orchestra.run.smithi178.stdout:2 2023-12-19T09:40:45.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.936+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750112340 msgr2=0x7f97501a6db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:45.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.936+0000 7f9757d1e640 1 --2- 172.21.15.178:0/3452362949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750112340 0x7f97501a6db0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.936+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 shutdown_connections 2023-12-19T09:40:45.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.936+0000 7f9757d1e640 1 --2- 172.21.15.178:0/3452362949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9750112340 0x7f97501a6db0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:45.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.936+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 >> 172.21.15.178:0/3452362949 conn(0x7f975010dd70 msgr2=0x7f9750113e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:45.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.936+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 shutdown_connections 2023-12-19T09:40:45.937 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:45.936+0000 7f9757d1e640 1 -- 172.21.15.178:0/3452362949 wait complete. 2023-12-19T09:40:45.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new f686ffba-6c3b-455d-a204-4a79387f0382 3 2023-12-19T09:40:46.003 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.003+0000 7f40e6f6df00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T09:40:46.051 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.046+0000 7f0111f00640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.052+0000 7f0111f00640 1 Processor -- start 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.052+0000 7f0111f00640 1 -- start start 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.052+0000 7f0111f00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f010c116040 0x7f010c10fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.052+0000 7f0111f00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c116630 con 0x7f010c1102c0 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.052+0000 7f0111f00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c1106d0 con 0x7f010c116040 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f010c116040 0x7f010c10fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f010c1102c0 0x7f010c11a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.178:38292/0 (socket says 172.21.15.178:38292) 2023-12-19T09:40:46.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010affd640 1 -- 172.21.15.178:0/2831703955 learned_addr learned my addr 172.21.15.178:0/2831703955 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010b7fe640 1 -- 172.21.15.178:0/2831703955 >> v1:172.21.15.99:6789/0 conn(0x7f010c1102c0 legacy=0x7f010c11a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010b7fe640 1 -- 172.21.15.178:0/2831703955 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c110840 con 0x7f010c116040 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010b7fe640 1 --2- 172.21.15.178:0/2831703955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c116040 0x7f010c10fd80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffdb8b97cde8fa85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010a7fc640 1 -- 172.21.15.178:0/2831703955 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00fc00e040 con 0x7f010c116040 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010a7fc640 1 -- 172.21.15.178:0/2831703955 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f00fc007670 con 0x7f010c116040 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.053+0000 7f010a7fc640 1 -- 172.21.15.178:0/2831703955 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00fc007910 con 0x7f010c116040 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.054+0000 7f0111f00640 1 -- 172.21.15.178:0/2831703955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c116040 msgr2=0x7f010c10fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:46.059 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.054+0000 7f0111f00640 1 --2- 172.21.15.178:0/2831703955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c116040 0x7f010c10fd80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.054+0000 7f0111f00640 1 -- 172.21.15.178:0/2831703955 shutdown_connections 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.054+0000 7f0111f00640 1 --2- 172.21.15.178:0/2831703955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c116040 0x7f010c10fd80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.054+0000 7f0111f00640 1 -- 172.21.15.178:0/2831703955 >> 172.21.15.178:0/2831703955 conn(0x7f010c070c60 msgr2=0x7f010c071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.054+0000 7f0111f00640 1 -- 172.21.15.178:0/2831703955 shutdown_connections 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.054+0000 7f0111f00640 1 -- 172.21.15.178:0/2831703955 wait complete. 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.055+0000 7f0111f00640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.055+0000 7f0111f00640 1 Processor -- start 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.055+0000 7f0111f00640 1 -- start start 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f0111f00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c1102c0 0x7f010c1a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f0111f00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c1a5320 con 0x7f010c1102c0 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f010b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c1102c0 0x7f010c1a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:46.060 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f010b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c1102c0 0x7f010c1a4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.178:53432/0 (socket says 172.21.15.178:53432) 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f010b7fe640 1 -- 172.21.15.178:0/3651259852 learned_addr learned my addr 172.21.15.178:0/3651259852 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f010b7fe640 1 -- 172.21.15.178:0/3651259852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c1a5460 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f010b7fe640 1 --2- 172.21.15.178:0/3651259852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c1102c0 0x7f010c1a4de0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.056+0000 7f0103fff640 1 -- 172.21.15.178:0/3651259852 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00fc00e040 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.057+0000 7f0103fff640 1 -- 172.21.15.178:0/3651259852 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f00fc012b50 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.057+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c1a56b0 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.057+0000 7f0103fff640 1 -- 172.21.15.178:0/3651259852 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f00fc012df0 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.057+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c1a94e0 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.057+0000 7f0103fff640 1 -- 172.21.15.178:0/3651259852 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f00fc0156f0 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.057+0000 7f0103fff640 1 -- 172.21.15.178:0/3651259852 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1092+0+0 (crc 0 0 0) 0x7f00fc014650 con 0x7f010c1102c0 2023-12-19T09:40:46.061 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.057+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c062350 con 0x7f010c1102c0 2023-12-19T09:40:46.062 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.060+0000 7f0103fff640 1 -- 172.21.15.178:0/3651259852 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f00fc0159a0 con 0x7f010c1102c0 2023-12-19T09:40:46.129 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.129+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f686ffba-6c3b-455d-a204-4a79387f0382", "id": 3} v 0) v1 -- 0x7f010c110bb0 con 0x7f010c1102c0 2023-12-19T09:40:46.132 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.132+0000 7f40e6f6df00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T09:40:46.134 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.134+0000 7f0103fff640 1 -- 172.21.15.178:0/3651259852 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f686ffba-6c3b-455d-a204-4a79387f0382", "id": 3}]=0 v7) v1 ==== 112+0+2 (crc 0 0 0) 0x7f00fc015b40 con 0x7f010c1102c0 2023-12-19T09:40:46.134 INFO:teuthology.orchestra.run.smithi178.stdout:3 2023-12-19T09:40:46.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.135+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c1102c0 msgr2=0x7f010c1a4de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:46.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.135+0000 7f0111f00640 1 --2- 172.21.15.178:0/3651259852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c1102c0 0x7f010c1a4de0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.135+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 shutdown_connections 2023-12-19T09:40:46.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.135+0000 7f0111f00640 1 --2- 172.21.15.178:0/3651259852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f010c1102c0 0x7f010c1a4de0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.135+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 >> 172.21.15.178:0/3651259852 conn(0x7f010c070c60 msgr2=0x7f010c111cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:46.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.135+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 shutdown_connections 2023-12-19T09:40:46.135 INFO:teuthology.orchestra.run.smithi178.stderr:2023-12-19T09:40:46.135+0000 7f0111f00640 1 -- 172.21.15.178:0/3651259852 wait complete. 2023-12-19T09:40:46.145 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2023-12-19T09:40:46.182 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T09:40:46.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2023-12-19T09:40:46.225 INFO:tasks.ceph.osd.0:Started 2023-12-19T09:40:46.225 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2023-12-19T09:40:46.256 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.256+0000 7f40e6f6df00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T09:40:46.261 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T09:40:46.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2023-12-19T09:40:46.301 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.301+0000 7f40e6f6df00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T09:40:46.304 INFO:tasks.ceph.osd.1:Started 2023-12-19T09:40:46.304 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2023-12-19T09:40:46.336 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T09:40:46.336 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2023-12-19T09:40:46.378 INFO:tasks.ceph.osd.2:Started 2023-12-19T09:40:46.378 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2023-12-19T09:40:46.405 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.405+0000 7f40e6f6df00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T09:40:46.410 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T09:40:46.410 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2023-12-19T09:40:46.453 INFO:tasks.ceph.osd.3:Started 2023-12-19T09:40:46.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T09:40:46.511 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.511+0000 7f40e6f6df00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T09:40:46.575 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.570+0000 7fec9aead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.575+0000 7fec9aead640 1 Processor -- start 2023-12-19T09:40:46.576 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.575+0000 7fec9aead640 1 -- start start 2023-12-19T09:40:46.577 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.576+0000 7fec9aead640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec940a0fc0 0x7fec94133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.576+0000 7fec9aead640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9409deb0 con 0x7fec940a0bb0 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.576+0000 7fec9aead640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9409d2b0 con 0x7fec940a0fc0 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.576+0000 7fec93fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec940a0fc0 0x7fec94133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.576+0000 7fec98c49640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fec940a0bb0 0x7fec94132f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55390/0 (socket says 172.21.15.99:55390) 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.576+0000 7fec98c49640 1 -- 172.21.15.99:0/4283319204 learned_addr learned my addr 172.21.15.99:0/4283319204 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.577+0000 7fec93fff640 1 -- 172.21.15.99:0/4283319204 >> v1:172.21.15.99:6789/0 conn(0x7fec940a0bb0 legacy=0x7fec94132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.577+0000 7fec93fff640 1 -- 172.21.15.99:0/4283319204 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec941302d0 con 0x7fec940a0fc0 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.577+0000 7fec93fff640 1 --2- 172.21.15.99:0/4283319204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0fc0 0x7fec94133620 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab47607909051b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.577+0000 7fec937fe640 1 -- 172.21.15.99:0/4283319204 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fec80009ce0 con 0x7fec940a0fc0 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.577+0000 7fec937fe640 1 -- 172.21.15.99:0/4283319204 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fec80009e40 con 0x7fec940a0fc0 2023-12-19T09:40:46.578 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.577+0000 7fec937fe640 1 -- 172.21.15.99:0/4283319204 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fec8000e360 con 0x7fec940a0fc0 2023-12-19T09:40:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 1 -- 172.21.15.99:0/4283319204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0fc0 msgr2=0x7fec94133620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 1 --2- 172.21.15.99:0/4283319204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0fc0 0x7fec94133620 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 1 -- 172.21.15.99:0/4283319204 shutdown_connections 2023-12-19T09:40:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 1 --2- 172.21.15.99:0/4283319204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0fc0 0x7fec94133620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.579 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 1 -- 172.21.15.99:0/4283319204 >> 172.21.15.99:0/4283319204 conn(0x7fec9406c9a0 msgr2=0x7fec9406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 1 -- 172.21.15.99:0/4283319204 shutdown_connections 2023-12-19T09:40:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 1 -- 172.21.15.99:0/4283319204 wait complete. 2023-12-19T09:40:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.578+0000 7fec9aead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.579+0000 7fec9aead640 1 Processor -- start 2023-12-19T09:40:46.580 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.579+0000 7fec9aead640 1 -- start start 2023-12-19T09:40:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.580+0000 7fec9aead640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0bb0 0x7fec9411b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.580+0000 7fec9aead640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9411e830 con 0x7fec940a0bb0 2023-12-19T09:40:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.580+0000 7fec98c49640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0bb0 0x7fec9411b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.580+0000 7fec98c49640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0bb0 0x7fec9411b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59864/0 (socket says 172.21.15.99:59864) 2023-12-19T09:40:46.581 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.580+0000 7fec98c49640 1 -- 172.21.15.99:0/2534400005 learned_addr learned my addr 172.21.15.99:0/2534400005 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec98c49640 1 -- 172.21.15.99:0/2534400005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9411db90 con 0x7fec940a0bb0 2023-12-19T09:40:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec98c49640 1 --2- 172.21.15.99:0/2534400005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0bb0 0x7fec9411b7f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec917fa640 1 -- 172.21.15.99:0/2534400005 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fec880059d0 con 0x7fec940a0bb0 2023-12-19T09:40:46.582 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec917fa640 1 -- 172.21.15.99:0/2534400005 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fec88005b30 con 0x7fec940a0bb0 2023-12-19T09:40:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec917fa640 1 -- 172.21.15.99:0/2534400005 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fec88005dd0 con 0x7fec940a0bb0 2023-12-19T09:40:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9412f670 con 0x7fec940a0bb0 2023-12-19T09:40:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9411f660 con 0x7fec940a0bb0 2023-12-19T09:40:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec917fa640 1 -- 172.21.15.99:0/2534400005 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7fec880073b0 con 0x7fec940a0bb0 2023-12-19T09:40:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.581+0000 7fec917fa640 1 -- 172.21.15.99:0/2534400005 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7fec8800f750 con 0x7fec940a0bb0 2023-12-19T09:40:46.583 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.582+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec94062350 con 0x7fec940a0bb0 2023-12-19T09:40:46.587 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.586+0000 7fec917fa640 1 -- 172.21.15.99:0/2534400005 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7fec8800f230 con 0x7fec940a0bb0 2023-12-19T09:40:46.649 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.648+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec9411d190 con 0x7fec940a0bb0 2023-12-19T09:40:46.649 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.649+0000 7fec917fa640 1 -- 172.21.15.99:0/2534400005 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7fec8800f480 con 0x7fec940a0bb0 2023-12-19T09:40:46.650 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:46.650 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":7,"fsid":"8e93e3b6-2270-4fce-ac6b-2175b078bbce","created":"2023-12-19T09:40:44.025359+0000","modified":"2023-12-19T09:40:46.130913+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T09:40:46.130913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"774e1dc8-872f-44c8-9e3e-aabe7df13883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"842562c8-a91c-40f8-9fd3-349029d8a22f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e895fab-1cdf-4c49-80ca-f2b0afb4c81d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f686ffba-6c3b-455d-a204-4a79387f0382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T09:40:46.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.650+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0bb0 msgr2=0x7fec9411b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:46.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.650+0000 7fec9aead640 1 --2- 172.21.15.99:0/2534400005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0bb0 0x7fec9411b7f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.650+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 shutdown_connections 2023-12-19T09:40:46.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.650+0000 7fec9aead640 1 --2- 172.21.15.99:0/2534400005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec940a0bb0 0x7fec9411b7f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:46.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.650+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 >> 172.21.15.99:0/2534400005 conn(0x7fec9406c9a0 msgr2=0x7fec940a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:46.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.650+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 shutdown_connections 2023-12-19T09:40:46.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:46.650+0000 7fec9aead640 1 -- 172.21.15.99:0/2534400005 wait complete. 2023-12-19T09:40:46.663 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T09:40:46.663 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T09:40:46.678 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.678+0000 7f40e6f6df00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T09:40:46.729 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.729+0000 7f40e6f6df00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T09:40:46.890 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:46.890+0000 7f40e6f6df00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T09:40:47.066 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T09:40:47.166 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.162+0000 7f23df19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:47.167 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.166+0000 7f23df19e640 1 Processor -- start 2023-12-19T09:40:47.167 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.166+0000 7f23df19e640 1 -- start start 2023-12-19T09:40:47.168 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23df19e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23d80a0a40 0x7f23d8138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:47.168 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23df19e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d809d400 con 0x7f23d809ff20 2023-12-19T09:40:47.168 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23df19e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80a0e50 con 0x7f23d80a0a40 2023-12-19T09:40:47.168 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23d7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f23d80a0a40 0x7f23d8138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:47.168 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23dcf3a640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f23d809ff20 0x7f23d80a0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55398/0 (socket says 172.21.15.99:55398) 2023-12-19T09:40:47.169 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23dcf3a640 1 -- 172.21.15.99:0/4238969902 learned_addr learned my addr 172.21.15.99:0/4238969902 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:47.169 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23d7fff640 1 -- 172.21.15.99:0/4238969902 >> v1:172.21.15.99:6789/0 conn(0x7f23d809ff20 legacy=0x7f23d80a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:47.169 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23d7fff640 1 -- 172.21.15.99:0/4238969902 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d809f6f0 con 0x7f23d80a0a40 2023-12-19T09:40:47.169 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.167+0000 7f23d7fff640 1 --2- 172.21.15.99:0/4238969902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d80a0a40 0x7f23d8138a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39e833628f9e8c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:47.169 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.168+0000 7f23d77fe640 1 -- 172.21.15.99:0/4238969902 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f23c4009ce0 con 0x7f23d80a0a40 2023-12-19T09:40:47.169 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.168+0000 7f23d77fe640 1 -- 172.21.15.99:0/4238969902 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f23c4009e40 con 0x7f23d80a0a40 2023-12-19T09:40:47.169 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.168+0000 7f23d77fe640 1 -- 172.21.15.99:0/4238969902 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f23c400e360 con 0x7f23d80a0a40 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 1 -- 172.21.15.99:0/4238969902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d80a0a40 msgr2=0x7f23d8138a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 1 --2- 172.21.15.99:0/4238969902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d80a0a40 0x7f23d8138a10 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 1 -- 172.21.15.99:0/4238969902 shutdown_connections 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 1 --2- 172.21.15.99:0/4238969902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d80a0a40 0x7f23d8138a10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 1 -- 172.21.15.99:0/4238969902 >> 172.21.15.99:0/4238969902 conn(0x7f23d80a2280 msgr2=0x7f23d80a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 1 -- 172.21.15.99:0/4238969902 shutdown_connections 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 1 -- 172.21.15.99:0/4238969902 wait complete. 2023-12-19T09:40:47.170 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.169+0000 7f23df19e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:47.171 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.171+0000 7f23df19e640 1 Processor -- start 2023-12-19T09:40:47.171 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.171+0000 7f23df19e640 1 -- start start 2023-12-19T09:40:47.173 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23df19e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d809ff20 0x7f23d81a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:47.173 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23df19e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81abfb0 con 0x7f23d809ff20 2023-12-19T09:40:47.173 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23dcf3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d809ff20 0x7f23d81a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23dcf3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d809ff20 0x7f23d81a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59878/0 (socket says 172.21.15.99:59878) 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23dcf3a640 1 -- 172.21.15.99:0/66152687 learned_addr learned my addr 172.21.15.99:0/66152687 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23dcf3a640 1 -- 172.21.15.99:0/66152687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d81a92d0 con 0x7f23d809ff20 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23dcf3a640 1 --2- 172.21.15.99:0/66152687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d809ff20 0x7f23d81a8140 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.172+0000 7f23d57fa640 1 -- 172.21.15.99:0/66152687 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f23cc0059d0 con 0x7f23d809ff20 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.173+0000 7f23d57fa640 1 -- 172.21.15.99:0/66152687 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f23cc005b30 con 0x7f23d809ff20 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.173+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d81a9cd0 con 0x7f23d809ff20 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.173+0000 7f23d57fa640 1 -- 172.21.15.99:0/66152687 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f23cc005dd0 con 0x7f23d809ff20 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.173+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d81ab750 con 0x7f23d809ff20 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.173+0000 7f23d57fa640 1 -- 172.21.15.99:0/66152687 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (crc 0 0 0) 0x7f23cc0073b0 con 0x7f23d809ff20 2023-12-19T09:40:47.174 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.173+0000 7f23d57fa640 1 -- 172.21.15.99:0/66152687 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1207+0+0 (crc 0 0 0) 0x7f23cc00f750 con 0x7f23d809ff20 2023-12-19T09:40:47.175 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.174+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8062350 con 0x7f23d809ff20 2023-12-19T09:40:47.176 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.176+0000 7f23d57fa640 1 -- 172.21.15.99:0/66152687 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (crc 0 0 0) 0x7f23d809d400 con 0x7f23d809ff20 2023-12-19T09:40:47.238 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.237+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23d809cac0 con 0x7f23d809ff20 2023-12-19T09:40:47.238 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.237+0000 7f23d57fa640 1 -- 172.21.15.99:0/66152687 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+4151 (crc 0 0 0) 0x7f23cc00f2e0 con 0x7f23d809ff20 2023-12-19T09:40:47.238 INFO:teuthology.misc.health.smithi099.stdout: 2023-12-19T09:40:47.238 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":7,"fsid":"8e93e3b6-2270-4fce-ac6b-2175b078bbce","created":"2023-12-19T09:40:44.025359+0000","modified":"2023-12-19T09:40:46.130913+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T09:40:46.130913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"774e1dc8-872f-44c8-9e3e-aabe7df13883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"842562c8-a91c-40f8-9fd3-349029d8a22f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e895fab-1cdf-4c49-80ca-f2b0afb4c81d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f686ffba-6c3b-455d-a204-4a79387f0382","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T09:40:47.239 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.238+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d809ff20 msgr2=0x7f23d81a8140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:47.239 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.238+0000 7f23df19e640 1 --2- 172.21.15.99:0/66152687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d809ff20 0x7f23d81a8140 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:47.239 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.238+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 shutdown_connections 2023-12-19T09:40:47.240 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.238+0000 7f23df19e640 1 --2- 172.21.15.99:0/66152687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23d809ff20 0x7f23d81a8140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:47.240 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.238+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 >> 172.21.15.99:0/66152687 conn(0x7f23d80a2280 msgr2=0x7f23d809a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:47.240 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.238+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 shutdown_connections 2023-12-19T09:40:47.240 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:47.238+0000 7f23df19e640 1 -- 172.21.15.99:0/66152687 wait complete. 2023-12-19T09:40:47.248 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-12-19T09:40:47.774 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:47.773+0000 7f40e6f6df00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T09:40:48.056 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:48.056+0000 7f40e6f6df00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T09:40:48.110 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:48.110+0000 7f40e6f6df00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T09:40:48.224 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:48.224+0000 7f40e6f6df00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T09:40:49.247 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-12-19T09:40:49.247+0000 7f4086c51640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-12-19T09:40:53.653 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T09:40:53.754 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.750+0000 7ffa3a39e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:53.755 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.754+0000 7ffa3a39e640 1 Processor -- start 2023-12-19T09:40:53.755 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.754+0000 7ffa3a39e640 1 -- start start 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.755+0000 7ffa3a39e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa340a0a40 0x7ffa34138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.755+0000 7ffa3a39e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3409d400 con 0x7ffa3409ff20 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.755+0000 7ffa3a39e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa340a0e50 con 0x7ffa340a0a40 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.755+0000 7ffa337fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa340a0a40 0x7ffa34138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.755+0000 7ffa337fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa340a0a40 0x7ffa34138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59880/0 (socket says 172.21.15.99:59880) 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.755+0000 7ffa33fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffa3409ff20 0x7ffa340a0330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55410/0 (socket says 172.21.15.99:55410) 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.755+0000 7ffa337fe640 1 -- 172.21.15.99:0/1657922522 learned_addr learned my addr 172.21.15.99:0/1657922522 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.756+0000 7ffa337fe640 1 -- 172.21.15.99:0/1657922522 >> v1:172.21.15.99:6789/0 conn(0x7ffa3409ff20 legacy=0x7ffa340a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.756+0000 7ffa337fe640 1 -- 172.21.15.99:0/1657922522 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3409f6f0 con 0x7ffa340a0a40 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.756+0000 7ffa337fe640 1 --2- 172.21.15.99:0/1657922522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa340a0a40 0x7ffa34138a10 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29deda5d2451655 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.756+0000 7ffa32ffd640 1 -- 172.21.15.99:0/1657922522 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffa28009dd0 con 0x7ffa340a0a40 2023-12-19T09:40:53.757 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.756+0000 7ffa32ffd640 1 -- 172.21.15.99:0/1657922522 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffa2800e230 con 0x7ffa340a0a40 2023-12-19T09:40:53.758 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.756+0000 7ffa32ffd640 1 -- 172.21.15.99:0/1657922522 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffa2800e4d0 con 0x7ffa340a0a40 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 1 -- 172.21.15.99:0/1657922522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa340a0a40 msgr2=0x7ffa34138a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 1 --2- 172.21.15.99:0/1657922522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa340a0a40 0x7ffa34138a10 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 1 -- 172.21.15.99:0/1657922522 shutdown_connections 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 1 --2- 172.21.15.99:0/1657922522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa340a0a40 0x7ffa34138a10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 1 -- 172.21.15.99:0/1657922522 >> 172.21.15.99:0/1657922522 conn(0x7ffa340a2280 msgr2=0x7ffa340a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 1 -- 172.21.15.99:0/1657922522 shutdown_connections 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 1 -- 172.21.15.99:0/1657922522 wait complete. 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.757+0000 7ffa3a39e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:53.759 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.758+0000 7ffa3a39e640 1 Processor -- start 2023-12-19T09:40:53.761 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.759+0000 7ffa3a39e640 1 -- start start 2023-12-19T09:40:53.761 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.759+0000 7ffa3a39e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3409ff20 0x7ffa341a8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:53.761 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.759+0000 7ffa3a39e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341abfb0 con 0x7ffa3409ff20 2023-12-19T09:40:53.761 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.759+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3409ff20 0x7ffa341a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:53.761 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.759+0000 7ffa33fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3409ff20 0x7ffa341a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59888/0 (socket says 172.21.15.99:59888) 2023-12-19T09:40:53.761 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.759+0000 7ffa33fff640 1 -- 172.21.15.99:0/3553240931 learned_addr learned my addr 172.21.15.99:0/3553240931 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:53.761 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.760+0000 7ffa33fff640 1 -- 172.21.15.99:0/3553240931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa341a92d0 con 0x7ffa3409ff20 2023-12-19T09:40:53.762 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.760+0000 7ffa33fff640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3409ff20 0x7ffa341a8140 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:53.762 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.760+0000 7ffa30ff9640 1 -- 172.21.15.99:0/3553240931 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffa240071e0 con 0x7ffa3409ff20 2023-12-19T09:40:53.762 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.760+0000 7ffa30ff9640 1 -- 172.21.15.99:0/3553240931 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffa24007340 con 0x7ffa3409ff20 2023-12-19T09:40:53.762 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.760+0000 7ffa30ff9640 1 -- 172.21.15.99:0/3553240931 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffa240075e0 con 0x7ffa3409ff20 2023-12-19T09:40:53.762 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.760+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa341a9cd0 con 0x7ffa3409ff20 2023-12-19T09:40:53.762 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.760+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa341ab750 con 0x7ffa3409ff20 2023-12-19T09:40:53.763 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.761+0000 7ffa30ff9640 1 -- 172.21.15.99:0/3553240931 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 44801+0+0 (crc 0 0 0) 0x7ffa240057e0 con 0x7ffa3409ff20 2023-12-19T09:40:53.763 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.761+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34062350 con 0x7ffa3409ff20 2023-12-19T09:40:53.763 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.761+0000 7ffa30ff9640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffa20037780 0x7ffa20039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:53.763 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.761+0000 7ffa30ff9640 1 -- 172.21.15.99:0/3553240931 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7ffa240467f0 con 0x7ffa3409ff20 2023-12-19T09:40:53.763 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.762+0000 7ffa337fe640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffa20037780 0x7ffa20039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:53.763 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.762+0000 7ffa337fe640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffa20037780 0x7ffa20039c90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:53.767 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.766+0000 7ffa30ff9640 1 -- 172.21.15.99:0/3553240931 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7ffa2400d330 con 0x7ffa3409ff20 2023-12-19T09:40:53.946 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.946+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa3409d400 con 0x7ffa3409ff20 2023-12-19T09:40:53.956 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.955+0000 7ffa30ff9640 1 -- 172.21.15.99:0/3553240931 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6905 (crc 0 0 0) 0x7ffa3409d400 con 0x7ffa3409ff20 2023-12-19T09:40:53.956 INFO:teuthology.misc.health.smithi099.stdout: 2023-12-19T09:40:53.956 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":11,"fsid":"8e93e3b6-2270-4fce-ac6b-2175b078bbce","created":"2023-12-19T09:40:44.025359+0000","modified":"2023-12-19T09:40:53.297322+0000","last_up_change":"2023-12-19T09:40:50.288497+0000","last_in_change":"2023-12-19T09:40:46.130913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T09:40:52.286068+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"774e1dc8-872f-44c8-9e3e-aabe7df13883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1010486646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":1010486646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":1010486646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1010486646}]},"public_addr":"172.21.15.99:6800/1010486646","cluster_addr":"172.21.15.99:6801/1010486646","heartbeat_back_addr":"172.21.15.99:6805/1010486646","heartbeat_front_addr":"172.21.15.99:6804/1010486646","state":["exists","up"]},{"osd":1,"uuid":"842562c8-a91c-40f8-9fd3-349029d8a22f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6803","nonce":2107593797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2107593797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":2107593797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2107593797}]},"public_addr":"172.21.15.99:6803/2107593797","cluster_addr":"172.21.15.99:6802/2107593797","heartbeat_back_addr":"172.21.15.99:6807/2107593797","heartbeat_front_addr":"172.21.15.99:6806/2107593797","state":["exists","up"]},{"osd":2,"uuid":"7e895fab-1cdf-4c49-80ca-f2b0afb4c81d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1424444103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1424444103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1424444103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":1424444103}]},"public_addr":"172.21.15.178:6803/1424444103","cluster_addr":"172.21.15.178:6802/1424444103","heartbeat_back_addr":"172.21.15.178:6806/1424444103","heartbeat_front_addr":"172.21.15.178:6807/1424444103","state":["exists","up"]},{"osd":3,"uuid":"f686ffba-6c3b-455d-a204-4a79387f0382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":248859203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":248859203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":248859203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":248859203}]},"public_addr":"172.21.15.178:6804/248859203","cluster_addr":"172.21.15.178:6805/248859203","heartbeat_back_addr":"172.21.15.178:6809/248859203","heartbeat_front_addr":"172.21.15.178:6808/248859203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T09:40:53.958 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffa20037780 msgr2=0x7ffa20039c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:53.958 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffa20037780 0x7ffa20039c90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:53.958 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3409ff20 msgr2=0x7ffa341a8140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:53.958 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3409ff20 0x7ffa341a8140 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:53.959 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 shutdown_connections 2023-12-19T09:40:53.959 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffa20037780 0x7ffa20039c90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:53.959 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 --2- 172.21.15.99:0/3553240931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa3409ff20 0x7ffa341a8140 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:53.959 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 >> 172.21.15.99:0/3553240931 conn(0x7ffa340a2280 msgr2=0x7ffa3409a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:53.959 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.957+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 shutdown_connections 2023-12-19T09:40:53.959 INFO:teuthology.misc.health.smithi099.stderr:2023-12-19T09:40:53.958+0000 7ffa3a39e640 1 -- 172.21.15.99:0/3553240931 wait complete. 2023-12-19T09:40:53.968 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-12-19T09:40:53.968 INFO:tasks.ceph:Creating RBD pool 2023-12-19T09:40:53.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-19T09:40:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.069+0000 7f4764c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f4764c6d640 1 Processor -- start 2023-12-19T09:40:54.077 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f4764c6d640 1 -- start start 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f4764c6d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4760136250 0x7f4760138670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f4764c6d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4760132fe0 con 0x7f4760133480 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f4764c6d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476009a9f0 con 0x7f4760136250 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f4755d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4760136250 0x7f4760138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f475e59c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4760133480 0x7f4760133890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55422/0 (socket says 172.21.15.99:55422) 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.077+0000 7f475e59c640 1 -- 172.21.15.99:0/557704852 learned_addr learned my addr 172.21.15.99:0/557704852 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.078+0000 7f4755d9b640 1 -- 172.21.15.99:0/557704852 >> v1:172.21.15.99:6789/0 conn(0x7f4760133480 legacy=0x7f4760133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.078+0000 7f4755d9b640 1 -- 172.21.15.99:0/557704852 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4760099dc0 con 0x7f4760136250 2023-12-19T09:40:54.079 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.078+0000 7f4755d9b640 1 --2- 172.21.15.99:0/557704852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760136250 0x7f4760138670 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd8fb47bd4fe3ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:54.080 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.078+0000 7f475dd9b640 1 -- 172.21.15.99:0/557704852 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4750009ce0 con 0x7f4760136250 2023-12-19T09:40:54.080 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.078+0000 7f475dd9b640 1 -- 172.21.15.99:0/557704852 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4750009e40 con 0x7f4760136250 2023-12-19T09:40:54.080 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.078+0000 7f475dd9b640 1 -- 172.21.15.99:0/557704852 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f475000e360 con 0x7f4760136250 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 1 -- 172.21.15.99:0/557704852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760136250 msgr2=0x7f4760138670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 1 --2- 172.21.15.99:0/557704852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760136250 0x7f4760138670 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 1 -- 172.21.15.99:0/557704852 shutdown_connections 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 1 --2- 172.21.15.99:0/557704852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760136250 0x7f4760138670 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 1 -- 172.21.15.99:0/557704852 >> 172.21.15.99:0/557704852 conn(0x7f476009eb00 msgr2=0x7f476009ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 1 -- 172.21.15.99:0/557704852 shutdown_connections 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 1 -- 172.21.15.99:0/557704852 wait complete. 2023-12-19T09:40:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.079+0000 7f4764c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.080+0000 7f4764c6d640 1 Processor -- start 2023-12-19T09:40:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.080+0000 7f4764c6d640 1 -- start start 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.081+0000 7f4764c6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760133480 0x7f476011ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.081+0000 7f4764c6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476011ec50 con 0x7f4760133480 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.081+0000 7f475e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760133480 0x7f476011ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.081+0000 7f475e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760133480 0x7f476011ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59902/0 (socket says 172.21.15.99:59902) 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.081+0000 7f475e59c640 1 -- 172.21.15.99:0/4024347164 learned_addr learned my addr 172.21.15.99:0/4024347164 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.081+0000 7f475e59c640 1 -- 172.21.15.99:0/4024347164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600720d0 con 0x7f4760133480 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.081+0000 7f475e59c640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760133480 0x7f476011ca60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.082+0000 7f47577fe640 1 -- 172.21.15.99:0/4024347164 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f47480059d0 con 0x7f4760133480 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.082+0000 7f47577fe640 1 -- 172.21.15.99:0/4024347164 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4748005b30 con 0x7f4760133480 2023-12-19T09:40:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.082+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476011e940 con 0x7f4760133480 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.082+0000 7f47577fe640 1 -- 172.21.15.99:0/4024347164 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4748005dd0 con 0x7f4760133480 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.082+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476011e120 con 0x7f4760133480 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.082+0000 7f47577fe640 1 -- 172.21.15.99:0/4024347164 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 44801+0+0 (crc 0 0 0) 0x7f47480070b0 con 0x7f4760133480 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.083+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4760062350 con 0x7f4760133480 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.083+0000 7f47577fe640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4744037780 0x7f4744039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.083+0000 7f47577fe640 1 -- 172.21.15.99:0/4024347164 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2319+0+0 (crc 0 0 0) 0x7f47480469b0 con 0x7f4760133480 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.083+0000 7f4755d9b640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4744037780 0x7f4744039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.083+0000 7f4755d9b640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4744037780 0x7f4744039c90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.088+0000 7f47577fe640 1 -- 172.21.15.99:0/4024347164 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f474800d330 con 0x7f4760133480 2023-12-19T09:40:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.264+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f4760067020 con 0x7f4760133480 2023-12-19T09:40:54.307 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.307+0000 7f47577fe640 1 -- 172.21.15.99:0/4024347164 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) v1 ==== 109+0+0 (crc 0 0 0) 0x7f474800d150 con 0x7f4760133480 2023-12-19T09:40:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'rbd' created 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4744037780 msgr2=0x7f4744039c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4744037780 0x7f4744039c90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760133480 msgr2=0x7f476011ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760133480 0x7f476011ca60 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 shutdown_connections 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4744037780 0x7f4744039c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 --2- 172.21.15.99:0/4024347164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4760133480 0x7f476011ca60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 >> 172.21.15.99:0/4024347164 conn(0x7f476009eb00 msgr2=0x7f4760136660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 shutdown_connections 2023-12-19T09:40:54.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.309+0000 7f4764c6d640 1 -- 172.21.15.99:0/4024347164 wait complete. 2023-12-19T09:40:54.321 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-19T09:40:54.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.425+0000 7f811f8ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:54.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.434+0000 7f811f8ad640 1 Processor -- start 2023-12-19T09:40:54.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.434+0000 7f811f8ad640 1 -- start start 2023-12-19T09:40:54.436 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.435+0000 7f811f8ad640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f811809a2b0 0x7f811809a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:54.436 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.435+0000 7f811f8ad640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8118098b90 con 0x7f8118130150 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.435+0000 7f811f8ad640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8118098880 con 0x7f811809a2b0 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.435+0000 7f811d649640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f811809a2b0 0x7f811809a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.435+0000 7f811ce48640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8118130150 0x7f8118130560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55428/0 (socket says 172.21.15.99:55428) 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.435+0000 7f811d649640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f811809a2b0 0x7f811809a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59908/0 (socket says 172.21.15.99:59908) 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.435+0000 7f811ce48640 1 -- 172.21.15.99:0/2649353921 learned_addr learned my addr 172.21.15.99:0/2649353921 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f811d649640 1 -- 172.21.15.99:0/2649353921 >> v1:172.21.15.99:6789/0 conn(0x7f8118130150 legacy=0x7f8118130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f811d649640 1 -- 172.21.15.99:0/2649353921 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811806e5e0 con 0x7f811809a2b0 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f810ffff640 1 -- 172.21.15.99:0/2649353921 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985143314 0 0) 0x7f8118098b90 con 0x7f8118130150 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f811d649640 1 --2- 172.21.15.99:0/2649353921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811809a6c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88eb1326dec2d643 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f810ffff640 1 -- 172.21.15.99:0/2649353921 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8114010440 con 0x7f811809a2b0 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f810ffff640 1 -- 172.21.15.99:0/2649353921 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f81140105a0 con 0x7f811809a2b0 2023-12-19T09:40:54.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f810ffff640 1 -- 172.21.15.99:0/2649353921 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8114010840 con 0x7f811809a2b0 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f811f8ad640 1 -- 172.21.15.99:0/2649353921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 msgr2=0x7f811809a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.436+0000 7f811f8ad640 1 --2- 172.21.15.99:0/2649353921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811809a6c0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.437+0000 7f811f8ad640 1 -- 172.21.15.99:0/2649353921 shutdown_connections 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.437+0000 7f811f8ad640 1 --2- 172.21.15.99:0/2649353921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811809a6c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.437+0000 7f811f8ad640 1 -- 172.21.15.99:0/2649353921 >> 172.21.15.99:0/2649353921 conn(0x7f811809daf0 msgr2=0x7f811809df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.437+0000 7f811f8ad640 1 -- 172.21.15.99:0/2649353921 shutdown_connections 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.437+0000 7f811f8ad640 1 -- 172.21.15.99:0/2649353921 wait complete. 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.437+0000 7f811f8ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.438+0000 7f811f8ad640 1 Processor -- start 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.438+0000 7f811f8ad640 1 -- start start 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.438+0000 7f811f8ad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811812d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.438+0000 7f811f8ad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811812f8c0 con 0x7f811809a2b0 2023-12-19T09:40:54.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.438+0000 7f811d649640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811812d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.438+0000 7f811d649640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811812d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59914/0 (socket says 172.21.15.99:59914) 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f811d649640 1 -- 172.21.15.99:0/3810110735 learned_addr learned my addr 172.21.15.99:0/3810110735 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f811d649640 1 -- 172.21.15.99:0/3810110735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811808a160 con 0x7f811809a2b0 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f811d649640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811812d030 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f811400f9e0 con 0x7f811809a2b0 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f811400fb40 con 0x7f811809a2b0 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8118097f60 con 0x7f811809a2b0 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f811400fde0 con 0x7f811809a2b0 2023-12-19T09:40:54.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.439+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811812ebb0 con 0x7f811809a2b0 2023-12-19T09:40:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.440+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 44801+0+0 (crc 0 0 0) 0x7f811400e360 con 0x7f811809a2b0 2023-12-19T09:40:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.440+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8118075080 con 0x7f811809a2b0 2023-12-19T09:40:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.440+0000 7f810dffb640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f80fc037780 0x7f80fc039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.440+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2661+0+0 (crc 0 0 0) 0x7f811404a830 con 0x7f811809a2b0 2023-12-19T09:40:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.440+0000 7f811ce48640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f80fc037780 0x7f80fc039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:54.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.441+0000 7f811ce48640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f80fc037780 0x7f80fc039c90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:54.446 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.445+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f8114009a00 con 0x7f811809a2b0 2023-12-19T09:40:54.613 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:54.612+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8118067bd0 con 0x7f811809a2b0 2023-12-19T09:40:55.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.092+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f811400d350 con 0x7f811809a2b0 2023-12-19T09:40:55.318 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.317+0000 7f810dffb640 1 -- 172.21.15.99:0/3810110735 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) v1 ==== 173+0+0 (crc 0 0 0) 0x7f8114019c50 con 0x7f811809a2b0 2023-12-19T09:40:55.318 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-19T09:40:55.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.319+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f80fc037780 msgr2=0x7f80fc039c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.319+0000 7f811f8ad640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f80fc037780 0x7f80fc039c90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.319+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 msgr2=0x7f811812d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.319+0000 7f811f8ad640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811812d030 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.320+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 shutdown_connections 2023-12-19T09:40:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.320+0000 7f811f8ad640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f80fc037780 0x7f80fc039c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.320+0000 7f811f8ad640 1 --2- 172.21.15.99:0/3810110735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f811809a2b0 0x7f811812d030 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.320+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 >> 172.21.15.99:0/3810110735 conn(0x7f811809daf0 msgr2=0x7f81181260b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.320+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 shutdown_connections 2023-12-19T09:40:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.320+0000 7f811f8ad640 1 -- 172.21.15.99:0/3810110735 wait complete. 2023-12-19T09:40:55.334 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T09:40:55.335 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T09:40:55.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T09:40:55.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T09:40:55.335 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T09:40:55.447 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.443+0000 7f157271e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.447+0000 7f157271e640 1 Processor -- start 2023-12-19T09:40:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.447+0000 7f157271e640 1 -- start start 2023-12-19T09:40:55.449 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f157271e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f156c0a0fc0 0x7f156c133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:55.449 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f157271e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c09deb0 con 0x7f156c0a0bb0 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f157271e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c09d2b0 con 0x7f156c0a0fc0 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f156b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f156c0a0fc0 0x7f156c133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f156b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f156c0a0fc0 0x7f156c133620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59916/0 (socket says 172.21.15.99:59916) 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f156b7fe640 1 -- 172.21.15.99:0/2124499130 learned_addr learned my addr 172.21.15.99:0/2124499130 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f156bfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f156c0a0bb0 0x7f156c132f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:55440/0 (socket says 172.21.15.99:55440) 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f156b7fe640 1 -- 172.21.15.99:0/2124499130 >> v1:172.21.15.99:6789/0 conn(0x7f156c0a0bb0 legacy=0x7f156c132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.448+0000 7f156b7fe640 1 -- 172.21.15.99:0/2124499130 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c1302d0 con 0x7f156c0a0fc0 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f156b7fe640 1 --2- 172.21.15.99:0/2124499130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0fc0 0x7f156c133620 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe30f08f05428d35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f156affd640 1 -- 172.21.15.99:0/2124499130 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f155c009dd0 con 0x7f156c0a0fc0 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f156affd640 1 -- 172.21.15.99:0/2124499130 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f155c00e230 con 0x7f156c0a0fc0 2023-12-19T09:40:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f156affd640 1 -- 172.21.15.99:0/2124499130 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f155c00e4d0 con 0x7f156c0a0fc0 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f157271e640 1 -- 172.21.15.99:0/2124499130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0fc0 msgr2=0x7f156c133620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f157271e640 1 --2- 172.21.15.99:0/2124499130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0fc0 0x7f156c133620 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f157271e640 1 -- 172.21.15.99:0/2124499130 shutdown_connections 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f157271e640 1 --2- 172.21.15.99:0/2124499130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0fc0 0x7f156c133620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f157271e640 1 -- 172.21.15.99:0/2124499130 >> 172.21.15.99:0/2124499130 conn(0x7f156c06c9a0 msgr2=0x7f156c06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f157271e640 1 -- 172.21.15.99:0/2124499130 shutdown_connections 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.449+0000 7f157271e640 1 -- 172.21.15.99:0/2124499130 wait complete. 2023-12-19T09:40:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.450+0000 7f157271e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.450+0000 7f157271e640 1 Processor -- start 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.451+0000 7f157271e640 1 -- start start 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.451+0000 7f157271e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0bb0 0x7f156c11b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.451+0000 7f157271e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c11e830 con 0x7f156c0a0bb0 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.451+0000 7f156bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0bb0 0x7f156c11b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.451+0000 7f156bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0bb0 0x7f156c11b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36908/0 (socket says 172.21.15.99:36908) 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.451+0000 7f156bfff640 1 -- 172.21.15.99:0/772883263 learned_addr learned my addr 172.21.15.99:0/772883263 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.452+0000 7f156bfff640 1 -- 172.21.15.99:0/772883263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c11db90 con 0x7f156c0a0bb0 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.452+0000 7f156bfff640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0bb0 0x7f156c11b7f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.452+0000 7f1568ff9640 1 -- 172.21.15.99:0/772883263 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f15600071e0 con 0x7f156c0a0bb0 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.452+0000 7f1568ff9640 1 -- 172.21.15.99:0/772883263 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f1560007340 con 0x7f156c0a0bb0 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.452+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c12f670 con 0x7f156c0a0bb0 2023-12-19T09:40:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.452+0000 7f1568ff9640 1 -- 172.21.15.99:0/772883263 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f15600075e0 con 0x7f156c0a0bb0 2023-12-19T09:40:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.452+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c11f660 con 0x7f156c0a0bb0 2023-12-19T09:40:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.453+0000 7f1568ff9640 1 -- 172.21.15.99:0/772883263 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f15600057e0 con 0x7f156c0a0bb0 2023-12-19T09:40:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.453+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c062350 con 0x7f156c0a0bb0 2023-12-19T09:40:55.456 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.453+0000 7f1568ff9640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f1558037810 0x7f1558039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:55.456 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.453+0000 7f1568ff9640 1 -- 172.21.15.99:0/772883263 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f1560046bd0 con 0x7f156c0a0bb0 2023-12-19T09:40:55.456 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.453+0000 7f156b7fe640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f1558037810 0x7f1558039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:55.456 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.454+0000 7f156b7fe640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f1558037810 0x7f1558039d20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.458+0000 7f1568ff9640 1 -- 172.21.15.99:0/772883263 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f156000d330 con 0x7f156c0a0bb0 2023-12-19T09:40:55.667 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.667+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f156c11d190 con 0x7f156c0a0bb0 2023-12-19T09:40:55.669 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.668+0000 7f1568ff9640 1 -- 172.21.15.99:0/772883263 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86184 (crc 0 0 0) 0x7f156000d150 con 0x7f156c0a0bb0 2023-12-19T09:40:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.670+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f1558037810 msgr2=0x7f1558039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.670+0000 7f157271e640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f1558037810 0x7f1558039d20 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.670+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0bb0 msgr2=0x7f156c11b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.670+0000 7f157271e640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0bb0 0x7f156c11b7f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.671+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 shutdown_connections 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.671+0000 7f157271e640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f1558037810 0x7f1558039d20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.671+0000 7f157271e640 1 --2- 172.21.15.99:0/772883263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f156c0a0bb0 0x7f156c11b7f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.671+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 >> 172.21.15.99:0/772883263 conn(0x7f156c06c9a0 msgr2=0x7f156c0a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.671+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 shutdown_connections 2023-12-19T09:40:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.671+0000 7f157271e640 1 -- 172.21.15.99:0/772883263 wait complete. 2023-12-19T09:40:55.682 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1252704696},{"type":"v1","addr":"172.21.15.178:6801","nonce":1252704696}]},"active_addr":"172.21.15.178:6801/1252704696","active_change":"2023-12-19T09:40:48.237567+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":3268220719}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":3707799299}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":2433884654}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":2888120021}]}]} 2023-12-19T09:40:55.687 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T09:40:55.687 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T09:40:55.687 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T09:40:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.787+0000 7f8c3ca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.791+0000 7f8c3ca6d640 1 Processor -- start 2023-12-19T09:40:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.791+0000 7f8c3ca6d640 1 -- start start 2023-12-19T09:40:55.793 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c3ca6d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8c38097d70 0x7f8c3812f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:55.793 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c3ca6d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c38098960 con 0x7f8c38097960 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c3ca6d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3809a2a0 con 0x7f8c38097d70 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c3659c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8c38097960 0x7f8c3812f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59094/0 (socket says 172.21.15.99:59094) 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c3659c640 1 -- 172.21.15.99:0/1153446195 learned_addr learned my addr 172.21.15.99:0/1153446195 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c35d9b640 1 --2- 172.21.15.99:0/1153446195 >> v2:172.21.15.99:3300/0 conn(0x7f8c38097d70 0x7f8c3812f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c35d9b640 1 -- 172.21.15.99:0/1153446195 >> v1:172.21.15.99:6789/0 conn(0x7f8c38097960 legacy=0x7f8c3812f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c3559a640 1 -- 172.21.15.99:0/1153446195 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198093572 0 0) 0x7f8c38098960 con 0x7f8c38097960 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.792+0000 7f8c35d9b640 1 -- 172.21.15.99:0/1153446195 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38072800 con 0x7f8c38097d70 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c35d9b640 1 --2- 172.21.15.99:0/1153446195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097d70 0x7f8c3812f950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26443784f821c5ff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3559a640 1 -- 172.21.15.99:0/1153446195 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c2c00ac70 con 0x7f8c38097d70 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3559a640 1 -- 172.21.15.99:0/1153446195 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8c2c00add0 con 0x7f8c38097d70 2023-12-19T09:40:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3559a640 1 -- 172.21.15.99:0/1153446195 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c2c00f470 con 0x7f8c38097d70 2023-12-19T09:40:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/1153446195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097d70 msgr2=0x7f8c3812f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3ca6d640 1 --2- 172.21.15.99:0/1153446195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097d70 0x7f8c3812f950 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/1153446195 shutdown_connections 2023-12-19T09:40:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3ca6d640 1 --2- 172.21.15.99:0/1153446195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097d70 0x7f8c3812f950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/1153446195 >> 172.21.15.99:0/1153446195 conn(0x7f8c3809dff0 msgr2=0x7f8c3809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/1153446195 shutdown_connections 2023-12-19T09:40:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.793+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/1153446195 wait complete. 2023-12-19T09:40:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.794+0000 7f8c3ca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.795+0000 7f8c3ca6d640 1 Processor -- start 2023-12-19T09:40:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.795+0000 7f8c3ca6d640 1 -- start start 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.795+0000 7f8c3ca6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097960 0x7f8c3812c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.795+0000 7f8c3ca6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3812e950 con 0x7f8c38097960 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.795+0000 7f8c3659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097960 0x7f8c3812c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.795+0000 7f8c3659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097960 0x7f8c3812c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36940/0 (socket says 172.21.15.99:36940) 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.795+0000 7f8c3659c640 1 -- 172.21.15.99:0/2735847347 learned_addr learned my addr 172.21.15.99:0/2735847347 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.796+0000 7f8c3659c640 1 -- 172.21.15.99:0/2735847347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3808b0d0 con 0x7f8c38097960 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.796+0000 7f8c3659c640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097960 0x7f8c3812c350 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.796+0000 7f8c26ffd640 1 -- 172.21.15.99:0/2735847347 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c28004af0 con 0x7f8c38097960 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.796+0000 7f8c26ffd640 1 -- 172.21.15.99:0/2735847347 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8c28004c50 con 0x7f8c38097960 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.796+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3808a040 con 0x7f8c38097960 2023-12-19T09:40:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.796+0000 7f8c26ffd640 1 -- 172.21.15.99:0/2735847347 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8c28007120 con 0x7f8c38097960 2023-12-19T09:40:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.796+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3812ef40 con 0x7f8c38097960 2023-12-19T09:40:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.797+0000 7f8c26ffd640 1 -- 172.21.15.99:0/2735847347 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f8c280072d0 con 0x7f8c38097960 2023-12-19T09:40:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.797+0000 7f8c26ffd640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f8c18037810 0x7f8c18039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.797+0000 7f8c26ffd640 1 -- 172.21.15.99:0/2735847347 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f8c28046e20 con 0x7f8c38097960 2023-12-19T09:40:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.797+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3812dce0 con 0x7f8c38097960 2023-12-19T09:40:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.797+0000 7f8c35d9b640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f8c18037810 0x7f8c18039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.798+0000 7f8c35d9b640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f8c18037810 0x7f8c18039d20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.802+0000 7f8c26ffd640 1 -- 172.21.15.99:0/2735847347 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f8c2800f230 con 0x7f8c38097960 2023-12-19T09:40:55.969 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.968+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c38062350 con 0x7f8c38097960 2023-12-19T09:40:55.969 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.969+0000 7f8c26ffd640 1 -- 172.21.15.99:0/2735847347 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8664 (crc 0 0 0) 0x7f8c2800a530 con 0x7f8c38097960 2023-12-19T09:40:55.970 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:55.970 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"fsid":"8e93e3b6-2270-4fce-ac6b-2175b078bbce","created":"2023-12-19T09:40:44.025359+0000","modified":"2023-12-19T09:40:55.308438+0000","last_up_change":"2023-12-19T09:40:50.288497+0000","last_in_change":"2023-12-19T09:40:46.130913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T09:40:52.286068+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-19T09:40:54.281968+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"774e1dc8-872f-44c8-9e3e-aabe7df13883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1010486646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":1010486646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":1010486646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1010486646}]},"public_addr":"172.21.15.99:6800/1010486646","cluster_addr":"172.21.15.99:6801/1010486646","heartbeat_back_addr":"172.21.15.99:6805/1010486646","heartbeat_front_addr":"172.21.15.99:6804/1010486646","state":["exists","up"]},{"osd":1,"uuid":"842562c8-a91c-40f8-9fd3-349029d8a22f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6803","nonce":2107593797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2107593797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":2107593797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2107593797}]},"public_addr":"172.21.15.99:6803/2107593797","cluster_addr":"172.21.15.99:6802/2107593797","heartbeat_back_addr":"172.21.15.99:6807/2107593797","heartbeat_front_addr":"172.21.15.99:6806/2107593797","state":["exists","up"]},{"osd":2,"uuid":"7e895fab-1cdf-4c49-80ca-f2b0afb4c81d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1424444103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1424444103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1424444103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":1424444103}]},"public_addr":"172.21.15.178:6803/1424444103","cluster_addr":"172.21.15.178:6802/1424444103","heartbeat_back_addr":"172.21.15.178:6806/1424444103","heartbeat_front_addr":"172.21.15.178:6807/1424444103","state":["exists","up"]},{"osd":3,"uuid":"f686ffba-6c3b-455d-a204-4a79387f0382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":248859203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":248859203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":248859203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":248859203}]},"public_addr":"172.21.15.178:6804/248859203","cluster_addr":"172.21.15.178:6805/248859203","heartbeat_back_addr":"172.21.15.178:6809/248859203","heartbeat_front_addr":"172.21.15.178:6808/248859203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T09:40:55.971 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f8c18037810 msgr2=0x7f8c18039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f8c18037810 0x7f8c18039d20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097960 msgr2=0x7f8c3812c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097960 0x7f8c3812c350 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 shutdown_connections 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f8c18037810 0x7f8c18039d20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 --2- 172.21.15.99:0/2735847347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c38097960 0x7f8c3812c350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 >> 172.21.15.99:0/2735847347 conn(0x7f8c3809dff0 msgr2=0x7f8c3809f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 shutdown_connections 2023-12-19T09:40:55.972 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:55.971+0000 7f8c3ca6d640 1 -- 172.21.15.99:0/2735847347 wait complete. 2023-12-19T09:40:55.982 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T09:40:55.982 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T09:40:56.086 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.082+0000 7fe25b71e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.086+0000 7fe25b71e640 1 Processor -- start 2023-12-19T09:40:56.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.087+0000 7fe25b71e640 1 -- start start 2023-12-19T09:40:56.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.087+0000 7fe25b71e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe2540a0bb0 0x7fe254132f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.087+0000 7fe25b71e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25409deb0 con 0x7fe2540a0fc0 2023-12-19T09:40:56.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.087+0000 7fe25b71e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25409d2b0 con 0x7fe2540a0bb0 2023-12-19T09:40:56.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.087+0000 7fe2594ba640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe2540a0bb0 0x7fe254132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.087+0000 7fe258cb9640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe2540a0fc0 0x7fe254133450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59096/0 (socket says 172.21.15.99:59096) 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.087+0000 7fe258cb9640 1 -- 172.21.15.99:0/3354603354 learned_addr learned my addr 172.21.15.99:0/3354603354 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.088+0000 7fe2594ba640 1 -- 172.21.15.99:0/3354603354 >> v1:172.21.15.99:6789/0 conn(0x7fe2540a0fc0 legacy=0x7fe254133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.088+0000 7fe2594ba640 1 -- 172.21.15.99:0/3354603354 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2541302d0 con 0x7fe2540a0bb0 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.088+0000 7fe24bfff640 1 -- 172.21.15.99:0/3354603354 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40289561 0 0) 0x7fe25409deb0 con 0x7fe2540a0fc0 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.088+0000 7fe2594ba640 1 --2- 172.21.15.99:0/3354603354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe254132f10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5a289da8d95aee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.088+0000 7fe24bfff640 1 -- 172.21.15.99:0/3354603354 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe250009ce0 con 0x7fe2540a0bb0 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.088+0000 7fe24bfff640 1 -- 172.21.15.99:0/3354603354 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe250009e40 con 0x7fe2540a0bb0 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.088+0000 7fe24bfff640 1 -- 172.21.15.99:0/3354603354 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe25000e360 con 0x7fe2540a0bb0 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 1 -- 172.21.15.99:0/3354603354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 msgr2=0x7fe254132f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 1 --2- 172.21.15.99:0/3354603354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe254132f10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 1 -- 172.21.15.99:0/3354603354 shutdown_connections 2023-12-19T09:40:56.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 1 --2- 172.21.15.99:0/3354603354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe254132f10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 1 -- 172.21.15.99:0/3354603354 >> 172.21.15.99:0/3354603354 conn(0x7fe25406c9a0 msgr2=0x7fe25406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 1 -- 172.21.15.99:0/3354603354 shutdown_connections 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 1 -- 172.21.15.99:0/3354603354 wait complete. 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.089+0000 7fe25b71e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.090+0000 7fe25b71e640 1 Processor -- start 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.090+0000 7fe25b71e640 1 -- start start 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe25b71e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe25411b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe25b71e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25411d170 con 0x7fe2540a0bb0 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe2594ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe25411b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe2594ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe25411b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36962/0 (socket says 172.21.15.99:36962) 2023-12-19T09:40:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe2594ba640 1 -- 172.21.15.99:0/3917118760 learned_addr learned my addr 172.21.15.99:0/3917118760 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe2594ba640 1 -- 172.21.15.99:0/3917118760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25406a960 con 0x7fe2540a0bb0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe2594ba640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe25411b7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe249ffb640 1 -- 172.21.15.99:0/3917118760 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe250014620 con 0x7fe2540a0bb0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe249ffb640 1 -- 172.21.15.99:0/3917118760 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe250014780 con 0x7fe2540a0bb0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25412f570 con 0x7fe2540a0bb0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe249ffb640 1 -- 172.21.15.99:0/3917118760 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe250014a20 con 0x7fe2540a0bb0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.091+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25411e040 con 0x7fe2540a0bb0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.092+0000 7fe249ffb640 1 -- 172.21.15.99:0/3917118760 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fe250014bd0 con 0x7fe2540a0bb0 2023-12-19T09:40:56.095 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.092+0000 7fe249ffb640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe238037810 0x7fe238039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.096 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.092+0000 7fe249ffb640 1 -- 172.21.15.99:0/3917118760 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fe250019040 con 0x7fe2540a0bb0 2023-12-19T09:40:56.096 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.092+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25406a960 con 0x7fe2540a0bb0 2023-12-19T09:40:56.096 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.093+0000 7fe258cb9640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe238037810 0x7fe238039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.096 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.093+0000 7fe258cb9640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe238037810 0x7fe238039d20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.097 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.097+0000 7fe249ffb640 1 -- 172.21.15.99:0/3917118760 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fe25406a960 con 0x7fe2540a0bb0 2023-12-19T09:40:56.265 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.264+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe25411f6d0 con 0x7fe2540a0bb0 2023-12-19T09:40:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.265+0000 7fe249ffb640 1 -- 172.21.15.99:0/3917118760 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8664 (crc 0 0 0) 0x7fe25411f6d0 con 0x7fe2540a0bb0 2023-12-19T09:40:56.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:56.266 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":13,"fsid":"8e93e3b6-2270-4fce-ac6b-2175b078bbce","created":"2023-12-19T09:40:44.025359+0000","modified":"2023-12-19T09:40:55.308438+0000","last_up_change":"2023-12-19T09:40:50.288497+0000","last_in_change":"2023-12-19T09:40:46.130913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T09:40:52.286068+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-19T09:40:54.281968+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"774e1dc8-872f-44c8-9e3e-aabe7df13883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1010486646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":1010486646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":1010486646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1010486646}]},"public_addr":"172.21.15.99:6800/1010486646","cluster_addr":"172.21.15.99:6801/1010486646","heartbeat_back_addr":"172.21.15.99:6805/1010486646","heartbeat_front_addr":"172.21.15.99:6804/1010486646","state":["exists","up"]},{"osd":1,"uuid":"842562c8-a91c-40f8-9fd3-349029d8a22f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6803","nonce":2107593797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2107593797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":2107593797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2107593797}]},"public_addr":"172.21.15.99:6803/2107593797","cluster_addr":"172.21.15.99:6802/2107593797","heartbeat_back_addr":"172.21.15.99:6807/2107593797","heartbeat_front_addr":"172.21.15.99:6806/2107593797","state":["exists","up"]},{"osd":2,"uuid":"7e895fab-1cdf-4c49-80ca-f2b0afb4c81d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1424444103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1424444103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1424444103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":1424444103}]},"public_addr":"172.21.15.178:6803/1424444103","cluster_addr":"172.21.15.178:6802/1424444103","heartbeat_back_addr":"172.21.15.178:6806/1424444103","heartbeat_front_addr":"172.21.15.178:6807/1424444103","state":["exists","up"]},{"osd":3,"uuid":"f686ffba-6c3b-455d-a204-4a79387f0382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":248859203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":248859203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":248859203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":248859203}]},"public_addr":"172.21.15.178:6804/248859203","cluster_addr":"172.21.15.178:6805/248859203","heartbeat_back_addr":"172.21.15.178:6809/248859203","heartbeat_front_addr":"172.21.15.178:6808/248859203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe238037810 msgr2=0x7fe238039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe238037810 0x7fe238039d20 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 msgr2=0x7fe25411b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe25411b7f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 shutdown_connections 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe238037810 0x7fe238039d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 --2- 172.21.15.99:0/3917118760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2540a0bb0 0x7fe25411b7f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 >> 172.21.15.99:0/3917118760 conn(0x7fe25406c9a0 msgr2=0x7fe25409e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 shutdown_connections 2023-12-19T09:40:56.270 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.267+0000 7fe25b71e640 1 -- 172.21.15.99:0/3917118760 wait complete. 2023-12-19T09:40:56.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T09:40:56.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T09:40:56.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T09:40:56.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T09:40:56.396 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.391+0000 7f6bdbd9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.396 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.391+0000 7f0b0db15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.397 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.391+0000 7fc4cca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.397 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.396+0000 7f6bdbd9e640 1 Processor -- start 2023-12-19T09:40:56.398 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.396+0000 7fc4cca6d640 1 Processor -- start 2023-12-19T09:40:56.398 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.396+0000 7fc4cca6d640 1 -- start start 2023-12-19T09:40:56.398 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.396+0000 7f0b0db15640 1 Processor -- start 2023-12-19T09:40:56.398 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.396+0000 7f0b0db15640 1 -- start start 2023-12-19T09:40:56.399 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.396+0000 7f6bdbd9e640 1 -- start start 2023-12-19T09:40:56.399 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.392+0000 7fc9e535e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.399 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7f0b0db15640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b0812ff00 0x7f0b08130310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.400 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7fc4cca6d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc4c8098480 0x7fc4c8098890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.400 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7fc4cca6d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c80729f0 con 0x7fc4c8098dd0 2023-12-19T09:40:56.400 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7f0b0db15640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b0809af50 con 0x7f0b0812c500 2023-12-19T09:40:56.400 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7f0b0db15640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0812fa00 con 0x7f0b0812ff00 2023-12-19T09:40:56.401 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7fc4cca6d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c809aa70 con 0x7fc4c8098480 2023-12-19T09:40:56.401 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7f0b077fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b0812ff00 0x7f0b08130310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.401 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7fc4c659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc4c8098480 0x7fc4c8098890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.401 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7f0b077fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b0812ff00 0x7f0b08130310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36972/0 (socket says 172.21.15.99:36972) 2023-12-19T09:40:56.402 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7f0b077fe640 1 -- 172.21.15.99:0/932833339 learned_addr learned my addr 172.21.15.99:0/932833339 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.402 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7fc4c659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc4c8098480 0x7fc4c8098890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36970/0 (socket says 172.21.15.99:36970) 2023-12-19T09:40:56.402 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7fc4c5d9b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc4c8098dd0 0x7fc4c8097110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59108/0 (socket says 172.21.15.99:59108) 2023-12-19T09:40:56.402 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.397+0000 7fc4c659c640 1 -- 172.21.15.99:0/3492686556 learned_addr learned my addr 172.21.15.99:0/3492686556 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.402 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc9e535e640 1 Processor -- start 2023-12-19T09:40:56.403 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bdbd9e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6bd40a0bb0 0x7f6bd4132f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.403 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bdbd9e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd409deb0 con 0x7f6bd40a0fc0 2023-12-19T09:40:56.404 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc9e535e640 1 -- start start 2023-12-19T09:40:56.404 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bdbd9e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd409d2b0 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.405 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd9b3a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6bd40a0bb0 0x7f6bd4132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.405 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc4c659c640 1 -- 172.21.15.99:0/3492686556 >> v1:172.21.15.99:6789/0 conn(0x7fc4c8098dd0 legacy=0x7fc4c8097110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.405 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd9b3a640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6bd40a0bb0 0x7f6bd4132f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36978/0 (socket says 172.21.15.99:36978) 2023-12-19T09:40:56.405 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd9b3a640 1 -- 172.21.15.99:0/1734403626 learned_addr learned my addr 172.21.15.99:0/1734403626 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.406 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc4c559a640 1 -- 172.21.15.99:0/3492686556 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387722367 0 0) 0x7fc4c80729f0 con 0x7fc4c8098dd0 2023-12-19T09:40:56.406 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc4c659c640 1 -- 172.21.15.99:0/3492686556 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c809a760 con 0x7fc4c8098480 2023-12-19T09:40:56.406 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f0b077fe640 1 -- 172.21.15.99:0/932833339 >> v1:172.21.15.99:6789/0 conn(0x7f0b0812c500 legacy=0x7f0b0812c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.406 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f0b077fe640 1 -- 172.21.15.99:0/932833339 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0806e220 con 0x7f0b0812ff00 2023-12-19T09:40:56.406 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd8b38640 1 -- 172.21.15.99:0/1734403626 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728748057 0 0) 0x7f6bd409deb0 con 0x7f6bd40a0fc0 2023-12-19T09:40:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc4c659c640 1 --2- 172.21.15.99:0/3492686556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c8098890 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d09437cc25f2bd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd8b38640 1 -- 172.21.15.99:0/1734403626 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc00034f0 con 0x7f6bd40a0fc0 2023-12-19T09:40:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd9b3a640 1 -- 172.21.15.99:0/1734403626 >> v1:172.21.15.99:6789/0 conn(0x7f6bd40a0fc0 legacy=0x7f6bd4133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.408 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f0b077fe640 1 --2- 172.21.15.99:0/932833339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812ff00 0x7f0b08130310 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12692d1624799ee5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.408 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd9b3a640 1 -- 172.21.15.99:0/1734403626 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd41302d0 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc4c559a640 1 -- 172.21.15.99:0/3492686556 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc4b800ad60 con 0x7fc4c8098480 2023-12-19T09:40:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc4c559a640 1 -- 172.21.15.99:0/3492686556 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc4b800f340 con 0x7fc4c8098480 2023-12-19T09:40:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7fc4c559a640 1 -- 172.21.15.99:0/3492686556 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc4b800f5e0 con 0x7fc4c8098480 2023-12-19T09:40:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd9b3a640 1 --2- 172.21.15.99:0/1734403626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd4132f10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a212b5a66e08d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f6bd8b38640 1 -- 172.21.15.99:0/1734403626 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6bd0009d40 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.398+0000 7f0b067fc640 1 -- 172.21.15.99:0/932833339 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0af8009dd0 con 0x7f0b0812ff00 2023-12-19T09:40:56.410 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7f0b067fc640 1 -- 172.21.15.99:0/932833339 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0af800e230 con 0x7f0b0812ff00 2023-12-19T09:40:56.411 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7f0b067fc640 1 -- 172.21.15.99:0/932833339 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0af800e4d0 con 0x7f0b0812ff00 2023-12-19T09:40:56.411 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7f6bd8b38640 1 -- 172.21.15.99:0/1734403626 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6bd000e230 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.411 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7f6bd8b38640 1 -- 172.21.15.99:0/1734403626 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6bd0009ea0 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9e535e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc9e0132760 0x7fc9e0134b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9e535e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e0098660 con 0x7fc9e0094470 2023-12-19T09:40:56.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9e535e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e0096600 con 0x7fc9e0132760 2023-12-19T09:40:56.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9deffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc9e0094470 0x7fc9e0094880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59128/0 (socket says 172.21.15.99:59128) 2023-12-19T09:40:56.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9deffd640 1 -- 172.21.15.99:0/1575256116 learned_addr learned my addr 172.21.15.99:0/1575256116 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:56.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9d67fc640 1 --2- 172.21.15.99:0/1575256116 >> v2:172.21.15.99:3300/0 conn(0x7fc9e0132760 0x7fc9e0134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131016489 0 0) 0x7fc9e0098660 con 0x7fc9e0094470 2023-12-19T09:40:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9cc0034f0 con 0x7fc9e0094470 2023-12-19T09:40:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057501793 0 0) 0x7fc9cc0034f0 con 0x7fc9e0094470 2023-12-19T09:40:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 >> v2:172.21.15.99:3300/0 conn(0x7fc9e0132760 msgr2=0x7fc9e0134b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T09:40:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9de7fc640 1 --2- 172.21.15.99:0/1575256116 >> v2:172.21.15.99:3300/0 conn(0x7fc9e0132760 0x7fc9e0134b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7f0b0db15640 1 -- 172.21.15.99:0/932833339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812ff00 msgr2=0x7f0b08130310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7f0b0db15640 1 --2- 172.21.15.99:0/932833339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812ff00 0x7f0b08130310 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc4cca6d640 1 -- 172.21.15.99:0/3492686556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 msgr2=0x7fc4c8098890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc4cca6d640 1 --2- 172.21.15.99:0/3492686556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c8098890 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc4cca6d640 1 -- 172.21.15.99:0/3492686556 shutdown_connections 2023-12-19T09:40:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc4cca6d640 1 --2- 172.21.15.99:0/3492686556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c8098890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc4cca6d640 1 -- 172.21.15.99:0/3492686556 >> 172.21.15.99:0/3492686556 conn(0x7fc4c809dff0 msgr2=0x7fc4c809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.399+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00962f0 con 0x7fc9e0094470 2023-12-19T09:40:56.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f0b0db15640 1 -- 172.21.15.99:0/932833339 shutdown_connections 2023-12-19T09:40:56.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 139634355 0 0) 0x7fc9d00015a0 con 0x7fc9e0094470 2023-12-19T09:40:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f0b0db15640 1 --2- 172.21.15.99:0/932833339 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812ff00 0x7f0b08130310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/1734403626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 msgr2=0x7f6bd4132f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/1734403626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd4132f10 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 >> v1:172.21.15.99:6789/0 conn(0x7fc9e0094470 legacy=0x7fc9e0094880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f0b0db15640 1 -- 172.21.15.99:0/932833339 >> 172.21.15.99:0/932833339 conn(0x7f0b0809dff0 msgr2=0x7f0b0809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc9de7fc640 1 --2- 172.21.15.99:0/1575256116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f0b0db15640 1 -- 172.21.15.99:0/932833339 shutdown_connections 2023-12-19T09:40:56.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/1734403626 shutdown_connections 2023-12-19T09:40:56.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/1734403626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd4132f10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f0b0db15640 1 -- 172.21.15.99:0/932833339 wait complete. 2023-12-19T09:40:56.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/1734403626 >> 172.21.15.99:0/1734403626 conn(0x7f6bd406c9a0 msgr2=0x7f6bd406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0096600 con 0x7fc9cc003990 2023-12-19T09:40:56.419 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc4cca6d640 1 -- 172.21.15.99:0/3492686556 shutdown_connections 2023-12-19T09:40:56.419 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc4cca6d640 1 -- 172.21.15.99:0/3492686556 wait complete. 2023-12-19T09:40:56.419 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc9deffd640 1 --2- 172.21.15.99:0/1575256116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/1734403626 shutdown_connections 2023-12-19T09:40:56.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/1734403626 wait complete. 2023-12-19T09:40:56.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f0b0db15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc4cca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7f6bdbd9e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc9deffd640 1 -- 172.21.15.99:0/1575256116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0034f0 con 0x7fc9cc003990 2023-12-19T09:40:56.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.400+0000 7fc9deffd640 1 --2- 172.21.15.99:0/1575256116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9cc003de0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965d423cafdcc26a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc9d0007b70 con 0x7fc9cc003990 2023-12-19T09:40:56.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc9d00059d0 con 0x7fc9cc003990 2023-12-19T09:40:56.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7fc9de7fc640 1 -- 172.21.15.99:0/1575256116 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc9d0005c70 con 0x7fc9cc003990 2023-12-19T09:40:56.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7f6bdbd9e640 1 Processor -- start 2023-12-19T09:40:56.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7f0b0db15640 1 Processor -- start 2023-12-19T09:40:56.423 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7f6bdbd9e640 1 -- start start 2023-12-19T09:40:56.423 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7f0b0db15640 1 -- start start 2023-12-19T09:40:56.423 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.401+0000 7fc4cca6d640 1 Processor -- start 2023-12-19T09:40:56.423 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc4cca6d640 1 -- start start 2023-12-19T09:40:56.424 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 -- 172.21.15.99:0/1575256116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 msgr2=0x7fc9cc003de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.424 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 --2- 172.21.15.99:0/1575256116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9cc003de0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.424 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f6bdbd9e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd411b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.425 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 -- 172.21.15.99:0/1575256116 shutdown_connections 2023-12-19T09:40:56.425 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 --2- 172.21.15.99:0/1575256116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9cc003de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.425 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 --2- 172.21.15.99:0/1575256116 >> v2:172.21.15.99:3300/0 conn(0x7fc9e0132760 0x7fc9e0134b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.425 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 -- 172.21.15.99:0/1575256116 >> 172.21.15.99:0/1575256116 conn(0x7fc9e009f0d0 msgr2=0x7fc9e009f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.425 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f6bdbd9e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd411cbe0 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.426 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 -- 172.21.15.99:0/1575256116 shutdown_connections 2023-12-19T09:40:56.426 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 1 -- 172.21.15.99:0/1575256116 wait complete. 2023-12-19T09:40:56.426 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f0b0db15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812c500 0x7f0b081c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.426 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f0b0db15640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08126b80 con 0x7f0b0812c500 2023-12-19T09:40:56.427 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f6bd9b3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd411b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.427 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f6bd9b3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd411b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36988/0 (socket says 172.21.15.99:36988) 2023-12-19T09:40:56.427 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f6bd9b3a640 1 -- 172.21.15.99:0/801329110 learned_addr learned my addr 172.21.15.99:0/801329110 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.427 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f0b077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812c500 0x7f0b081c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.428 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f0b077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812c500 0x7f0b081c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36996/0 (socket says 172.21.15.99:36996) 2023-12-19T09:40:56.428 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc9e535e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.428 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f0b077fe640 1 -- 172.21.15.99:0/291481657 learned_addr learned my addr 172.21.15.99:0/291481657 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.428 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc4cca6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c812c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.428 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7fc4cca6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c812fca0 con 0x7fc4c8098480 2023-12-19T09:40:56.429 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.402+0000 7f6bd9b3a640 1 -- 172.21.15.99:0/801329110 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd411d210 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.429 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7fc4c659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c812c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.429 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7fc4c659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c812c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37008/0 (socket says 172.21.15.99:37008) 2023-12-19T09:40:56.429 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7fc4c659c640 1 -- 172.21.15.99:0/966839397 learned_addr learned my addr 172.21.15.99:0/966839397 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f6bd9b3a640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd411b7f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f0b077fe640 1 -- 172.21.15.99:0/291481657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0808e9a0 con 0x7f0b0812c500 2023-12-19T09:40:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f0b077fe640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812c500 0x7f0b081c4eb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7fc4c659c640 1 -- 172.21.15.99:0/966839397 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c806b9c0 con 0x7fc4c8098480 2023-12-19T09:40:56.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6bd0014410 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6bd0014570 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd411e2d0 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0af8014540 con 0x7f0b0812c500 2023-12-19T09:40:56.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b081267e0 con 0x7f0b0812c500 2023-12-19T09:40:56.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7fc4c659c640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c812c2e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6bd0014810 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd412f630 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0808e620 con 0x7f0b0812c500 2023-12-19T09:40:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0af80146a0 con 0x7f0b0812c500 2023-12-19T09:40:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0af8014940 con 0x7f0b0812c500 2023-12-19T09:40:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.403+0000 7fc9e535e640 1 Processor -- start 2023-12-19T09:40:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7fc9e535e640 1 -- start start 2023-12-19T09:40:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ae8000f10 con 0x7f0b0812c500 2023-12-19T09:40:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6bd409f570 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc4b800fea0 con 0x7fc4c8098480 2023-12-19T09:40:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc4b8011420 con 0x7fc4c8098480 2023-12-19T09:40:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc4b80116c0 con 0x7fc4c8098480 2023-12-19T09:40:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7fc4cca6d640 1 -- 172.21.15.99:0/966839397 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c812dd60 con 0x7fc4c8098480 2023-12-19T09:40:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f0af8014b40 con 0x7f0b0812c500 2023-12-19T09:40:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f0aeffff640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0af40377c0 0x7f0af4039cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f6bd0014970 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f0af8019040 con 0x7f0b0812c500 2023-12-19T09:40:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f0aeffff640 1 --2- 172.21.15.99:0/291481657 >> v2:172.21.15.178:6803/1424444103 conn(0x7f0af403c7b0 0x7f0af403ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 --> v2:172.21.15.178:6803/1424444103 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0af403f2d0 con 0x7f0af403c7b0 2023-12-19T09:40:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.404+0000 7fc4cca6d640 1 -- 172.21.15.99:0/966839397 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c8097ca0 con 0x7fc4c8098480 2023-12-19T09:40:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7fc9e535e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9e0137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7fc9e535e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0138eb0 con 0x7fc9cc003990 2023-12-19T09:40:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f6bca7fc640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f6bb80378b0 0x7f6bb8039dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f6bd0019040 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7f0af8013e40 con 0x7f0b0812c500 2023-12-19T09:40:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f6bca7fc640 1 --2- 172.21.15.99:0/801329110 >> v2:172.21.15.99:6800/1010486646 conn(0x7f6bb803c8a0 0x7f6bb803ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 --> v2:172.21.15.99:6800/1010486646 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bb803f3c0 con 0x7f6bb803c8a0 2023-12-19T09:40:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7f6bd0014c70 con 0x7f6bd40a0bb0 2023-12-19T09:40:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7fc9deffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9e0137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7fc9deffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9e0137a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37020/0 (socket says 172.21.15.99:37020) 2023-12-19T09:40:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7fc9deffd640 1 -- 172.21.15.99:0/3250911038 learned_addr learned my addr 172.21.15.99:0/3250911038 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f0b06ffd640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0af40377c0 0x7f0af4039cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7fc4cca6d640 1 -- 172.21.15.99:0/966839397 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4c809c760 con 0x7fc4c8098480 2023-12-19T09:40:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7f6bd9339640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f6bb80378b0 0x7f6bb8039dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.405+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fc4b8011870 con 0x7fc4c8098480 2023-12-19T09:40:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7f0b07fff640 1 --2- 172.21.15.99:0/291481657 >> v2:172.21.15.178:6803/1424444103 conn(0x7f0af403c7b0 0x7f0af403ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:40:56.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc4b6ffd640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc4a8037810 0x7fc4a8039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc9deffd640 1 -- 172.21.15.99:0/3250911038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e0126390 con 0x7fc9cc003990 2023-12-19T09:40:56.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fc4b8049b70 con 0x7fc4c8098480 2023-12-19T09:40:56.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7f0b06ffd640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0af40377c0 0x7f0af4039cd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc4b6ffd640 1 --2- 172.21.15.99:0/966839397 >> v2:172.21.15.178:6804/248859203 conn(0x7fc4a803c7b0 0x7fc4a803ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 --> v2:172.21.15.178:6804/248859203 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4a803f2d0 con 0x7fc4a803c7b0 2023-12-19T09:40:56.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7fc4b8049df0 con 0x7fc4c8098480 2023-12-19T09:40:56.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc4c5d9b640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc4a8037810 0x7fc4a8039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.442 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7f6bd9339640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f6bb80378b0 0x7f6bb8039dc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.443 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc9deffd640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9e0137a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.443 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7f6bda33b640 1 --2- 172.21.15.99:0/801329110 >> v2:172.21.15.99:6800/1010486646 conn(0x7f6bb803c8a0 0x7f6bb803ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:40:56.443 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc9d0005e80 con 0x7fc9cc003990 2023-12-19T09:40:56.444 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc9d0007040 con 0x7fc9cc003990 2023-12-19T09:40:56.444 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc9d00072e0 con 0x7fc9cc003990 2023-12-19T09:40:56.444 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e0126c30 con 0x7fc9cc003990 2023-12-19T09:40:56.444 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e0127a30 con 0x7fc9cc003990 2023-12-19T09:40:56.444 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.406+0000 7fc4c5d9b640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc4a8037810 0x7fc4a8039d20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.446 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.407+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9e0067e50 con 0x7fc9cc003990 2023-12-19T09:40:56.446 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.407+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fc9d0007490 con 0x7fc9cc003990 2023-12-19T09:40:56.446 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7fc9d7fff640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc9c0037810 0x7fc9c0039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.446 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fc9d0047d90 con 0x7fc9cc003990 2023-12-19T09:40:56.446 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7fc9d7fff640 1 --2- 172.21.15.99:0/3250911038 >> v2:172.21.15.99:6803/2107593797 conn(0x7fc9c003c860 0x7fc9c003ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.447 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 --> v2:172.21.15.99:6803/2107593797 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9c003f380 con 0x7fc9c003c860 2023-12-19T09:40:56.447 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7fc9d0016e60 con 0x7fc9cc003990 2023-12-19T09:40:56.447 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7fc9d67fc640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc9c0037810 0x7fc9c0039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.447 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7fc9d67fc640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc9c0037810 0x7fc9c0039d20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.447 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.408+0000 7f0b07fff640 1 --2- 172.21.15.99:0/291481657 >> v2:172.21.15.178:6803/1424444103 conn(0x7f0af403c7b0 0x7f0af403ec40 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.447 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.409+0000 7f6bda33b640 1 --2- 172.21.15.99:0/801329110 >> v2:172.21.15.99:6800/1010486646 conn(0x7f6bb803c8a0 0x7f6bb803ed30 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.448 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.409+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== osd.2 v2:172.21.15.178:6803/1424444103 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f0af403f2d0 con 0x7f0af403c7b0 2023-12-19T09:40:56.448 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.410+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== osd.0 v2:172.21.15.99:6800/1010486646 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f6bb803f3c0 con 0x7f6bb803c8a0 2023-12-19T09:40:56.448 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.410+0000 7fc4c6d9d640 1 --2- 172.21.15.99:0/966839397 >> v2:172.21.15.178:6804/248859203 conn(0x7fc4a803c7b0 0x7fc4a803ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:40:56.448 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.411+0000 7fc9df7fe640 1 --2- 172.21.15.99:0/3250911038 >> v2:172.21.15.99:6803/2107593797 conn(0x7fc9c003c860 0x7fc9c003ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:40:56.449 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.412+0000 7fc4c6d9d640 1 --2- 172.21.15.99:0/966839397 >> v2:172.21.15.178:6804/248859203 conn(0x7fc4a803c7b0 0x7fc4a803ec40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.449 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.413+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 --> v2:172.21.15.178:6803/1424444103 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ae8002af0 con 0x7f0af403c7b0 2023-12-19T09:40:56.449 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.413+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== osd.3 v2:172.21.15.178:6804/248859203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fc4a803f2d0 con 0x7fc4a803c7b0 2023-12-19T09:40:56.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.414+0000 7fc9df7fe640 1 --2- 172.21.15.99:0/3250911038 >> v2:172.21.15.99:6803/2107593797 conn(0x7fc9c003c860 0x7fc9c003ecf0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.450 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.414+0000 7f0aeffff640 1 -- 172.21.15.99:0/291481657 <== osd.2 v2:172.21.15.178:6803/1424444103 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ae8002af0 con 0x7f0af403c7b0 2023-12-19T09:40:56.451 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 >> v2:172.21.15.178:6803/1424444103 conn(0x7f0af403c7b0 msgr2=0x7f0af403ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.451 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 --2- 172.21.15.99:0/291481657 >> v2:172.21.15.178:6803/1424444103 conn(0x7f0af403c7b0 0x7f0af403ec40 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.451 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0af40377c0 msgr2=0x7f0af4039cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.451 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0af40377c0 0x7f0af4039cd0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812c500 msgr2=0x7f0b081c4eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812c500 0x7f0b081c4eb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 shutdown_connections 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 --2- 172.21.15.99:0/291481657 >> v2:172.21.15.178:6803/1424444103 conn(0x7f0af403c7b0 0x7f0af403ec40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0af40377c0 0x7f0af4039cd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 --2- 172.21.15.99:0/291481657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b0812c500 0x7f0b081c4eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 >> 172.21.15.99:0/291481657 conn(0x7f0b0809dff0 msgr2=0x7f0b08099d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 shutdown_connections 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7f0b0db15640 1 -- 172.21.15.99:0/291481657 wait complete. 2023-12-19T09:40:56.452 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.415+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== osd.1 v2:172.21.15.99:6803/2107593797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fc9c003f380 con 0x7fc9c003c860 2023-12-19T09:40:56.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.416+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 --> v2:172.21.15.99:6800/1010486646 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6bd411f180 con 0x7f6bb803c8a0 2023-12-19T09:40:56.453 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bca7fc640 1 -- 172.21.15.99:0/801329110 <== osd.0 v2:172.21.15.99:6800/1010486646 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6bd411f180 con 0x7f6bb803c8a0 2023-12-19T09:40:56.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 >> v2:172.21.15.99:6800/1010486646 conn(0x7f6bb803c8a0 msgr2=0x7f6bb803ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/801329110 >> v2:172.21.15.99:6800/1010486646 conn(0x7f6bb803c8a0 0x7f6bb803ed30 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f6bb80378b0 msgr2=0x7f6bb8039dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.454 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f6bb80378b0 0x7f6bb8039dc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 msgr2=0x7f6bd411b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd411b7f0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.417+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 shutdown_connections 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.418+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f6bb80378b0 0x7f6bb8039dc0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.418+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/801329110 >> v2:172.21.15.99:6800/1010486646 conn(0x7f6bb803c8a0 0x7f6bb803ed30 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.418+0000 7f6bdbd9e640 1 --2- 172.21.15.99:0/801329110 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6bd40a0bb0 0x7f6bd411b7f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.418+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 >> 172.21.15.99:0/801329110 conn(0x7f6bd406c9a0 msgr2=0x7f6bd409e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.418+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 shutdown_connections 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.418+0000 7f6bdbd9e640 1 -- 172.21.15.99:0/801329110 wait complete. 2023-12-19T09:40:56.455 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.419+0000 7fc4cca6d640 1 -- 172.21.15.99:0/966839397 --> v2:172.21.15.178:6804/248859203 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc4c809b2d0 con 0x7fc4a803c7b0 2023-12-19T09:40:56.456 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.419+0000 7fc4b6ffd640 1 -- 172.21.15.99:0/966839397 <== osd.3 v2:172.21.15.178:6804/248859203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc4c000a820 con 0x7fc4a803c7b0 2023-12-19T09:40:56.457 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 -- 172.21.15.99:0/966839397 >> v2:172.21.15.178:6804/248859203 conn(0x7fc4a803c7b0 msgr2=0x7fc4a803ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.457 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 --2- 172.21.15.99:0/966839397 >> v2:172.21.15.178:6804/248859203 conn(0x7fc4a803c7b0 0x7fc4a803ec40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 -- 172.21.15.99:0/966839397 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc4a8037810 msgr2=0x7fc4a8039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc4a8037810 0x7fc4a8039d20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 -- 172.21.15.99:0/966839397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 msgr2=0x7fc4c812c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c812c2e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 -- 172.21.15.99:0/966839397 shutdown_connections 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 --2- 172.21.15.99:0/966839397 >> v2:172.21.15.178:6804/248859203 conn(0x7fc4a803c7b0 0x7fc4a803ec40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc4a8037810 0x7fc4a8039d20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 --2- 172.21.15.99:0/966839397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4c8098480 0x7fc4c812c2e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 -- 172.21.15.99:0/966839397 >> 172.21.15.99:0/966839397 conn(0x7fc4c809dff0 msgr2=0x7fc4c81b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 -- 172.21.15.99:0/966839397 shutdown_connections 2023-12-19T09:40:56.458 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc4b4ff9640 1 -- 172.21.15.99:0/966839397 wait complete. 2023-12-19T09:40:56.459 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.420+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 --> v2:172.21.15.99:6803/2107593797 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc9e0062350 con 0x7fc9c003c860 2023-12-19T09:40:56.459 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9d7fff640 1 -- 172.21.15.99:0/3250911038 <== osd.1 v2:172.21.15.99:6803/2107593797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc9e0062350 con 0x7fc9c003c860 2023-12-19T09:40:56.460 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 >> v2:172.21.15.99:6803/2107593797 conn(0x7fc9c003c860 msgr2=0x7fc9c003ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.460 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 --2- 172.21.15.99:0/3250911038 >> v2:172.21.15.99:6803/2107593797 conn(0x7fc9c003c860 0x7fc9c003ecf0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.460 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc9c0037810 msgr2=0x7fc9c0039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.460 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc9c0037810 0x7fc9c0039d20 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 msgr2=0x7fc9e0137a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9e0137a70 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 shutdown_connections 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 --2- 172.21.15.99:0/3250911038 >> v2:172.21.15.99:6803/2107593797 conn(0x7fc9c003c860 0x7fc9c003ecf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc9c0037810 0x7fc9c0039d20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 --2- 172.21.15.99:0/3250911038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9cc003990 0x7fc9e0137a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.422+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 >> 172.21.15.99:0/3250911038 conn(0x7fc9e009f0d0 msgr2=0x7fc9e009f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.424+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 shutdown_connections 2023-12-19T09:40:56.461 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.424+0000 7fc9e535e640 1 -- 172.21.15.99:0/3250911038 wait complete. 2023-12-19T09:40:56.462 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.462 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T09:40:56.463 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.463 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T09:40:56.464 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T09:40:56.465 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.465 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T09:40:56.618 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.613+0000 7f0e55cf0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.618 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.613+0000 7fa1fcc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.618 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.613+0000 7f898059e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.619 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.613+0000 7f16da15e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.619 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7fa1fcc2d640 1 Processor -- start 2023-12-19T09:40:56.619 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7f898059e640 1 Processor -- start 2023-12-19T09:40:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7fa1fcc2d640 1 -- start start 2023-12-19T09:40:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7f898059e640 1 -- start start 2023-12-19T09:40:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7f16da15e640 1 Processor -- start 2023-12-19T09:40:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7f0e55cf0640 1 Processor -- start 2023-12-19T09:40:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7f16da15e640 1 -- start start 2023-12-19T09:40:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.618+0000 7f0e55cf0640 1 -- start start 2023-12-19T09:40:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f16da15e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f16d4097d70 0x7f16d412f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f898059e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8978132d70 0x7f8978135190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f898059e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f897809af50 con 0x7f897812ff00 2023-12-19T09:40:56.622 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f898059e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f897812fa00 con 0x7f8978132d70 2023-12-19T09:40:56.622 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1fcc2d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa1f8097d70 0x7fa1f812f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.622 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f16da15e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d4098960 con 0x7f16d4097960 2023-12-19T09:40:56.622 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f16da15e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d409a2a0 con 0x7f16d4097d70 2023-12-19T09:40:56.622 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1fcc2d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f8098960 con 0x7fa1f8097960 2023-12-19T09:40:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1fcc2d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f809a2a0 con 0x7fa1f8097d70 2023-12-19T09:40:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f0e55cf0640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0e500a0bb0 0x7f0e50132f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f0e55cf0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5009deb0 con 0x7f0e500a0fc0 2023-12-19T09:40:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f0e55cf0640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5009d2b0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1f5d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa1f8097d70 0x7fa1f812f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f16d37fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f16d4097960 0x7f16d412f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59154/0 (socket says 172.21.15.99:59154) 2023-12-19T09:40:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f897db39640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8978132d70 0x7f8978135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1f5d9b640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa1f8097d70 0x7fa1f812f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37028/0 (socket says 172.21.15.99:37028) 2023-12-19T09:40:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1f5d9b640 1 -- 172.21.15.99:0/346767434 learned_addr learned my addr 172.21.15.99:0/346767434 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f16d37fe640 1 -- 172.21.15.99:0/1333808622 learned_addr learned my addr 172.21.15.99:0/1333808622 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:56.625 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f897db39640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8978132d70 0x7f8978135190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37034/0 (socket says 172.21.15.99:37034) 2023-12-19T09:40:56.625 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f897db39640 1 -- 172.21.15.99:0/3975803304 learned_addr learned my addr 172.21.15.99:0/3975803304 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.625 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f897e33a640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f897812ff00 0x7f8978130310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59138/0 (socket says 172.21.15.99:59138) 2023-12-19T09:40:56.626 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f0e4effd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0e500a0fc0 0x7f0e50133450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59162/0 (socket says 172.21.15.99:59162) 2023-12-19T09:40:56.628 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f0e4effd640 1 -- 172.21.15.99:0/1394579548 learned_addr learned my addr 172.21.15.99:0/1394579548 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:56.628 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f0e4f7fe640 1 --2- 172.21.15.99:0/1394579548 >> v2:172.21.15.99:3300/0 conn(0x7f0e500a0bb0 0x7f0e50132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7f16d2ffd640 1 --2- 172.21.15.99:0/1333808622 >> v2:172.21.15.99:3300/0 conn(0x7f16d4097d70 0x7f16d412f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1f5d9b640 1 -- 172.21.15.99:0/346767434 >> v1:172.21.15.99:6789/0 conn(0x7fa1f8097960 legacy=0x7fa1f812f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.619+0000 7fa1f5d9b640 1 -- 172.21.15.99:0/346767434 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8072800 con 0x7fa1f8097d70 2023-12-19T09:40:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7fa1f5d9b640 1 --2- 172.21.15.99:0/346767434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097d70 0x7fa1f812f950 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfbf2c4e410507c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d27fc640 1 -- 172.21.15.99:0/1333808622 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838499774 0 0) 0x7f16d4098960 con 0x7f16d4097960 2023-12-19T09:40:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d27fc640 1 -- 172.21.15.99:0/1333808622 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16bc0034f0 con 0x7f16d4097960 2023-12-19T09:40:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f897db39640 1 -- 172.21.15.99:0/3975803304 >> v1:172.21.15.99:6789/0 conn(0x7f897812ff00 legacy=0x7f8978130310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f897db39640 1 -- 172.21.15.99:0/3975803304 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897806e220 con 0x7f8978132d70 2023-12-19T09:40:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f0e4e7fc640 1 -- 172.21.15.99:0/1394579548 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738913377 0 0) 0x7f0e5009deb0 con 0x7f0e500a0fc0 2023-12-19T09:40:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f0e4f7fe640 1 -- 172.21.15.99:0/1394579548 >> v1:172.21.15.99:6789/0 conn(0x7f0e500a0fc0 legacy=0x7f0e50133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f0e4f7fe640 1 -- 172.21.15.99:0/1394579548 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e501302d0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d2ffd640 1 -- 172.21.15.99:0/1333808622 >> v1:172.21.15.99:6789/0 conn(0x7f16d4097960 legacy=0x7f16d412f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d2ffd640 1 -- 172.21.15.99:0/1333808622 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4072800 con 0x7f16d4097d70 2023-12-19T09:40:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f897db39640 1 --2- 172.21.15.99:0/3975803304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8978132d70 0x7f8978135190 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e44998efa8f78c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7fa1f559a640 1 -- 172.21.15.99:0/346767434 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1ec009dd0 con 0x7fa1f8097d70 2023-12-19T09:40:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7fa1f559a640 1 -- 172.21.15.99:0/346767434 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa1ec00e230 con 0x7fa1f8097d70 2023-12-19T09:40:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7fa1f559a640 1 -- 172.21.15.99:0/346767434 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1ec00e4d0 con 0x7fa1f8097d70 2023-12-19T09:40:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d2ffd640 1 --2- 172.21.15.99:0/1333808622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097d70 0x7f16d412f950 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921a87e44f3796f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f897d338640 1 -- 172.21.15.99:0/3975803304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f8968009dd0 con 0x7f8978132d70 2023-12-19T09:40:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f897d338640 1 -- 172.21.15.99:0/3975803304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f896800e230 con 0x7f8978132d70 2023-12-19T09:40:56.633 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f897d338640 1 -- 172.21.15.99:0/3975803304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f896800e4d0 con 0x7f8978132d70 2023-12-19T09:40:56.633 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d27fc640 1 -- 172.21.15.99:0/1333808622 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f16c8009ce0 con 0x7f16d4097d70 2023-12-19T09:40:56.633 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f0e4f7fe640 1 --2- 172.21.15.99:0/1394579548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e50132f10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88469ccf06a9982a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.633 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f0e4e7fc640 1 -- 172.21.15.99:0/1394579548 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0e40009ce0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f0e4e7fc640 1 -- 172.21.15.99:0/1394579548 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0e40009e40 con 0x7f0e500a0bb0 2023-12-19T09:40:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f0e4e7fc640 1 -- 172.21.15.99:0/1394579548 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0e4000e360 con 0x7f0e500a0bb0 2023-12-19T09:40:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d27fc640 1 -- 172.21.15.99:0/1333808622 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f16c8009e40 con 0x7f16d4097d70 2023-12-19T09:40:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.620+0000 7f16d27fc640 1 -- 172.21.15.99:0/1333808622 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f16c800e360 con 0x7f16d4097d70 2023-12-19T09:40:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7fa1fcc2d640 1 -- 172.21.15.99:0/346767434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097d70 msgr2=0x7fa1f812f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7fa1fcc2d640 1 --2- 172.21.15.99:0/346767434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097d70 0x7fa1f812f950 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.635 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f898059e640 1 -- 172.21.15.99:0/3975803304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8978132d70 msgr2=0x7f8978135190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.635 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f898059e640 1 --2- 172.21.15.99:0/3975803304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8978132d70 0x7f8978135190 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.635 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7fa1fcc2d640 1 -- 172.21.15.99:0/346767434 shutdown_connections 2023-12-19T09:40:56.635 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f0e55cf0640 1 -- 172.21.15.99:0/1394579548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 msgr2=0x7f0e50132f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.635 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f0e55cf0640 1 --2- 172.21.15.99:0/1394579548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e50132f10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f16da15e640 1 -- 172.21.15.99:0/1333808622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097d70 msgr2=0x7f16d412f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f16da15e640 1 --2- 172.21.15.99:0/1333808622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097d70 0x7f16d412f950 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7fa1fcc2d640 1 --2- 172.21.15.99:0/346767434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097d70 0x7fa1f812f950 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7fa1fcc2d640 1 -- 172.21.15.99:0/346767434 >> 172.21.15.99:0/346767434 conn(0x7fa1f809dff0 msgr2=0x7fa1f809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f898059e640 1 -- 172.21.15.99:0/3975803304 shutdown_connections 2023-12-19T09:40:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f898059e640 1 --2- 172.21.15.99:0/3975803304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8978132d70 0x7f8978135190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f898059e640 1 -- 172.21.15.99:0/3975803304 >> 172.21.15.99:0/3975803304 conn(0x7f897809dff0 msgr2=0x7f897809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7fa1fcc2d640 1 -- 172.21.15.99:0/346767434 shutdown_connections 2023-12-19T09:40:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7fa1fcc2d640 1 -- 172.21.15.99:0/346767434 wait complete. 2023-12-19T09:40:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f0e55cf0640 1 -- 172.21.15.99:0/1394579548 shutdown_connections 2023-12-19T09:40:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f0e55cf0640 1 --2- 172.21.15.99:0/1394579548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e50132f10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f0e55cf0640 1 -- 172.21.15.99:0/1394579548 >> 172.21.15.99:0/1394579548 conn(0x7f0e5006c9a0 msgr2=0x7f0e5006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.637 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f898059e640 1 -- 172.21.15.99:0/3975803304 shutdown_connections 2023-12-19T09:40:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f898059e640 1 -- 172.21.15.99:0/3975803304 wait complete. 2023-12-19T09:40:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7f0e55cf0640 1 -- 172.21.15.99:0/1394579548 shutdown_connections 2023-12-19T09:40:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f16da15e640 1 -- 172.21.15.99:0/1333808622 shutdown_connections 2023-12-19T09:40:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f16da15e640 1 --2- 172.21.15.99:0/1333808622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097d70 0x7f16d412f950 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.621+0000 7f16da15e640 1 -- 172.21.15.99:0/1333808622 >> 172.21.15.99:0/1333808622 conn(0x7f16d409dff0 msgr2=0x7f16d409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.638 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7f0e55cf0640 1 -- 172.21.15.99:0/1394579548 wait complete. 2023-12-19T09:40:56.639 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7f16da15e640 1 -- 172.21.15.99:0/1333808622 shutdown_connections 2023-12-19T09:40:56.639 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7f16da15e640 1 -- 172.21.15.99:0/1333808622 wait complete. 2023-12-19T09:40:56.639 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7fa1fcc2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.639 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7f0e55cf0640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.640 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7f16da15e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.640 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.622+0000 7f898059e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:56.640 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7f0e55cf0640 1 Processor -- start 2023-12-19T09:40:56.640 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7f0e55cf0640 1 -- start start 2023-12-19T09:40:56.641 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7fa1fcc2d640 1 Processor -- start 2023-12-19T09:40:56.641 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7fa1fcc2d640 1 -- start start 2023-12-19T09:40:56.641 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7f898059e640 1 Processor -- start 2023-12-19T09:40:56.641 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7f898059e640 1 -- start start 2023-12-19T09:40:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7f16da15e640 1 Processor -- start 2023-12-19T09:40:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7f16da15e640 1 -- start start 2023-12-19T09:40:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.623+0000 7f0e55cf0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e5011e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e55cf0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50120500 con 0x7f0e500a0bb0 2023-12-19T09:40:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e4f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e5011e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7fa1fcc2d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097960 0x7fa1f808e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e4f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e5011e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37058/0 (socket says 172.21.15.99:37058) 2023-12-19T09:40:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e4f7fe640 1 -- 172.21.15.99:0/2966717022 learned_addr learned my addr 172.21.15.99:0/2966717022 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7fa1fcc2d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8090580 con 0x7fa1f8097960 2023-12-19T09:40:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7fa1f659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097960 0x7fa1f808e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7fa1f659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097960 0x7fa1f808e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37074/0 (socket says 172.21.15.99:37074) 2023-12-19T09:40:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7fa1f659c640 1 -- 172.21.15.99:0/296914744 learned_addr learned my addr 172.21.15.99:0/296914744 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e4f7fe640 1 -- 172.21.15.99:0/2966717022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50121de0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7fa1f659c640 1 -- 172.21.15.99:0/296914744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f81261e0 con 0x7fa1f8097960 2023-12-19T09:40:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e4f7fe640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e5011e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f898059e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f897812ff00 0x7f89781c1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7fa1f659c640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097960 0x7fa1f808e3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e37fff640 1 -- 172.21.15.99:0/2966717022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0e40014830 con 0x7f0e500a0bb0 2023-12-19T09:40:56.646 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f898059e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8978129570 con 0x7f897812ff00 2023-12-19T09:40:56.646 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f897e33a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f897812ff00 0x7f89781c1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.646 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e37fff640 1 -- 172.21.15.99:0/2966717022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f0e40014990 con 0x7f0e500a0bb0 2023-12-19T09:40:56.646 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7fa1e6ffd640 1 -- 172.21.15.99:0/296914744 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1e800c7e0 con 0x7fa1f8097960 2023-12-19T09:40:56.647 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e501228f0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.647 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f0e37fff640 1 -- 172.21.15.99:0/2966717022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f0e40014c30 con 0x7f0e500a0bb0 2023-12-19T09:40:56.647 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f16da15e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097960 0x7f16d40945a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.647 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.624+0000 7f897e33a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f897812ff00 0x7f89781c1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37080/0 (socket says 172.21.15.99:37080) 2023-12-19T09:40:56.647 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f897e33a640 1 -- 172.21.15.99:0/3035065454 learned_addr learned my addr 172.21.15.99:0/3035065454 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.648 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7fa1fcc2d640 1 -- 172.21.15.99:0/296914744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f80901e0 con 0x7fa1f8097960 2023-12-19T09:40:56.648 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e50120d50 con 0x7f0e500a0bb0 2023-12-19T09:40:56.648 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f16da15e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d4137240 con 0x7f16d4097960 2023-12-19T09:40:56.648 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f16d37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097960 0x7f16d40945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.648 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7fa1fcc2d640 1 -- 172.21.15.99:0/296914744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f8071be0 con 0x7fa1f8097960 2023-12-19T09:40:56.649 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f16d37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097960 0x7f16d40945a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37086/0 (socket says 172.21.15.99:37086) 2023-12-19T09:40:56.649 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f16d37fe640 1 -- 172.21.15.99:0/2660181315 learned_addr learned my addr 172.21.15.99:0/2660181315 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:56.649 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f897e33a640 1 -- 172.21.15.99:0/3035065454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978129850 con 0x7f897812ff00 2023-12-19T09:40:56.649 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f16d37fe640 1 -- 172.21.15.99:0/2660181315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4136180 con 0x7f16d4097960 2023-12-19T09:40:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7fa1e6ffd640 1 -- 172.21.15.99:0/296914744 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa1e800c940 con 0x7fa1f8097960 2023-12-19T09:40:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7fa1e6ffd640 1 -- 172.21.15.99:0/296914744 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa1e800cbe0 con 0x7fa1f8097960 2023-12-19T09:40:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f16d37fe640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097960 0x7f16d40945a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.625+0000 7f897e33a640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f897812ff00 0x7f89781c1be0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f0e37fff640 1 -- 172.21.15.99:0/2966717022 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f0e400113a0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e50062350 con 0x7f0e500a0bb0 2023-12-19T09:40:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f16bbfff640 1 -- 172.21.15.99:0/2660181315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f16c40059d0 con 0x7f16d4097960 2023-12-19T09:40:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d4136f30 con 0x7f16d4097960 2023-12-19T09:40:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7fa1e6ffd640 1 -- 172.21.15.99:0/296914744 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fa1e8011310 con 0x7fa1f8097960 2023-12-19T09:40:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f896effd640 1 -- 172.21.15.99:0/3035065454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f89740071e0 con 0x7f897812ff00 2023-12-19T09:40:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f896effd640 1 -- 172.21.15.99:0/3035065454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f8974007340 con 0x7f897812ff00 2023-12-19T09:40:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897806f330 con 0x7f897812ff00 2023-12-19T09:40:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f0e37fff640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0e3c037810 0x7f0e3c039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f0e37fff640 1 -- 172.21.15.99:0/2966717022 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f0e400482d0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7fa1e6ffd640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa1d8037810 0x7fa1d8039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7fa1e6ffd640 1 -- 172.21.15.99:0/296914744 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fa1e8047400 con 0x7fa1f8097960 2023-12-19T09:40:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d0005010 con 0x7fa1f8097960 2023-12-19T09:40:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f0e4effd640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0e3c037810 0x7f0e3c039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f16bbfff640 1 -- 172.21.15.99:0/2660181315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f16c4005b30 con 0x7f16d4097960 2023-12-19T09:40:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.627+0000 7fa1f5d9b640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa1d8037810 0x7fa1d8039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.627+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d41357d0 con 0x7f16d4097960 2023-12-19T09:40:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.627+0000 7f16bbfff640 1 -- 172.21.15.99:0/2660181315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f16c4005dd0 con 0x7f16d4097960 2023-12-19T09:40:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.626+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897806e930 con 0x7f897812ff00 2023-12-19T09:40:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.627+0000 7f896effd640 1 -- 172.21.15.99:0/3035065454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f89740071e0 con 0x7f897812ff00 2023-12-19T09:40:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.627+0000 7f0e4effd640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0e3c037810 0x7f0e3c039d20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.627+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8978062350 con 0x7f897812ff00 2023-12-19T09:40:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.627+0000 7fa1f5d9b640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa1d8037810 0x7fa1d8039d20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.628+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b4005010 con 0x7f16d4097960 2023-12-19T09:40:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.631+0000 7f0e37fff640 1 -- 172.21.15.99:0/2966717022 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f0e4000ddc0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.636+0000 7fa1e6ffd640 1 -- 172.21.15.99:0/296914744 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fa1e800ad00 con 0x7fa1f8097960 2023-12-19T09:40:56.657 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.637+0000 7f896effd640 1 -- 172.21.15.99:0/3035065454 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f897400c6e0 con 0x7f897812ff00 2023-12-19T09:40:56.657 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.637+0000 7f896effd640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f895c037800 0x7f895c039d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.657 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.637+0000 7f896effd640 1 -- 172.21.15.99:0/3035065454 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f8974046a80 con 0x7f897812ff00 2023-12-19T09:40:56.657 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.637+0000 7f16bbfff640 1 -- 172.21.15.99:0/2660181315 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f16c40070b0 con 0x7f16d4097960 2023-12-19T09:40:56.657 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.637+0000 7f897db39640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f895c037800 0x7f895c039d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.658 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.637+0000 7f16bbfff640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f16c00377c0 0x7f16c0039cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:56.658 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.638+0000 7f16bbfff640 1 -- 172.21.15.99:0/2660181315 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f16c4047060 con 0x7f16d4097960 2023-12-19T09:40:56.658 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.638+0000 7f16d2ffd640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f16c00377c0 0x7f16c0039cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:56.658 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.638+0000 7f897db39640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f895c037800 0x7f895c039d10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.658 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.638+0000 7f16d2ffd640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f16c00377c0 0x7f16c0039cd0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:56.659 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.642+0000 7f896effd640 1 -- 172.21.15.99:0/3035065454 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f897400a910 con 0x7f897812ff00 2023-12-19T09:40:56.659 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.646+0000 7f16bbfff640 1 -- 172.21.15.99:0/2660181315 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f16c400a950 con 0x7f16d4097960 2023-12-19T09:40:56.823 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.823+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0e50066f90 con 0x7f0e500a0bb0 2023-12-19T09:40:56.824 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.823+0000 7f0e37fff640 1 -- 172.21.15.99:0/2966717022 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f0e4001a1a0 con 0x7f0e500a0bb0 2023-12-19T09:40:56.824 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0e3c037810 msgr2=0x7f0e3c039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0e3c037810 0x7f0e3c039d20 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 msgr2=0x7f0e5011e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e5011e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 shutdown_connections 2023-12-19T09:40:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f0e3c037810 0x7f0e3c039d20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 --2- 172.21.15.99:0/2966717022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e500a0bb0 0x7f0e5011e8c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.825+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 >> 172.21.15.99:0/2966717022 conn(0x7f0e5006c9a0 msgr2=0x7f0e50132f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.826+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 shutdown_connections 2023-12-19T09:40:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.826+0000 7f0e55cf0640 1 -- 172.21.15.99:0/2966717022 wait complete. 2023-12-19T09:40:56.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2023-12-19T09:40:56.837 DEBUG:teuthology.parallel:result is None 2023-12-19T09:40:56.840 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.840+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16b4005590 con 0x7f16d4097960 2023-12-19T09:40:56.840 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.840+0000 7f16bbfff640 1 -- 172.21.15.99:0/2660181315 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f16c400a120 con 0x7f16d4097960 2023-12-19T09:40:56.841 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.842 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.841+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa1d00052c0 con 0x7fa1f8097960 2023-12-19T09:40:56.842 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7fa1e6ffd640 1 -- 172.21.15.99:0/296914744 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7fa1e800a910 con 0x7fa1f8097960 2023-12-19T09:40:56.842 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f16c00377c0 msgr2=0x7f16c0039cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.843 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f16c00377c0 0x7f16c0039cd0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.843 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097960 msgr2=0x7f16d40945a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.843 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.843 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097960 0x7f16d40945a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.844 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 shutdown_connections 2023-12-19T09:40:56.844 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f16c00377c0 0x7f16c0039cd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.844 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 --2- 172.21.15.99:0/2660181315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d4097960 0x7f16d40945a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.844 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 >> 172.21.15.99:0/2660181315 conn(0x7f16d409dff0 msgr2=0x7f16d409b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.844 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 shutdown_connections 2023-12-19T09:40:56.844 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.842+0000 7f16da15e640 1 -- 172.21.15.99:0/2660181315 wait complete. 2023-12-19T09:40:56.845 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa1d8037810 msgr2=0x7fa1d8039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa1d8037810 0x7fa1d8039d20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097960 msgr2=0x7fa1f808e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097960 0x7fa1f808e3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 shutdown_connections 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa1d8037810 0x7fa1d8039d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 --2- 172.21.15.99:0/296914744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1f8097960 0x7fa1f808e3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 >> 172.21.15.99:0/296914744 conn(0x7fa1f809dff0 msgr2=0x7fa1f8095670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 shutdown_connections 2023-12-19T09:40:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.845+0000 7fa1e4ff9640 1 -- 172.21.15.99:0/296914744 wait complete. 2023-12-19T09:40:56.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2023-12-19T09:40:56.854 DEBUG:teuthology.parallel:result is None 2023-12-19T09:40:56.854 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.854+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f897806e930 con 0x7f897812ff00 2023-12-19T09:40:56.855 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.854+0000 7f896effd640 1 -- 172.21.15.99:0/3035065454 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (crc 0 0 0) 0x7f897806e930 con 0x7f897812ff00 2023-12-19T09:40:56.855 INFO:teuthology.orchestra.run.smithi099.stdout:38654705670 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f895c037800 msgr2=0x7f895c039d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f895c037800 0x7f895c039d10 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f897812ff00 msgr2=0x7f89781c1be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f897812ff00 0x7f89781c1be0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 shutdown_connections 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f895c037800 0x7f895c039d10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 --2- 172.21.15.99:0/3035065454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f897812ff00 0x7f89781c1be0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 >> 172.21.15.99:0/3035065454 conn(0x7f897809dff0 msgr2=0x7f8978130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 shutdown_connections 2023-12-19T09:40:56.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:56.857+0000 7f898059e640 1 -- 172.21.15.99:0/3035065454 wait complete. 2023-12-19T09:40:56.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2023-12-19T09:40:56.860 DEBUG:teuthology.parallel:result is None 2023-12-19T09:40:56.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2023-12-19T09:40:56.868 DEBUG:teuthology.parallel:result is None 2023-12-19T09:40:56.868 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T09:40:56.869 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T09:40:57.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.012+0000 7f319c22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:57.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.016+0000 7f319c22d640 1 Processor -- start 2023-12-19T09:40:57.016 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.016+0000 7f319c22d640 1 -- start start 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.016+0000 7f319c22d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3194070570 0x7f3194136120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.016+0000 7f319c22d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3194071b40 con 0x7f319406fa50 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f319c22d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3194070d50 con 0x7f3194070570 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f31997c8640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3194070570 0x7f3194136120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f3199fc9640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f319406fa50 0x7f319406fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59186/0 (socket says 172.21.15.99:59186) 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f31997c8640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3194070570 0x7f3194136120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37088/0 (socket says 172.21.15.99:37088) 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f3199fc9640 1 -- 172.21.15.99:0/3201820361 learned_addr learned my addr 172.21.15.99:0/3201820361 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f31997c8640 1 -- 172.21.15.99:0/3201820361 >> v1:172.21.15.99:6789/0 conn(0x7f319406fa50 legacy=0x7f319406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f31997c8640 1 -- 172.21.15.99:0/3201820361 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194071830 con 0x7f3194070570 2023-12-19T09:40:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f31997c8640 1 --2- 172.21.15.99:0/3201820361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3194070570 0x7f3194136120 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1d8d1d35c2a98f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.019 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f3198fc7640 1 -- 172.21.15.99:0/3201820361 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3184009ce0 con 0x7f3194070570 2023-12-19T09:40:57.019 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f3198fc7640 1 -- 172.21.15.99:0/3201820361 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3184009e40 con 0x7f3194070570 2023-12-19T09:40:57.019 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.017+0000 7f3198fc7640 1 -- 172.21.15.99:0/3201820361 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f318400e360 con 0x7f3194070570 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 1 -- 172.21.15.99:0/3201820361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3194070570 msgr2=0x7f3194136120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 1 --2- 172.21.15.99:0/3201820361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3194070570 0x7f3194136120 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 1 -- 172.21.15.99:0/3201820361 shutdown_connections 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 1 --2- 172.21.15.99:0/3201820361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3194070570 0x7f3194136120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 1 -- 172.21.15.99:0/3201820361 >> 172.21.15.99:0/3201820361 conn(0x7f319409dff0 msgr2=0x7f319409e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 1 -- 172.21.15.99:0/3201820361 shutdown_connections 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 1 -- 172.21.15.99:0/3201820361 wait complete. 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.018+0000 7f319c22d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.019+0000 7f319c22d640 1 Processor -- start 2023-12-19T09:40:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.019+0000 7f319c22d640 1 -- start start 2023-12-19T09:40:57.022 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f319c22d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f319406fa50 0x7f31940961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.022 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f319c22d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3194094860 con 0x7f319406fa50 2023-12-19T09:40:57.022 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f3199fc9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f319406fa50 0x7f31940961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.022 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f3199fc9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f319406fa50 0x7f31940961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37092/0 (socket says 172.21.15.99:37092) 2023-12-19T09:40:57.022 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f3199fc9640 1 -- 172.21.15.99:0/3138764921 learned_addr learned my addr 172.21.15.99:0/3138764921 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:57.022 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f3199fc9640 1 -- 172.21.15.99:0/3138764921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194097de0 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f3199fc9640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f319406fa50 0x7f31940961b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f318a7fc640 1 -- 172.21.15.99:0/3138764921 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f31900059d0 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f318a7fc640 1 -- 172.21.15.99:0/3138764921 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f3190005b30 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3194094290 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f318a7fc640 1 -- 172.21.15.99:0/3138764921 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f3190005dd0 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.020+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3194095ea0 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.021+0000 7f318a7fc640 1 -- 172.21.15.99:0/3138764921 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f31900070b0 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.021+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3194093940 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.021+0000 7f318a7fc640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3178037840 0x7f3178039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.021+0000 7f318a7fc640 1 -- 172.21.15.99:0/3138764921 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f3190046b90 con 0x7f319406fa50 2023-12-19T09:40:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.022+0000 7f31997c8640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3178037840 0x7f3178039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.024 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.022+0000 7f31997c8640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3178037840 0x7f3178039d50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.027 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.026+0000 7f318a7fc640 1 -- 172.21.15.99:0/3138764921 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f319000d330 con 0x7f319406fa50 2023-12-19T09:40:57.190 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.190+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31940a0950 con 0x7f3178037840 2023-12-19T09:40:57.192 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.192+0000 7f318a7fc640 1 -- 172.21.15.99:0/3138764921 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30046 (crc 0 0 0) 0x7f31840124e0 con 0x7f3178037840 2023-12-19T09:40:57.192 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:57.193 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2023-12-19T09:40:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3178037840 msgr2=0x7f3178039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3178037840 0x7f3178039d50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f319406fa50 msgr2=0x7f31940961b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f319406fa50 0x7f31940961b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 shutdown_connections 2023-12-19T09:40:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3178037840 0x7f3178039d50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 --2- 172.21.15.99:0/3138764921 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f319406fa50 0x7f31940961b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 >> 172.21.15.99:0/3138764921 conn(0x7f319409dff0 msgr2=0x7f3194135460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 shutdown_connections 2023-12-19T09:40:57.195 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.193+0000 7f319c22d640 1 -- 172.21.15.99:0/3138764921 wait complete. 2023-12-19T09:40:57.204 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-12-19T09:40:56.418603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109568,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320832,"statfs":{"total":429496729600,"available":429384531968,"internally_reserved":0,"allocated":1417216,"data_stored":1259008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.377535+0000","last_change":"2023-12-19T09:40:55.377872+0000","last_active":"2023-12-19T09:40:55.377535+0000","last_peered":"2023-12-19T09:40:55.377535+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.374430+0000","last_became_peered":"2023-12-19T09:40:55.374430+0000","last_unstale":"2023-12-19T09:40:55.377535+0000","last_undegraded":"2023-12-19T09:40:55.377535+0000","last_fullsized":"2023-12-19T09:40:55.377535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.373335+0000","last_change":"2023-12-19T09:40:55.373709+0000","last_active":"2023-12-19T09:40:55.373335+0000","last_peered":"2023-12-19T09:40:55.373335+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.370833+0000","last_became_peered":"2023-12-19T09:40:55.370833+0000","last_unstale":"2023-12-19T09:40:55.373335+0000","last_undegraded":"2023-12-19T09:40:55.373335+0000","last_fullsized":"2023-12-19T09:40:55.373335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-19T09:40:56.330006+0000","last_change":"2023-12-19T09:40:55.385057+0000","last_active":"2023-12-19T09:40:56.330006+0000","last_peered":"2023-12-19T09:40:56.330006+0000","last_clean":"2023-12-19T09:40:56.330006+0000","last_became_active":"2023-12-19T09:40:55.376880+0000","last_became_peered":"2023-12-19T09:40:55.376880+0000","last_unstale":"2023-12-19T09:40:56.330006+0000","last_undegraded":"2023-12-19T09:40:56.330006+0000","last_fullsized":"2023-12-19T09:40:56.330006+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.370198+0000","last_change":"2023-12-19T09:40:55.375889+0000","last_active":"2023-12-19T09:40:55.370198+0000","last_peered":"2023-12-19T09:40:55.370198+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.367503+0000","last_became_peered":"2023-12-19T09:40:55.367503+0000","last_unstale":"2023-12-19T09:40:55.370198+0000","last_undegraded":"2023-12-19T09:40:55.370198+0000","last_fullsized":"2023-12-19T09:40:55.370198+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.368838+0000","last_change":"2023-12-19T09:40:55.369239+0000","last_active":"2023-12-19T09:40:55.368838+0000","last_peered":"2023-12-19T09:40:55.368838+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.366264+0000","last_became_peered":"2023-12-19T09:40:55.366264+0000","last_unstale":"2023-12-19T09:40:55.368838+0000","last_undegraded":"2023-12-19T09:40:55.368838+0000","last_fullsized":"2023-12-19T09:40:55.368838+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.389956+0000","last_change":"2023-12-19T09:40:55.390358+0000","last_active":"2023-12-19T09:40:55.389956+0000","last_peered":"2023-12-19T09:40:55.389956+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.387550+0000","last_became_peered":"2023-12-19T09:40:55.387550+0000","last_unstale":"2023-12-19T09:40:55.389956+0000","last_undegraded":"2023-12-19T09:40:55.389956+0000","last_fullsized":"2023-12-19T09:40:55.389956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.369766+0000","last_change":"2023-12-19T09:40:55.370124+0000","last_active":"2023-12-19T09:40:55.369766+0000","last_peered":"2023-12-19T09:40:55.369766+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.366632+0000","last_became_peered":"2023-12-19T09:40:55.366632+0000","last_unstale":"2023-12-19T09:40:55.369766+0000","last_undegraded":"2023-12-19T09:40:55.369766+0000","last_fullsized":"2023-12-19T09:40:55.369766+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.377439+0000","last_change":"2023-12-19T09:40:55.377818+0000","last_active":"2023-12-19T09:40:55.377439+0000","last_peered":"2023-12-19T09:40:55.377439+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.374987+0000","last_became_peered":"2023-12-19T09:40:55.374987+0000","last_unstale":"2023-12-19T09:40:55.377439+0000","last_undegraded":"2023-12-19T09:40:55.377439+0000","last_fullsized":"2023-12-19T09:40:55.377439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-19T09:40:56.329255+0000","last_change":"2023-12-19T09:40:53.332271+0000","last_active":"2023-12-19T09:40:56.329255+0000","last_peered":"2023-12-19T09:40:56.329255+0000","last_clean":"2023-12-19T09:40:56.329255+0000","last_became_active":"2023-12-19T09:40:53.328758+0000","last_became_peered":"2023-12-19T09:40:53.328758+0000","last_unstale":"2023-12-19T09:40:56.329255+0000","last_undegraded":"2023-12-19T09:40:56.329255+0000","last_fullsized":"2023-12-19T09:40:56.329255+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_clean_scrub_stamp":"2023-12-19T09:40:52.293719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-19T09:40:57.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T09:40:57.310 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.306+0000 7fb0ba6de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:57.311 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.310+0000 7fb0ba6de640 1 Processor -- start 2023-12-19T09:40:57.311 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.310+0000 7fb0ba6de640 1 -- start start 2023-12-19T09:40:57.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.311+0000 7fb0ba6de640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb0b4136250 0x7fb0b4138670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.311+0000 7fb0ba6de640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b4132fe0 con 0x7fb0b4133480 2023-12-19T09:40:57.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.311+0000 7fb0ba6de640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b409a9f0 con 0x7fb0b4136250 2023-12-19T09:40:57.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.311+0000 7fb0b37fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb0b4136250 0x7fb0b4138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.311+0000 7fb0b3fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb0b4133480 0x7fb0b4133890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59190/0 (socket says 172.21.15.99:59190) 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.311+0000 7fb0b37fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb0b4136250 0x7fb0b4138670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37108/0 (socket says 172.21.15.99:37108) 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.311+0000 7fb0b3fff640 1 -- 172.21.15.99:0/254637781 learned_addr learned my addr 172.21.15.99:0/254637781 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0b37fe640 1 -- 172.21.15.99:0/254637781 >> v1:172.21.15.99:6789/0 conn(0x7fb0b4133480 legacy=0x7fb0b4133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0b37fe640 1 -- 172.21.15.99:0/254637781 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b4099dc0 con 0x7fb0b4136250 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0b37fe640 1 --2- 172.21.15.99:0/254637781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4136250 0x7fb0b4138670 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d959d3f84b72dec5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0b2ffd640 1 -- 172.21.15.99:0/254637781 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb0a8009ce0 con 0x7fb0b4136250 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0b2ffd640 1 -- 172.21.15.99:0/254637781 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb0a8009e40 con 0x7fb0b4136250 2023-12-19T09:40:57.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0b2ffd640 1 -- 172.21.15.99:0/254637781 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb0a800e360 con 0x7fb0b4136250 2023-12-19T09:40:57.314 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0ba6de640 1 -- 172.21.15.99:0/254637781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4136250 msgr2=0x7fb0b4138670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.316 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.312+0000 7fb0ba6de640 1 --2- 172.21.15.99:0/254637781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4136250 0x7fb0b4138670 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.317 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.313+0000 7fb0ba6de640 1 -- 172.21.15.99:0/254637781 shutdown_connections 2023-12-19T09:40:57.317 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.313+0000 7fb0ba6de640 1 --2- 172.21.15.99:0/254637781 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4136250 0x7fb0b4138670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.317 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.313+0000 7fb0ba6de640 1 -- 172.21.15.99:0/254637781 >> 172.21.15.99:0/254637781 conn(0x7fb0b409eb00 msgr2=0x7fb0b409ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:57.317 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.313+0000 7fb0ba6de640 1 -- 172.21.15.99:0/254637781 shutdown_connections 2023-12-19T09:40:57.317 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.313+0000 7fb0ba6de640 1 -- 172.21.15.99:0/254637781 wait complete. 2023-12-19T09:40:57.317 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.313+0000 7fb0ba6de640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:57.317 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.314+0000 7fb0ba6de640 1 Processor -- start 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.314+0000 7fb0ba6de640 1 -- start start 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.314+0000 7fb0ba6de640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4133480 0x7fb0b41c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.314+0000 7fb0ba6de640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b41c4b20 con 0x7fb0b4133480 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4133480 0x7fb0b41c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4133480 0x7fb0b41c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37124/0 (socket says 172.21.15.99:37124) 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b3fff640 1 -- 172.21.15.99:0/2242665850 learned_addr learned my addr 172.21.15.99:0/2242665850 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b3fff640 1 -- 172.21.15.99:0/2242665850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b411dc40 con 0x7fb0b4133480 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b3fff640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4133480 0x7fb0b41c50f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.319 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b0ff9640 1 -- 172.21.15.99:0/2242665850 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb0a40058a0 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b0ff9640 1 -- 172.21.15.99:0/2242665850 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fb0a4005a00 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b41c4d50 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0b0ff9640 1 -- 172.21.15.99:0/2242665850 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fb0a4005ca0 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.315+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b411dec0 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.316+0000 7fb0b0ff9640 1 -- 172.21.15.99:0/2242665850 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fb0a40070b0 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.316+0000 7fb0b0ff9640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fb0a0037810 0x7fb0a0039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.316+0000 7fb0b0ff9640 1 -- 172.21.15.99:0/2242665850 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fb0a4046c10 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.316+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b411cff0 con 0x7fb0b4133480 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.316+0000 7fb0b37fe640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fb0a0037810 0x7fb0a0039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.320 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.317+0000 7fb0b37fe640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fb0a0037810 0x7fb0a0039d20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.321 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.321+0000 7fb0b0ff9640 1 -- 172.21.15.99:0/2242665850 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fb0a400f230 con 0x7fb0b4133480 2023-12-19T09:40:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.483+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0b411f5f0 con 0x7fb0a0037810 2023-12-19T09:40:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.485+0000 7fb0b0ff9640 1 -- 172.21.15.99:0/2242665850 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+30046 (crc 0 0 0) 0x7fb0b411f5f0 con 0x7fb0a0037810 2023-12-19T09:40:57.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2023-12-19T09:40:57.487 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.486+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fb0a0037810 msgr2=0x7fb0a0039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.487 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.486+0000 7fb0ba6de640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fb0a0037810 0x7fb0a0039d20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.486+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4133480 msgr2=0x7fb0b41c50f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.486+0000 7fb0ba6de640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4133480 0x7fb0b41c50f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.487+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 shutdown_connections 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.487+0000 7fb0ba6de640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fb0a0037810 0x7fb0a0039d20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.487+0000 7fb0ba6de640 1 --2- 172.21.15.99:0/2242665850 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0b4133480 0x7fb0b41c50f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.487+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 >> 172.21.15.99:0/2242665850 conn(0x7fb0b409eb00 msgr2=0x7fb0b4130db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.487+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 shutdown_connections 2023-12-19T09:40:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.487+0000 7fb0ba6de640 1 -- 172.21.15.99:0/2242665850 wait complete. 2023-12-19T09:40:57.497 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-12-19T09:40:56.418603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109568,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320832,"statfs":{"total":429496729600,"available":429384531968,"internally_reserved":0,"allocated":1417216,"data_stored":1259008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.377535+0000","last_change":"2023-12-19T09:40:55.377872+0000","last_active":"2023-12-19T09:40:55.377535+0000","last_peered":"2023-12-19T09:40:55.377535+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.374430+0000","last_became_peered":"2023-12-19T09:40:55.374430+0000","last_unstale":"2023-12-19T09:40:55.377535+0000","last_undegraded":"2023-12-19T09:40:55.377535+0000","last_fullsized":"2023-12-19T09:40:55.377535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.373335+0000","last_change":"2023-12-19T09:40:55.373709+0000","last_active":"2023-12-19T09:40:55.373335+0000","last_peered":"2023-12-19T09:40:55.373335+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.370833+0000","last_became_peered":"2023-12-19T09:40:55.370833+0000","last_unstale":"2023-12-19T09:40:55.373335+0000","last_undegraded":"2023-12-19T09:40:55.373335+0000","last_fullsized":"2023-12-19T09:40:55.373335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-19T09:40:56.330006+0000","last_change":"2023-12-19T09:40:55.385057+0000","last_active":"2023-12-19T09:40:56.330006+0000","last_peered":"2023-12-19T09:40:56.330006+0000","last_clean":"2023-12-19T09:40:56.330006+0000","last_became_active":"2023-12-19T09:40:55.376880+0000","last_became_peered":"2023-12-19T09:40:55.376880+0000","last_unstale":"2023-12-19T09:40:56.330006+0000","last_undegraded":"2023-12-19T09:40:56.330006+0000","last_fullsized":"2023-12-19T09:40:56.330006+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.370198+0000","last_change":"2023-12-19T09:40:55.375889+0000","last_active":"2023-12-19T09:40:55.370198+0000","last_peered":"2023-12-19T09:40:55.370198+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.367503+0000","last_became_peered":"2023-12-19T09:40:55.367503+0000","last_unstale":"2023-12-19T09:40:55.370198+0000","last_undegraded":"2023-12-19T09:40:55.370198+0000","last_fullsized":"2023-12-19T09:40:55.370198+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.368838+0000","last_change":"2023-12-19T09:40:55.369239+0000","last_active":"2023-12-19T09:40:55.368838+0000","last_peered":"2023-12-19T09:40:55.368838+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.366264+0000","last_became_peered":"2023-12-19T09:40:55.366264+0000","last_unstale":"2023-12-19T09:40:55.368838+0000","last_undegraded":"2023-12-19T09:40:55.368838+0000","last_fullsized":"2023-12-19T09:40:55.368838+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.389956+0000","last_change":"2023-12-19T09:40:55.390358+0000","last_active":"2023-12-19T09:40:55.389956+0000","last_peered":"2023-12-19T09:40:55.389956+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.387550+0000","last_became_peered":"2023-12-19T09:40:55.387550+0000","last_unstale":"2023-12-19T09:40:55.389956+0000","last_undegraded":"2023-12-19T09:40:55.389956+0000","last_fullsized":"2023-12-19T09:40:55.389956+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.369766+0000","last_change":"2023-12-19T09:40:55.370124+0000","last_active":"2023-12-19T09:40:55.369766+0000","last_peered":"2023-12-19T09:40:55.369766+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.366632+0000","last_became_peered":"2023-12-19T09:40:55.366632+0000","last_unstale":"2023-12-19T09:40:55.369766+0000","last_undegraded":"2023-12-19T09:40:55.369766+0000","last_fullsized":"2023-12-19T09:40:55.369766+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-12-19T09:40:55.377439+0000","last_change":"2023-12-19T09:40:55.377818+0000","last_active":"2023-12-19T09:40:55.377439+0000","last_peered":"2023-12-19T09:40:55.377439+0000","last_clean":"2023-12-19T09:40:54.304643+0000","last_became_active":"2023-12-19T09:40:55.374987+0000","last_became_peered":"2023-12-19T09:40:55.374987+0000","last_unstale":"2023-12-19T09:40:55.377439+0000","last_undegraded":"2023-12-19T09:40:55.377439+0000","last_fullsized":"2023-12-19T09:40:55.377439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-19T09:40:56.329255+0000","last_change":"2023-12-19T09:40:53.332271+0000","last_active":"2023-12-19T09:40:56.329255+0000","last_peered":"2023-12-19T09:40:56.329255+0000","last_clean":"2023-12-19T09:40:56.329255+0000","last_became_active":"2023-12-19T09:40:53.328758+0000","last_became_peered":"2023-12-19T09:40:53.328758+0000","last_unstale":"2023-12-19T09:40:56.329255+0000","last_undegraded":"2023-12-19T09:40:56.329255+0000","last_fullsized":"2023-12-19T09:40:56.329255+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_clean_scrub_stamp":"2023-12-19T09:40:52.293719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27008,"kb_used_data":56,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830592,"statfs":{"total":107374182400,"available":107346526208,"internally_reserved":0,"allocated":57344,"data_stored":19568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27776,"kb_used_data":636,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829824,"statfs":{"total":107374182400,"available":107345739776,"internally_reserved":0,"allocated":651264,"data_stored":609936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-19T09:40:57.498 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T09:40:57.498 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T09:40:57.499 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T09:40:57.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T09:40:57.604 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.601+0000 7fc442e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:57.604 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.604+0000 7fc442e06640 1 Processor -- start 2023-12-19T09:40:57.605 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.604+0000 7fc442e06640 1 -- start start 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc442e06640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc43c06fa50 0x7fc43c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc442e06640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c071b40 con 0x7fc43c0703a0 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc442e06640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c070d50 con 0x7fc43c06fa50 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc440ba2640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc43c06fa50 0x7fc43c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc43bfff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc43c0703a0 0x7fc43c135110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59192/0 (socket says 172.21.15.99:59192) 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc43bfff640 1 -- 172.21.15.99:0/877443182 learned_addr learned my addr 172.21.15.99:0/877443182 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc440ba2640 1 -- 172.21.15.99:0/877443182 >> v1:172.21.15.99:6789/0 conn(0x7fc43c0703a0 legacy=0x7fc43c135110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc440ba2640 1 -- 172.21.15.99:0/877443182 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c071830 con 0x7fc43c06fa50 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc440ba2640 1 --2- 172.21.15.99:0/877443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c06fe60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c590ac66a40da445 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.606 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc43b7fe640 1 -- 172.21.15.99:0/877443182 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc430009ce0 con 0x7fc43c06fa50 2023-12-19T09:40:57.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc43b7fe640 1 -- 172.21.15.99:0/877443182 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc430009e40 con 0x7fc43c06fa50 2023-12-19T09:40:57.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.605+0000 7fc43b7fe640 1 -- 172.21.15.99:0/877443182 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc43000e360 con 0x7fc43c06fa50 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 1 -- 172.21.15.99:0/877443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 msgr2=0x7fc43c06fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 1 --2- 172.21.15.99:0/877443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c06fe60 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 1 -- 172.21.15.99:0/877443182 shutdown_connections 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 1 --2- 172.21.15.99:0/877443182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c06fe60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 1 -- 172.21.15.99:0/877443182 >> 172.21.15.99:0/877443182 conn(0x7fc43c09dff0 msgr2=0x7fc43c09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 1 -- 172.21.15.99:0/877443182 shutdown_connections 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 1 -- 172.21.15.99:0/877443182 wait complete. 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.606+0000 7fc442e06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.607+0000 7fc442e06640 1 Processor -- start 2023-12-19T09:40:57.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.607+0000 7fc442e06640 1 -- start start 2023-12-19T09:40:57.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc442e06640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c12d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc442e06640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c130840 con 0x7fc43c06fa50 2023-12-19T09:40:57.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc440ba2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c12d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc440ba2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c12d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37146/0 (socket says 172.21.15.99:37146) 2023-12-19T09:40:57.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc440ba2640 1 -- 172.21.15.99:0/1999922834 learned_addr learned my addr 172.21.15.99:0/1999922834 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:40:57.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc440ba2640 1 -- 172.21.15.99:0/1999922834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c1339b0 con 0x7fc43c06fa50 2023-12-19T09:40:57.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc440ba2640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c12d3c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc4397fa640 1 -- 172.21.15.99:0/1999922834 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc430014620 con 0x7fc43c06fa50 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.608+0000 7fc4397fa640 1 -- 172.21.15.99:0/1999922834 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fc430014780 con 0x7fc43c06fa50 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.609+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c1304e0 con 0x7fc43c06fa50 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.609+0000 7fc4397fa640 1 -- 172.21.15.99:0/1999922834 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fc430014a20 con 0x7fc43c06fa50 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.609+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c130f10 con 0x7fc43c06fa50 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.609+0000 7fc4397fa640 1 -- 172.21.15.99:0/1999922834 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fc430014b80 con 0x7fc43c06fa50 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.610+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c133b40 con 0x7fc43c06fa50 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.610+0000 7fc4397fa640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc420037810 0x7fc420039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:40:57.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.610+0000 7fc4397fa640 1 -- 172.21.15.99:0/1999922834 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7fc430019040 con 0x7fc43c06fa50 2023-12-19T09:40:57.612 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.610+0000 7fc43bfff640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc420037810 0x7fc420039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:40:57.612 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.611+0000 7fc43bfff640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc420037810 0x7fc420039d20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:40:57.615 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.614+0000 7fc4397fa640 1 -- 172.21.15.99:0/1999922834 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fc430018d90 con 0x7fc43c06fa50 2023-12-19T09:40:57.817 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.817+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc43c130670 con 0x7fc43c06fa50 2023-12-19T09:40:57.818 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.817+0000 7fc4397fa640 1 -- 172.21.15.99:0/1999922834 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (crc 0 0 0) 0x7fc430018980 con 0x7fc43c06fa50 2023-12-19T09:40:57.818 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:40:57.818 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc420037810 msgr2=0x7fc420039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc420037810 0x7fc420039d20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 msgr2=0x7fc43c12d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c12d3c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 shutdown_connections 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fc420037810 0x7fc420039d20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 --2- 172.21.15.99:0/1999922834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc43c06fa50 0x7fc43c12d3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 >> 172.21.15.99:0/1999922834 conn(0x7fc43c09dff0 msgr2=0x7fc43c126040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 shutdown_connections 2023-12-19T09:40:57.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:40:57.819+0000 7fc442e06640 1 -- 172.21.15.99:0/1999922834 wait complete. 2023-12-19T09:40:57.830 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T09:40:57.830 INFO:teuthology.run_tasks:Running task workunit... 2023-12-19T09:40:57.844 INFO:tasks.workunit:Pulling workunits from ref 729869e4a72e72e756b33d15b6f2fbf113fa1a2d 2023-12-19T09:40:57.844 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-19T09:40:57.844 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-19T09:40:57.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:40:57.859 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-19T09:40:57.859 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-19T09:40:57.914 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-19T09:40:57.914 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-19T09:40:57.968 INFO:tasks.workunit:timeout=3h 2023-12-19T09:40:57.968 INFO:tasks.workunit:cleanup=True 2023-12-19T09:40:57.968 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/Matan-B/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 729869e4a72e72e756b33d15b6f2fbf113fa1a2d 2023-12-19T09:40:58.023 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-19T09:41:40.485 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to '729869e4a72e72e756b33d15b6f2fbf113fa1a2d'. 2023-12-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi099.stderr: 2023-12-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2023-12-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi099.stderr: 2023-12-19T09:41:40.486 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr: 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr: 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr: 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr: 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr: 2023-12-19T09:41:40.487 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at 729869e4a72 Merge remote-tracking branch 'athanatos/sjust/wip-crimson-2023-12-13-fixes' into wip-matanb-crimson-testing-misc 2023-12-19T09:41:40.490 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-19T09:41:40.555 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-19T09:41:40.557 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-19T09:41:40.557 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-19T09:41:41.301 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-19T09:41:41.373 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-19T09:41:41.413 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-19T09:41:41.415 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-19T09:41:41.415 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-19T09:41:41.454 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-19T09:41:41.457 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2023-12-19T09:41:41.457 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-19T09:41:41.512 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2023-12-19T09:41:41.514 INFO:tasks.workunit:Running workunit rados/test.sh... 2023-12-19T09:41:41.514 DEBUG:teuthology.orchestra.run.smithi099:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=729869e4a72e72e756b33d15b6f2fbf113fa1a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ parallel=1 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' '' = --serial ']' 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ color= 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -t 1 ']' 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ declare -A pids 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_aio 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_aio' 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_aio 2023-12-19T09:41:41.572 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.573 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_aio 2023-12-19T09:41:41.573 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84201 2023-12-19T09:41:41.573 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_aio on pid 84201' 2023-12-19T09:41:41.573 INFO:tasks.workunit.client.0.smithi099.stdout:test api_aio on pid 84201 2023-12-19T09:41:41.576 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84201 2023-12-19T09:41:41.576 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.576 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_aio_pp 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_aio_pp' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_aio_pp 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.577 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.578 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_aio_pp 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84208 2023-12-19T09:41:41.579 INFO:tasks.workunit.client.0.smithi099.stdout:test api_aio_pp on pid 84208 2023-12-19T09:41:41.583 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_aio_pp on pid 84208' 2023-12-19T09:41:41.583 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84208 2023-12-19T09:41:41.583 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.583 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2023-12-19T09:41:41.583 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.583 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_io 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_io' 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_io 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.584 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.585 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.586 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_io 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84217 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_io on pid 84217' 2023-12-19T09:41:41.587 INFO:tasks.workunit.client.0.smithi099.stdout:test api_io on pid 84217 2023-12-19T09:41:41.592 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84217 2023-12-19T09:41:41.592 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2023-12-19T09:41:41.592 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.592 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_io_pp 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_io_pp' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_io_pp 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.593 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.594 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.595 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_io_pp 2023-12-19T09:41:41.596 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84230 2023-12-19T09:41:41.597 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_io_pp on pid 84230' 2023-12-19T09:41:41.597 INFO:tasks.workunit.client.0.smithi099.stdout:test api_io_pp on pid 84230 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84230 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_asio 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_asio' 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_asio 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.603 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.604 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.605 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.606 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.607 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.608 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.609 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_asio 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84243 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_asio on pid 84243' 2023-12-19T09:41:41.610 INFO:tasks.workunit.client.0.smithi099.stdout:test api_asio on pid 84243 2023-12-19T09:41:41.617 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84243 2023-12-19T09:41:41.617 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.618 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_list 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_list' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_list 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.619 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.620 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.621 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.622 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.623 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.624 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.625 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.625 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84201/exe 2023-12-19T09:41:41.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_list 2023-12-19T09:41:41.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84261 2023-12-19T09:41:41.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_list on pid 84261' 2023-12-19T09:41:41.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2023-12-19T09:41:41.625 INFO:tasks.workunit.client.0.smithi099.stdout:test api_list on pid 84261 2023-12-19T09:41:41.633 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84261 2023-12-19T09:41:41.633 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.633 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.633 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.633 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.633 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_lock 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.634 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_lock' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.635 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_lock 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.636 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84208/exe 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_aio: /' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.639 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.640 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_aio.log 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_lock 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84280 2023-12-19T09:41:41.641 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_lock on pid 84280' 2023-12-19T09:41:41.642 INFO:tasks.workunit.client.0.smithi099.stdout:test api_lock on pid 84280 2023-12-19T09:41:41.652 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84280 2023-12-19T09:41:41.652 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.652 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.652 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2023-12-19T09:41:41.652 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.652 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.653 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_lock_pp 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.654 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_lock_pp' 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_aio_pp.log 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.655 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.656 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_lock_pp 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.657 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.658 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.659 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.660 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_aio_pp: /' 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84217/exe 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_lock_pp 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.661 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84303 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.662 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.663 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_lock_pp on pid 84303' 2023-12-19T09:41:41.664 INFO:tasks.workunit.client.0.smithi099.stdout:test api_lock_pp on pid 84303 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84303 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.675 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_misc 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_misc' 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.676 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.677 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_io.log 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.678 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_io: /' 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84230/exe 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.679 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.680 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.681 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_misc 2023-12-19T09:41:41.682 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.683 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.684 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.685 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.686 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_io_pp: /' 2023-12-19T09:41:41.686 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84243/exe 2023-12-19T09:41:41.686 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_misc 2023-12-19T09:41:41.686 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84333 2023-12-19T09:41:41.686 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_misc on pid 84333' 2023-12-19T09:41:41.686 INFO:tasks.workunit.client.0.smithi099.stdout:test api_misc on pid 84333 2023-12-19T09:41:41.694 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84333 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.695 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.696 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_misc_pp 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_misc_pp' 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_asio: /' 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.697 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.698 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.699 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.700 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_io_pp.log 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.701 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_asio.log 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_misc_pp 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_misc_pp 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84352 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_misc_pp on pid 84352' 2023-12-19T09:41:41.702 INFO:tasks.workunit.client.0.smithi099.stdout:test api_misc_pp on pid 84352 2023-12-19T09:41:41.712 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84352 2023-12-19T09:41:41.712 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2023-12-19T09:41:41.712 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.712 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.712 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_tier_pp 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_tier_pp' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.713 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.714 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.715 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.716 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_tier_pp 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.717 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.718 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.719 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84261/exe 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_tier_pp 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84373 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.721 INFO:tasks.workunit.client.0.smithi099.stdout:test api_tier_pp on pid 84373 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_tier_pp on pid 84373' 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84373 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_pool 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_pool' 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_pool 2023-12-19T09:41:41.725 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.726 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.726 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_list.log 2023-12-19T09:41:41.726 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_pool 2023-12-19T09:41:41.726 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.726 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84383 2023-12-19T09:41:41.726 INFO:tasks.workunit.client.0.smithi099.stdout:test api_pool on pid 84383 2023-12-19T09:41:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_pool on pid 84383' 2023-12-19T09:41:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84383 2023-12-19T09:41:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.742 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_snapshots 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_snapshots' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.743 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_snapshots 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.744 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.745 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.746 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.747 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84352/exe 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_list: /' 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.750 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.752 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84303/exe 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.753 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84333/exe 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.754 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84280/exe 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_snapshots 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84421 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_snapshots on pid 84421' 2023-12-19T09:41:41.757 INFO:tasks.workunit.client.0.smithi099.stdout:test api_snapshots on pid 84421 2023-12-19T09:41:41.773 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84421 2023-12-19T09:41:41.773 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.773 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_misc_pp.log 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_misc: /' 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.774 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_lock.log 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_lock_pp: /' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_misc_pp: /' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_misc.log 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.775 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_snapshots_pp 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_lock_pp.log 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_snapshots_pp' 2023-12-19T09:41:41.776 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_lock: /' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.777 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_snapshots_pp 2023-12-19T09:41:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84383/exe 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.786 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_pool.log 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_snapshots_pp 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84498 2023-12-19T09:41:41.788 INFO:tasks.workunit.client.0.smithi099.stdout:test api_snapshots_pp on pid 84498 2023-12-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_snapshots_pp on pid 84498' 2023-12-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84498 2023-12-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_stat 2023-12-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_stat' 2023-12-19T09:41:41.790 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_stat 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_pool: /' 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_stat 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84509 2023-12-19T09:41:41.791 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_stat on pid 84509' 2023-12-19T09:41:41.792 INFO:tasks.workunit.client.0.smithi099.stdout:test api_stat on pid 84509 2023-12-19T09:41:41.794 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84509 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_stat_pp 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_stat_pp' 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.795 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_stat_pp 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_stat_pp 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84540 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_stat_pp on pid 84540' 2023-12-19T09:41:41.797 INFO:tasks.workunit.client.0.smithi099.stdout:test api_stat_pp on pid 84540 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84540 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_watch_notify 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.804 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_watch_notify' 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84421/exe 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.806 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.807 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.808 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_snapshots: /' 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_snapshots.log 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_watch_notify 2023-12-19T09:41:41.809 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_watch_notify 2023-12-19T09:41:41.810 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84566 2023-12-19T09:41:41.810 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_watch_notify on pid 84566' 2023-12-19T09:41:41.810 INFO:tasks.workunit.client.0.smithi099.stdout:test api_watch_notify on pid 84566 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84566 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_watch_notify_pp 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_watch_notify_pp' 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.819 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.821 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.823 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_watch_notify_pp 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.825 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.652+0000 7f50d143c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.691+0000 7f50d143c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.691+0000 7f50d143c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [----------] Global test environment set-up. 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [----------] 12 tests from AsioRados 2023-12-19T09:41:41.826 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.692+0000 7f50d143c640 1 Processor -- start 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.692+0000 7f50d143c640 1 -- start start 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.693+0000 7f50d143c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570aaca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.693+0000 7f50d143c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570a9461a0 con 0x55570a9ac1e0 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.695+0000 7f50ca44b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570aaca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.695+0000 7f50ca44b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570aaca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45564/0 (socket says 172.21.15.99:45564) 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.695+0000 7f50ca44b640 1 -- 172.21.15.99:0/3759455141 learned_addr learned my addr 172.21.15.99:0/3759455141 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.696+0000 7f50ca44b640 1 -- 172.21.15.99:0/3759455141 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570a8e76b0 con 0x55570a9ac1e0 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.697+0000 7f50ca44b640 1 --2- 172.21.15.99:0/3759455141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570aaca960 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1c7ad31d1838c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.718+0000 7f50c8c48640 1 -- 172.21.15.99:0/3759455141 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f50c000d840 con 0x55570a9ac1e0 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.718+0000 7f50c8c48640 1 -- 172.21.15.99:0/3759455141 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f50c000d9a0 con 0x55570a9ac1e0 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.718+0000 7f50c8c48640 1 -- 172.21.15.99:0/3759455141 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f50c000dc40 con 0x55570a9ac1e0 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.719+0000 7f50d143c640 1 -- 172.21.15.99:0/3759455141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 msgr2=0x55570aaca960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.719+0000 7f50d143c640 1 --2- 172.21.15.99:0/3759455141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570aaca960 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:41.827 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.720+0000 7f50d143c640 1 -- 172.21.15.99:0/3759455141 shutdown_connections 2023-12-19T09:41:41.828 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_watch_notify_pp 2023-12-19T09:41:41.828 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84590 2023-12-19T09:41:41.828 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.720+0000 7f50d143c640 1 --2- 172.21test api_watch_notify_pp on pid 84590 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_watch_notify_pp on pid 84590' 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84590 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_cmd 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_cmd' 2023-12-19T09:41:41.838 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.839 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.839 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.839 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.839 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.839 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.839 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.839 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.841 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.842 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.843 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.844 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.845 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_cmd 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_cmd 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84627 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_cmd on pid 84627' 2023-12-19T09:41:41.848 INFO:tasks.workunit.client.0.smithi099.stdout:test api_cmd on pid 84627 2023-12-19T09:41:41.857 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84627 2023-12-19T09:41:41.857 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.857 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_cmd_pp 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_cmd_pp' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.858 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.859 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.860 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.861 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.862 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.863 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_cmd_pp 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.864 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_cmd_pp 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.865 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84656 2023-12-19T09:41:41.866 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_cmd_pp on pid 84656' 2023-12-19T09:41:41.866 INFO:tasks.workunit.client.0.smithi099.stdout:test api_cmd_pp on pid 84656 2023-12-19T09:41:41.888 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84656 2023-12-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.889 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.890 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.891 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_service 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.892 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_service' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.893 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84509/exe 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.894 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.895 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.896 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.897 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84498/exe 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.898 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_service 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.900 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.901 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84566/exe 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.902 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_stat.log 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.903 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84373/exe 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.904 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.905 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.906 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.907 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_watch_notify: /' 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_tier_pp.log 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_service 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84708 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_service on pid 84708' 2023-12-19T09:41:41.908 INFO:tasks.workunit.client.0.smithi099.stdout:test api_service on pid 84708 2023-12-19T09:41:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84708 2023-12-19T09:41:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_snapshots_pp: /' 2023-12-19T09:41:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_stat: /' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_watch_notify.log 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_tier_pp: /' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2023-12-19T09:41:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_service_pp 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_service_pp' 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84540/exe 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.920 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_stat_pp.log 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_stat_pp: /' 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_service_pp 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_service_pp 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84724 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_service_pp on pid 84724' 2023-12-19T09:41:41.921 INFO:tasks.workunit.client.0.smithi099.stdout:test api_service_pp on pid 84724 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84724 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.925 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.926 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_c_write_operations 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_c_write_operations' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_c_write_operations 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.927 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_c_write_operations 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84734 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_c_write_operations on pid 84734' 2023-12-19T09:41:41.928 INFO:tasks.workunit.client.0.smithi099.stdout:test api_c_write_operations on pid 84734 2023-12-19T09:41:41.931 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84734 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.932 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_c_read_operations 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_c_read_operations' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.933 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.934 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stdout:.15.99:0/3759455141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570aaca960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.720+0000 7f50d143c640 1 -- 172.21.15.99:0/3759455141 >> 172.21.15.99:0/3759455141 conn(0x55570a8bae00 msgr2=0x55570a9a7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.720+0000 7f50d143c640 1 -- 172.21.15.99:0/3759455141 shutdown_connections 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.720+0000 7f50d143c640 1 -- 172.21.15.99:0/3759455141 wait complete. 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.723+0000 7f50d143c640 1 Processor -- start 2023-12-19T09:41:41.935 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.723+0000 7f50d143c640 1 -- start start 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.724+0000 7f50d143c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570a997320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.724+0000 7f50d143c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570a941a90 con 0x55570a9ac1e0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.724+0000 7f50ca44b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570a997320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.725+0000 7f50ca44b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570a997320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45598/0 (socket says 172.21.15.99:45598) 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.725+0000 7f50ca44b640 1 -- 172.21.15.99:0/1245567661 learned_addr learned my addr 172.21.15.99:0/1245567661 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.725+0000 7f50ca44b640 1 -- 172.21.15.99:0/1245567661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55570a8da860 con 0x55570a9ac1e0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.726+0000 7f50ca44b640 1 --2- 172.21.15.99:0/1245567661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570a997320 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.773+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f50c0010b00 con 0x55570a9ac1e0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.774+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55570a8da2c0 con 0x55570a9ac1e0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.775+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55570a998ed0 con 0x55570a9ac1e0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.775+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f50c0010c60 con 0x55570a9ac1e0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.775+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f50c000e370 con 0x55570a9ac1e0 2023-12-19T09:41:41.936 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.776+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f50c000c040 con 0x55570a9ac1e0 2023-12-19T09:41:41.952 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.953 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.954 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_c_read_operations 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.955 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.956 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84590/exe 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.957 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.958 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.959 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.960 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.961 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.962 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.963 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84627/exe 2023-12-19T09:41:41.964 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.965 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2023-12-19T09:41:41.966 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_c_read_operations 2023-12-19T09:41:41.967 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.967 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84826 2023-12-19T09:41:41.967 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.776+0000 7f50bb7fe640 1 --2- 172.21.15.99:0/1245567661test api_c_read_operations on pid 84826 2023-12-19T09:41:41.977 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_c_read_operations on pid 84826' 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84826 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_cmd.log 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_cmd: /' 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s api_cls_remote_reads 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' api_cls_remote_reads' 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.978 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.979 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:41.980 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.981 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.982 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.983 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.984 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo api_cls_remote_reads 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84708/exe 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.985 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=api_cls_remote_reads 2023-12-19T09:41:41.986 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84869 2023-12-19T09:41:41.987 INFO:tasks.workunit.client.0.smithi099.stdout:test api_cls_remote_reads on pid 84869 2023-12-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test api_cls_remote_reads on pid 84869' 2023-12-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84869 2023-12-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:41.994 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.995 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:41.996 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_service: /' 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s list_parallel 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' list_parallel' 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84656/exe 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:41.997 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:41.998 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo list_parallel 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84734/exe 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:41.999 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_service.log 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=list_parallel 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84915 2023-12-19T09:41:42.000 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test list_parallel on pid 84915' 2023-12-19T09:41:42.001 INFO:tasks.workunit.client.0.smithi099.stdout:test list_parallel on pid 84915 2023-12-19T09:41:42.007 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84915 2023-12-19T09:41:42.007 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:42.008 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_cmd_pp: /' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:42.009 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2023-12-19T09:41:42.010 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s open_pools_parallel 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' open_pools_parallel' 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_c_write_operations: /' 2023-12-19T09:41:42.011 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo open_pools_parallel 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=open_pools_parallel 2023-12-19T09:41:42.012 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:42.013 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:42.013 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.013 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:42.013 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84937 2023-12-19T09:41:42.013 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test open_pools_parallel on pid 84937' 2023-12-19T09:41:42.013 INFO:tasks.workunit.client.0.smithi099.stdout:test open_pools_parallel on pid 84937 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84937 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:++ printf %25s delete_pools_parallel 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:+ r=' delete_pools_parallel' 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.026 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:42.027 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:42.028 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:++ echo delete_pools_parallel 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:42.029 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ awk '{print $1}' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:42.030 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:42.031 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:42.032 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:42.033 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:42.034 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+ ff=delete_pools_parallel 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:42.035 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:42.036 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84987 2023-12-19T09:41:42.036 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'test delete_pools_parallel on pid 84987' 2023-12-19T09:41:42.036 INFO:tasks.workunit.client.0.smithi099.stdout:test delete_pools_parallel on pid 84987 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+ pids[$f]=84987 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+ ret=0 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' 1 -eq 1 ']' 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84373 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84373 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84724/exe 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:42.064 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:42.065 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:42.066 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_service_pp.log 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_service_pp: /' 2023-12-19T09:41:42.067 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -f /etc/bashrc ']' 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:+ . /etc/bashrc 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ BASHRCSOURCED=Y 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ shopt -q login_shell 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:+++ umask 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' 0022 -eq 0 ']' 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ SHELL=/bin/bash 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/bash_completion.sh 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2023-12-19T09:41:42.068 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/cobbler.sh 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:+++ COBBLER_SERVER=172.21.0.11 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorgrep.sh 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.069 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:42.070 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'grep=grep --color=auto' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'egrep=egrep --color=auto' 2023-12-19T09:41:42.071 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'fgrep=fgrep --color=auto' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:42.072 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorls.sh 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' '!' -t 0 ']' 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:+++ return 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorsysstat.sh 2023-12-19T09:41:42.073 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export S_COLORS=auto 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:+++ S_COLORS=auto 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorxzgrep.sh 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:42.074 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.075 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.076 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:42.077 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84937/exe 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84826/exe 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:42.078 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:42.079 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.080 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/colorzgrep.sh 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:+++ /usr/libexec/grepconf.sh -c 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:42.081 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_c_read_operations: /' 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84915/exe 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ open_pools_parallel: /' 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:42.082 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:42.083 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.084 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_list_parallel.log 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84869/exe 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:42.085 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ list_parallel: /' 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zgrep=zgrep --color=auto' 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2023-12-19T09:41:42.086 INFO:tasks.workunit.client.0.smithi099.stderr:+++ alias 'zegrep=zegrep --color=auto' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/debuginfod.sh 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/gawk.sh 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/lang.sh 2023-12-19T09:41:42.087 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/locale 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG_backup=en_US.UTF-8 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /etc/locale.conf ']' 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -x /usr/bin/sed ']' 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:++++ export LANG=en_US.UTF-8 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:++++ LANG=en_US.UTF-8 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2023-12-19T09:41:42.088 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:+++ LANG=en_US.UTF-8 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:+++ unset LANG_backup config 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n '' ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -n en_US.UTF-8 ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' dumb = linux ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/less.sh 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:++ for i in /etc/profile.d/*.sh 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2023-12-19T09:41:42.089 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '' ']' 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:++ . /etc/profile.d/which2.sh 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+++++ readlink /proc/84987/exe 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:++++ basename /usr/bin/bash 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_declare='declare -f' 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+++ which_opt=-f 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export which_declare 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+++ export -f which 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset i 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset -f pathmunge 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset rc 2023-12-19T09:41:42.090 INFO:tasks.workunit.client.0.smithi099.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stderr:+ sed 's/^/ delete_pools_parallel: /' 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/cls_remote_reads.cc:13: Skipped 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: Not supported by crimson yet. Skipped 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2023-12-19T09:41:42.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (0 ms total) 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (0 ms total) 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [ PASSED ] 0 tests. 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [ SKIPPED ] 1 test, listed below: 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: [ SKIPPED ] ClsTestRemoteReads.TestGather 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: 2023-12-19T09:41:41.965+0000 7efc0b26e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: 2023-12-19T09:41:41.965+0000 7efc0b26e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:42.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_cls_remote_reads: 2023-12-19T09:41:41.965+0000 7efc0b26e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:45.712 INFO:tasks.workunit.client.0.smithi099.stdout: >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f50a80361d0 0x7f50a80386e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.776+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2672+0+0 (crc 0 0 0) 0x7f50c00493e0 con 0x55570a9ac1e0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.776+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55570a93a920 con 0x55570a9ac1e0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.777+0000 7f50c9c4a640 1 --2- 172.21.15.99:0/1245567661 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f50a80361d0 0x7f50a80386e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.777+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (crc 0 0 0) 0x7f50c0008e40 con 0x55570a9ac1e0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.777+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x55570a94bb20 con 0x55570a9ac1e0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:41.781+0000 7f50c9c4a640 1 --2- 172.21.15.99:0/1245567661 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f50a80361d0 0x7f50a80386e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:42.064+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v15) v1 ==== 43+0+0 (crc 0 0 0) 0x7f50c0008c40 con 0x55570a9ac1e0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:42.064+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=15}) v3 -- 0x7f50a803aaf0 con 0x55570a9ac1e0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:42.108+0000 7f50bb7fe640 1 -- 172.21.15.99:0/1245567661 <== mon.0 v2:172.21.15.99:3300/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 5832+0+0 (crc 0 0 0) 0x7f50c00078d0 con 0x55570a9ac1e0 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:42.108+0000 7f50d143c640 1 --2- 172.21.15.99:0/1245567661 >> v2:172.21.15.99:6800/1010486646 conn(0x55570a9af490 0x55570aae1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:41:45.713 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:42.108+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:2 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570a996b90 con 0x55570a9af490 2023-12-19T09:41:45.714 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:42.109+0000 7f50cac4c640 1 --2- 172.21.15.99:0/1245567661 >> v2:172.21.15.99:6800/1010486646 conn(0x55570a9af490 0x55570aae1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:41:45.714 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:42.111+0000 7f50cac4c640 1 --2- 172.21.15.99:0/1245567661 >> v2:172.21.15.99:6800/1010486646 conn(0x55570a9af490 0x55570aae1450 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:41:45.714 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.712+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 1 ==== osd_op_reply(2 exist [writefull 0~5] v17'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:45.714 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2023-12-19T09:41:46.010 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.712+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:3 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570a998210 con 0x55570a9af490 2023-12-19T09:41:46.010 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.712+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:4 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aade8d0 con 0x55570a9af490 2023-12-19T09:41:46.010 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.933+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:46.010 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.933+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v17'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:46.010 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (221 ms) 2023-12-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2023-12-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.933+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:5 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aade430 con 0x55570a9af490 2023-12-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.933+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:6 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae1990 con 0x55570a9af490 2023-12-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.954+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v17'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.973+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (40 ms) 2023-12-19T09:41:46.011 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2023-12-19T09:41:46.012 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:7 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570ab01d00 con 0x55570a9af490 2023-12-19T09:41:46.012 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:45.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:8 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570ab22510 con 0x55570a9af490 2023-12-19T09:41:46.012 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:46.004+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 6 ==== osd_op_reply(7 exist [read 0~5 out=5b] v17'1 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:46.012 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:46.009+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 7 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:46.012 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (36 ms) 2023-12-19T09:41:46.012 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2023-12-19T09:41:47.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:46.009+0000 7f50d143c640 1 -- 172.21.15.99:0/12455 api_tier_pp: [==========] Running 77 tests from 4 test suites. 2023-12-19T09:41:47.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] Global test environment set-up. 2023-12-19T09:41:47.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2023-12-19T09:41:47.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: seed 84705 2023-12-19T09:41:47.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: 2023-12-19T09:41:41.827+0000 7f11a982c940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: 2023-12-19T09:41:41.827+0000 7f11a982c940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: 2023-12-19T09:41:41.827+0000 7f11a982c940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:287: Skipped 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:2182: Skipped 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:2561: Skipped 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (0 ms total) 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-12-19T09:41:47.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2023-12-19T09:41:47.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (1 ms) 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2023-12-19T09:41:47.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2023-12-19T09:41:47.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2023-12-19T09:41:47.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2023-12-19T09:41:47.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:47.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2023-12-19T09:41:47.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-12-19T09:41:47.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:47.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:47.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:48.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2023-12-19T09:41:48.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-12-19T09:41:48.100 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.101 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:223: Skipped 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:233: Skipped 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2023-12-19T09:41:48.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (0 ms total) 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2023-12-19T09:41:48.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6267: Skipped 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2023-12-19T09:41:48.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.108 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.109 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.110 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.111 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2023-12-19T09:41:48.112 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.113 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.114 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2023-12-19T09:41:48.115 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.116 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.117 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.117 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.117 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2023-12-19T09:41:48.118 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-12-19T09:41:48.118 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.118 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.118 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.118 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6278: Skipped 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6288: Skipped 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/tier_cxx.cc:6272: Skipped 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [----------] Global test environment tear-down 2023-12-19T09:41:48.119 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (6272 ms total) 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ PASSED ] 0 tests. 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] 77 tests, listed below: 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.Dirty 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierPP.HitSetNone 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Promote 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Evict 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2023-12-19T09:41:48.120 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.Flush 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2023-12-19T09:41:48.121 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2023-12-19T09:41:48.122 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.Dirty 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTierECPP.HitSetNone 2023-12-19T09:41:48.123 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2023-12-19T09:41:48.124 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2023-12-19T09:41:48.125 INFO:tasks.workunit.client.0.smithi099.stdout: api_tier_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2023-12-19T09:41:48.126 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:41:48.126 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84243 2023-12-19T09:41:48.126 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84243 2023-12-19T09:41:50.104 INFO:tasks.workunit.client.0.smithi099.stdout:67661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:9 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aadecb0 con 0x55570a9af490 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:46.955+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 8 ==== osd_op_reply(9 exist [write 0~5] v18'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (946 ms) 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:46.955+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:10 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aadecb0 con 0x55570a9af490 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:48.636+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 9 ==== osd_op_reply(10 exist [write 0~5] v19'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1681 ms) 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:48.636+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:11 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570a997860 con 0x55570a9af490 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.034+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 10 ==== osd_op_reply(11 exist [write 0~5] v21'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1398 ms) 2023-12-19T09:41:50.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.034+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:12 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570a997860 con 0x55570a9af490 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.034+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:13 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae2190 con 0x55570a9af490 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.064+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 11 ==== osd_op_reply(12 exist [read 0~5 out=5b] v21'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.078+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 12 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (44 ms) 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.079+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:14 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae1cf0 con 0x55570a9af490 2023-12-19T09:41:50.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.079+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:15 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae2670 con 0x55570a9af490 2023-12-19T09:41:54.973 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.104+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v21'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.109+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (32 ms) 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.110+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:16 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae1cf0 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.110+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:17 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae4ea0 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.137+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v21'4 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.140+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (30 ms) 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:50.140+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:18 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae1cf0 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:51.656+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 17 ==== osd_op_reply(18 exist [writefull 0~5] v23'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:54.974 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1516 ms) 2023-12-19T09:41:54.975 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2023-12-19T09:41:54.975 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:51.656+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:19 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae1cf0 con 0x55570a9af490 2023-12-19T09:41:54.975 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:52.800+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 18 ==== osd_op_reply(19 exist [writefull 0~5] v24'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:54.975 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1145 ms) 2023-12-19T09:41:54.975 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2023-12-19T09:41:54.975 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:52.801+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 --> v2:172.21.15.99:6800/1010486646 -- osd_op(unknown.0.0:20 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x55570aae1cf0 con 0x55570a9af490 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50cac4c640 1 -- 172.21.15.99:0/1245567661 <== osd.0 v2:172.21.15.99:6800/1010486646 19 ==== osd_op_reply(20 exist [writefull 0~5] v25'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f50b400c430 con 0x55570a9af490 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (2172 ms) 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 >> v2:172.21.15.99:6800/1010486646 conn(0x55570a9af490 msgr2=0x55570aae1450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 --2- 172.21.15.99:0/1245567661 >> v2:172.21.15.99:6800/1010486646 conn(0x55570a9af490 0x55570aae1450 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f50a80361d0 msgr2=0x7f50a80386e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 --2- 172.21.15.99:0/1245567661 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f50a80361d0 0x7f50a80386e0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 msgr2=0x55570a997320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 --2- 172.21.15.99:0/1245567661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570a997320 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 shutdown_connections 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 --2- 172.21.15.99:0/1245567661 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f50a80361d0 0x7f50a80386e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:54.977 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 --2- 172.21.15.99:0/1245567661 >> v2:172.21.15.99:6800/1010486646 conn(0x55570a9af490 0x55570aae1450 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 --2- 172.21.15.99:0/1245567661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55570a9ac1e0 0x55570a997320 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 >> 172.21.15.99:0/1245567661 conn(0x55570a8bae00 msgr2=0x55570a9aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 shutdown_connections 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.973+0000 7f50d143c640 1 -- 172.21.15.99:0/1245567661 wait complete. 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [----------] 12 tests from AsioRados (9261 ms total) 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [----------] Global test environment tear-down 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (13282 ms total) 2023-12-19T09:41:54.978 INFO:tasks.workunit.client.0.smithi099.stdout: api_asio: [ PASSED ] 12 tests. 2023-12-19T09:41:54.979 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:41:54.979 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84421 2023-12-19T09:41:54.979 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84421 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Running main() from gmock_main.cc 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [----------] Global test environment set-up. 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: seed 84719 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (10094 ms) 2023-12-19T09:41:55.128 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (733 ms) 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (38 ms) 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (939 ms) 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (11804 ms total) 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.129 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.130 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.131 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: Not supported by crimson yet. Skipped 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (0 ms total) 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [----------] Global test environment tear-down 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (13338 ms total) 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ PASSED ] 5 tests. 2023-12-19T09:41:55.132 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] 4 tests, listed below: 2023-12-19T09:41:55.133 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPP 2023-12-19T09:41:55.133 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2023-12-19T09:41:55.133 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.PoolStatPP 2023-12-19T09:41:55.133 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat_pp: [ SKIPPED ] LibRadosStatECPP.StatPPNS 2023-12-19T09:41:58.138 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: Running main() from gmock_main.cc 2023-12-19T09:41:58.138 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [----------] Global test environment set-up. 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (226 ms) 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (135 ms) 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (15910 ms) 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (16271 ms total) 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [----------] Global test environment tear-down 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (16271 ms total) 2023-12-19T09:41:58.139 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Running main() from gmock_main.cc 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [----------] Global test environment set-up. 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [----------] 5 tests from LibRadosStat 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ OK ] LibRadosStat.Stat (10040 ms) 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (2827 ms) 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2023-12-19T09:42:00.140 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ OK ] LibRadosStat.StatNS (1956 ms) 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (2022 ms) 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [----------] 5 tests from LibRadosStat (16845 ms total) 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:168: Skipped 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.141 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.142 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:176: Skipped 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: Not supported by crimson yet. Skipped 2023-12-19T09:42:00.143 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (0 ms total) 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [----------] Global test environment tear-down 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (18370 ms total) 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ PASSED ] 5 tests. 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] 4 tests, listed below: 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.Stat 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.StatNS 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.ClusterStat 2023-12-19T09:42:00.144 INFO:tasks.workunit.client.0.smithi099.stdout: api_stat: [ SKIPPED ] LibRadosStatEC.PoolStat 2023-12-19T09:42:02.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Running main() from gmock_main.cc 2023-12-19T09:42:02.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2023-12-19T09:42:02.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [----------] Global test environment set-up. 2023-12-19T09:42:02.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [----------] 8 tests from LibRadosLock 2023-12-19T09:42:02.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (4631 ms) 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.LockShared (2199 ms) 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1940 ms) 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (2957 ms) 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (139 ms) 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.Unlock (4979 ms) 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2023-12-19T09:42:02.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (1242 ms) 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (927 ms) 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [----------] 8 tests from LibRadosLock (19014 ms total) 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:168: Skipped 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2023-12-19T09:42:02.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2023-12-19T09:42:02.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2023-12-19T09:42:02.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2023-12-19T09:42:02.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.157 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.157 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.157 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.157 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2023-12-19T09:42:02.157 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2023-12-19T09:42:02.157 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:02.157 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:176: Skipped 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: Not supported by crimson yet. Skipped 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (0 ms total) 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [----------] Global test environment tear-down 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (20447 ms total) 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ PASSED ] 8 tests. 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] 8 tests, listed below: 2023-12-19T09:42:02.158 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusive 2023-12-19T09:42:02.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockShared 2023-12-19T09:42:02.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2023-12-19T09:42:02.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockSharedDur 2023-12-19T09:42:02.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.LockMayRenew 2023-12-19T09:42:02.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.Unlock 2023-12-19T09:42:02.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.ListLockers 2023-12-19T09:42:02.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock: [ SKIPPED ] LibRadosLockEC.BreakLock 2023-12-19T09:42:07.985 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2023-12-19T09:42:07.986 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (1 ms) 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1 ms total) 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: notify 2023-12-19T09:42:07.987 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (8975 ms) 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: notify 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (6807 ms) 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (294 ms) 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (4739 ms) 2023-12-19T09:42:07.988 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2023-12-19T09:42:09.447 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: handle_notify cookie 94727091722096 api_service: 2023-12-19T09:41:41.888+0000 7f8a9a4677c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:09.447 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:41:41.888+0000 7f8a9a4677c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:09.447 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2023-12-19T09:42:09.447 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [----------] Global test environment set-up. 2023-12-19T09:42:09.447 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [----------] 4 tests from LibRadosService 2023-12-19T09:42:09.447 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2023-12-19T09:42:09.447 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:41:41.892+0000 7f8a9a4677c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5218 ms) 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ OK ] LibRadosService.RegisterLate (55 ms) 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: cluster: 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: id: 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: health: HEALTH_WARN 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 7 pool(s) do not have an application enabled 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: services: 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: mon: 1 daemons, quorum a (age 63s) 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: mgr: x(active, since 59s) 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: osd: 4 osds: 4 up (since 57s), 4 in (since 61s) 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: laundry: 2 daemons active (1 hosts) 2023-12-19T09:42:09.448 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: data: 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: pools: 28 pools, 841 pgs 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: objects: 7 objects, 577 KiB 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: usage: 107 MiB used, 400 GiB / 400 GiB avail 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: pgs: 77.527% pgs unknown 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 7.015% pgs not active 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 652 unknown 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 130 active+clean 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 46 creating+peering 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 13 creating+activating 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: io: 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: client: 1023 B/s wr, 0 op/s rd, 1 op/s wr 2023-12-19T09:42:09.449 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: cluster: 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: id: 8e93e3b6-2270-4fce-ac6b-2175b078bbce 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: health: HEALTH_WARN 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 7 pool(s) do not have an application enabled 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: services: 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: mon: 1 daemons, quorum a (age 65s) 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: mgr: x(active, since 61s) 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: osd: 4 osds: 4 up (since 59s), 4 in (since 63s) 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: laundry: 1 daemon active (1 hosts) 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.450 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: data: 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: pools: 28 pools, 841 pgs 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: objects: 8 objects, 577 KiB 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: usage: 111 MiB used, 400 GiB / 400 GiB avail 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: pgs: 48.514% pgs unknown 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 22.117% pgs not active 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 408 unknown 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 247 active+clean 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 135 creating+peering 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 51 creating+activating 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: io: 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: client: 1.2 KiB/s wr, 0 op/s rd, 1 op/s wr 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.451 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2245 ms) 2023-12-19T09:42:09.452 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ RUN ] LibRadosService.Status 2023-12-19T09:42:09.452 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ OK ] LibRadosService.Status (20036 ms) 2023-12-19T09:42:09.452 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [----------] 4 tests from LibRadosService (27554 ms total) 2023-12-19T09:42:09.453 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: 2023-12-19T09:42:09.453 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [----------] Global test environment tear-down 2023-12-19T09:42:09.453 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27554 ms total) 2023-12-19T09:42:09.453 INFO:tasks.workunit.client.0.smithi099.stdout: api_service: [ PASSED ] 4 tests. 2023-12-19T09:42:09.689 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2023-12-19T09:42:09.689 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] Global test environment set-up. 2023-12-19T09:42:09.689 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2023-12-19T09:42:09.689 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2023-12-19T09:42:09.690 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2023-12-19T09:42:09.690 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-12-19T09:42:09.690 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:42:09.690 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2023-12-19T09:42:09.690 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2023-12-19T09:42:09.690 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:41:41.700+0000 7f343942d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:09.691 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:41:41.700+0000 7f343942d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:09.691 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:41:41.700+0000 7f343942d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:09.691 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2023-12-19T09:42:09.691 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:41:41.819+0000 7f343942d640 -1 failed for service _ceph-mon._tcp 2023-12-19T09:42:09.691 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:41:41.819+0000 7f343942d640 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2023-12-19T09:42:09.691 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (119 ms) 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2025 ms) 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2144 ms total) 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x7f33fc005d20 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x7f341c005d20 2023-12-19T09:42:09.692 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c75f6f720 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c75f43f30 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c75f41110 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c76135150 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c7628a940 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c7628b3f0 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c7628be20 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c761e7cd0 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c7628c970 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c7628d020 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 0x555c7628da80 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: started 13 aios 2023-12-19T09:42:09.693 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x7f33fc005d20 2023-12-19T09:42:09.694 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x7f341c005d20 2023-12-19T09:42:09.694 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c75f6f720 2023-12-19T09:42:09.694 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c75f43f30 2023-12-19T09:42:09.694 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c75f41110 2023-12-19T09:42:09.694 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c76135150 2023-12-19T09:42:09.694 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c7628a940 2023-12-19T09:42:09.694 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c7628b3f0 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c7628be20 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c761e7cd0 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c7628c970 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c7628d020 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: waiting 0x555c7628da80 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: done. 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (15290 ms) 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (15290 ms total) 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:42:09.695 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2023-12-19T09:42:09.696 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2023-12-19T09:42:09.696 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2023-12-19T09:42:09.696 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2023-12-19T09:42:09.696 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMisc.Exec (929 ms) 2023-12-19T09:42:09.696 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2023-12-19T09:42:09.696 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (5897 ms) 2023-12-19T09:42:09.697 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: api_pool: Running main() from gmock_main.cc 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [----------] Global test environment set-up. 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [----------] 9 tests from LibRadosPools 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2381 ms) 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3005 ms) 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2023-12-19T09:42:11.042 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3010 ms) 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3008 ms) 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3023 ms) 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5012 ms) 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4881 ms) 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5012 ms) 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/pool.cc:139: Skipped 2023-12-19T09:42:11.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: Not supported by crimson yet. Skipped 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [----------] 9 tests from LibRadosPools (29332 ms total) 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [----------] Global test environment tear-down 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (29332 ms total) 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ PASSED ] 8 tests. 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ SKIPPED ] 1 test, listed below: 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_pool: [ SKIPPED ] LibRadosPools.PoolGetBaseTier 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: Running main() from gmock_main.cc 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [----------] Global test environment set-up. 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (362 ms) 2023-12-19T09:42:11.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (78 ms) 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (18854 ms) 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:00.138901+0000 mon.a [INF] from='client.? 172.21.15.99:0/3626708958' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi099-84422-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:01.141368+0000 mon.a [INF] from='client.? 172.21.15.99:0/3626708958' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi099-84422-1","app": "rados","yes_i_really_mean_it": true}]': finished 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:01.145568+0000 mon.a [INF] from='client.? 172.21.15.99:0/517158179' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi099-84271-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:01.166650+0000 client.admin [INF] onexx 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:01.166768+0000 mon.a [INF] from='client.? 172.21.15.99:0/2758908152' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:04.157444+0000 mon.a [INF] from='client.? 172.21.15.99:0/2758908152' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:06.157963+0000 client.admin [INF] threexx 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: got: 2023-12-19T09:42:06.158273+0000 mon.a [INF] from='client.? 172.21.15.99:0/2758908152' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (9894 ms) 2023-12-19T09:42:11.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (29188 ms total) 2023-12-19T09:42:11.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: 2023-12-19T09:42:11.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [----------] Global test environment tear-down 2023-12-19T09:42:11.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (29190 ms total) 2023-12-19T09:42:11.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_cmd: [ PASSED ] 4 tests. 2023-12-19T09:42:14.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Running main() from gmock_main.cc 2023-12-19T09:42:14.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2023-12-19T09:42:14.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [----------] Global test environment set-up. 2023-12-19T09:42:14.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2023-12-19T09:42:14.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: seed 84411 2023-12-19T09:42:14.159 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (7671 ms) 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (1262 ms) 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (4126 ms) 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (3980 ms) 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (736 ms) 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (5901 ms) 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (3270 ms) 2023-12-19T09:42:14.160 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (3909 ms) 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (30855 ms total) 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2023-12-19T09:42:14.161 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.162 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.163 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2023-12-19T09:42:14.164 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2023-12-19T09:42:14.164 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.164 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.164 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.164 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.164 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2023-12-19T09:42:14.164 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: Not supported by crimson yet. Skipped 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (0 ms total) 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [----------] Global test environment tear-down 2023-12-19T09:42:14.165 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (32372 ms total) 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ PASSED ] 8 tests. 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] 8 tests, listed below: 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedPP 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.UnlockPP 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.ListLockersPP 2023-12-19T09:42:14.166 INFO:tasks.workunit.client.0.smithi099.stdout: api_lock_pp: [ SKIPPED ] LibRadosLockECPP.BreakLockPP 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [----------] Global test environment set-up. 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: 2023-12-19T09:41:41.925+0000 7f6e9ac3a7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: 2023-12-19T09:41:41.925+0000 7f6e9ac3a7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: 2023-12-19T09:41:41.925+0000 7f6e9ac3a7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5184 ms) 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2023-12-19T09:42:17.422 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (69 ms) 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20058 ms) 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: attempt 0 of 20 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: failed to deregister: 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: { 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "epoch": 6, 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "modified": "2023-12-19T09:42:10.262106+0000", 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "services": { 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "laundry": { 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "daemons": { 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "summary": "", 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "close-test-pid85000": { 2023-12-19T09:42:17.423 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "start_epoch": 5, 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "start_stamp": "2023-12-19T09:42:07.278735+0000", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "gid": 4387, 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "addr": "172.21.15.99:0/1303668851", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "metadata": { 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "arch": "x86_64", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "ceph_release": "reef", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-231-g729869e4 (729869e4a72e72e756b33d15b6f2fbf113fa1a2d) reef (dev)", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "ceph_version_short": "19.0.0-231-g729869e4", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "distro": "centos", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "distro_version": "9", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "foo": "bar", 2023-12-19T09:42:17.424 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "hostname": "smithi099", 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Tue Nov 28 20:35:49 UTC 2023", 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "kernel_version": "5.14.0-391.el9.x86_64", 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "mem_swap_kb": "0", 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "mem_total_kb": "32488500", 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "os": "Linux", 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "this": "that" 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: }, 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: "task_status": {} 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: } 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: } 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: } 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: } 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: } 2023-12-19T09:42:17.425 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: 2023-12-19T09:42:17.426 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: attempt 1 of 20 2023-12-19T09:42:17.426 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10185 ms) 2023-12-19T09:42:17.426 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (35496 ms total) 2023-12-19T09:42:17.426 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: 2023-12-19T09:42:17.426 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [----------] Global test environment tear-down 2023-12-19T09:42:17.428 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (35496 ms total) 2023-12-19T09:42:17.428 INFO:tasks.workunit.client.0.smithi099.stdout: api_service_pp: [ PASSED ] 4 tests. 2023-12-19T09:42:28.718 INFO:tasks.workunit.client.0.smithi099.stdout:notify_id 171798691843 notifier_gid 4230 2023-12-19T09:42:28.718 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (5060 ms) 2023-12-19T09:42:28.719 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2023-12-19T09:42:28.719 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: handle_notify cookie 94727091725008 notify_id 193273528323 notifier_gid 4230 2023-12-19T09:42:28.719 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (3800 ms) 2023-12-19T09:42:28.719 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2023-12-19T09:42:28.719 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: handle_notify cookie 94727091725008 notify_id 193273528324 notifier_gid 4230 2023-12-19T09:42:28.719 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (14813 ms) 2023-12-19T09:42:28.719 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2023-12-19T09:42:29.276 INFO:tasks.workunit.client.0.smithi099.stderr:bash: line 1: 84807 Segmentation fault (core dumped) ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 2023-12-19T09:42:29.276 INFO:tasks.workunit.client.0.smithi099.stderr: 84808 Done | tee ceph_test_rados_api_watch_notify_pp.log 2023-12-19T09:42:29.276 INFO:tasks.workunit.client.0.smithi099.stderr: 84809 Done | sed "s/^/ api_watch_notify_pp: /" 2023-12-19T09:42:30.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Running main() from gmock_main.cc 2023-12-19T09:42:30.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2023-12-19T09:42:30.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [----------] Global test environment set-up. 2023-12-19T09:42:30.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [----------] 14 tests from LibRadosIo 2023-12-19T09:42:30.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (5081 ms) 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: no timeout :/ 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: no timeout :/ 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: no timeout :/ 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: no timeout :/ 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: no timeout :/ 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (2686 ms) 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (4892 ms) 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2023-12-19T09:42:30.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.Checksum (2092 ms) 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (56 ms) 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (3208 ms) 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (2735 ms) 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (20 ms) 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.TruncTest (3146 ms) 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4793 ms) 2023-12-19T09:42:30.055 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (2160 ms) 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.RmXattr (1093 ms) 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ OK ] LibRadosIo.XattrIter (14300 ms) 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [----------] 14 tests from LibRadosIo (46262 ms total) 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:168: Skipped 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.056 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.057 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2023-12-19T09:42:30.058 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.059 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:42:30.060 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:176: Skipped 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: Not supported by crimson yet. Skipped 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [----------] 10 tests from LibRadosIoEC (0 ms total) 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [----------] Global test environment tear-down 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [==========] 24 tests from 2 test suites ran. (48425 ms total) 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ PASSED ] 14 tests. 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] 10 tests, listed below: 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.SimpleWrite 2023-12-19T09:42:30.061 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RoundTrip 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.TruncTest 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RemoveTest 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.RmXattr 2023-12-19T09:42:30.062 INFO:tasks.workunit.client.0.smithi099.stdout: api_io: [ SKIPPED ] LibRadosIoEC.XattrIter 2023-12-19T09:42:45.057 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRadosMisc.CmpExt (1718 ms) 2023-12-19T09:42:45.187 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2023-12-19T09:42:45.187 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4354 ms) 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (30449 ms) 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] 8 tests from LibRadosMisc (43347 ms total) 2023-12-19T09:42:45.188 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: 2023-12-19T09:42:45.189 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [----------] Global test environment tear-down 2023-12-19T09:42:45.189 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (63345 ms total) 2023-12-19T09:42:45.189 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc: [ PASSED ] 12 tests. 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Running main() from gmock_main.cc 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [----------] Global test environment set-up. 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: seed 84326 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (3436 ms) 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2023-12-19T09:43:01.075 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (3506 ms) 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5897 ms) 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (1834 ms) 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (1277 ms) 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (13 ms) 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (11 ms) 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (3001 ms) 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2023-12-19T09:43:01.076 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (3942 ms) 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (733 ms) 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (3233 ms) 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (2940 ms) 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (8913 ms) 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (27229 ms) 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2023-12-19T09:43:01.077 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (10890 ms) 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (89 ms) 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (21 ms) 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (13 ms) 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (840 ms) 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (77818 ms total) 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:43:01.078 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Ski api_snapshots: Running main() from gmock_main.cc 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] Global test environment set-up. 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (6015 ms) 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (7031 ms) 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2004 ms) 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (3010 ms) 2023-12-19T09:43:01.079 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (18060 ms total) 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (10960 ms) 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3918 ms) 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (42150 ms) 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (57028 ms total) 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:168: Skipped 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2023-12-19T09:43:01.080 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2023-12-19T09:43:01.081 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869epped 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.082 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.083 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_AR4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2023-12-19T09:43:01.084 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:176: Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:168: Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.085 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2023-12-19T09:43:01.088 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: /home/jenCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.089 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.090 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2023-12-19T09:43:01.091 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.092 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2023-12-19T09:43:01.093 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/kins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:176: Skipped 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [----------] Global test environment tear-down 2023-12-19T09:43:01.094 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (79336 ms total) 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ PASSED ] 7 tests. 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] 6 tests, listed below: 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapList 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.Rollback 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2023-12-19T09:43:01.095 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots: [ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84987 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84987 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout:BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.096 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (1 ms) 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1 ms total) 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [----------] Global test environment tear-down 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (79448 ms total) 2023-12-19T09:43:01.097 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ PASSED ] 20 tests. 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] 17 tests, listed below: 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.ReadOpPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.TruncTestPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2023-12-19T09:43:01.098 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2023-12-19T09:43:01.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.RmXattrPP 2023-12-19T09:43:01.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.XattrListPP 2023-12-19T09:43:01.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtPP 2023-12-19T09:43:01.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2023-12-19T09:43:01.099 INFO:tasks.workunit.client.0.smithi099.stdout: api_io_pp: [ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2023-12-19T09:43:08.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: Running main() from gmock_main.cc 2023-12-19T09:43:08.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2023-12-19T09:43:08.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [----------] Global test environment set-up. 2023-12-19T09:43:08.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2023-12-19T09:43:08.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2023-12-19T09:43:08.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify_test_cb 2023-12-19T09:43:08.102 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (8629 ms) 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93826187604560 err -107 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (5231 ms) 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93826187616224 err -107 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (5090 ms) 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 146028888065 cookie 93826187616224 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (87 ms) 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2023-12-19T09:43:08.103 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 146028888065 cookie 93826187621104 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (820 ms) 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 146028888066 cookie 93826187621104 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (141 ms) 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 167503724545 cookie 93826187621104 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 167503724545 cookie 93826187624384 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (6814 ms) 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 188978561026 cookie 93826187624384 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 193273528324 cookie 93826187624384 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (5893 ms) 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2023-12-19T09:43:08.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93826187624384 err -107 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_cb from 4224 notify_id 343597383683 cookie 93826187644848 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (46259 ms) 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93826187644848 err -107 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (5941 ms) 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (84905 ms total) 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:168: Skipped 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-19T09:43:08.105 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:182: Skipped 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:196: Skipped 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:176: Skipped 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: Not supported by crimson yet. Skipped 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [----------] Global test environment tear-down 2023-12-19T09:43:08.106 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (86304 ms total) 2023-12-19T09:43:08.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ PASSED ] 10 tests. 2023-12-19T09:43:08.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ SKIPPED ] 1 test, listed below: 2023-12-19T09:43:08.107 INFO:tasks.workunit.client.0.smithi099.stdout: api_watch_notify: [ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2023-12-19T09:43:34.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2023-12-19T09:43:34.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [==========] Running 19 tests from 4 test suites. 2023-12-19T09:43:34.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: seed 84695 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (7016 ms) 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (6030 ms) 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2002 ms) 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2002 ms) 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (6891 ms) 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (23941 ms total) 2023-12-19T09:43:34.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (48717 ms) 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/snapshots_cxx.cc:156: Skipped 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/snapshots_cxx.cc:242: Skipped 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2023-12-19T09:43:34.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4335 ms) 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (8945 ms) 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/snapshots_cxx.cc:463: Skipped 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: deleting snap 13 in pool LibRadosSnapshotsSelfManagedPP_smithi099-84695-7 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: waiting for snaps to purge 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (21102 ms) 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (83100 ms total) 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2023-12-19T09:43:34.048 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:34.049 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2023-12-19T09:43:34.050 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-12-19T09:43:34.051 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: Not supported by crimson yet. Skipped 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2023-12-19T09:43:34.052 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: 2023-12-19T09:43:34.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2023-12-19T09:43:34.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [==========] 19 tests from 4 test suites ran. (112252 ms total) 2023-12-19T09:43:34.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ PASSED ] 9 tests. 2023-12-19T09:43:34.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] 10 tests, listed below: 2023-12-19T09:43:34.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2023-12-19T09:43:34.053 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2023-12-19T09:43:34.054 INFO:tasks.workunit.client.0.smithi099.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2023-12-19T09:43:52.221 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: Running main() from gmock_main.cc 2023-12-19T09:43:52.221 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2023-12-19T09:43:52.221 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [----------] Global test environment set-up. 2023-12-19T09:43:52.221 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (10875 ms) 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (70 ms) 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (5074 ms) 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (7827 ms) 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (46 ms) 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2023-12-19T09:43:52.222 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (4852 ms) 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (190 ms) 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (762 ms) 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (11443 ms) 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (23667 ms) 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (9092 ms) 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (20 ms) 2023-12-19T09:43:52.223 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (13107 ms) 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (8954 ms) 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (31801 ms) 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (18 ms) 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (127798 ms total) 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [----------] Global test environment tear-down 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (130295 ms total) 2023-12-19T09:43:52.224 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2023-12-19T09:46:27.019 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] Global test environment set-up. 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] 7 tests from LibRadosList 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 2023-12-19T09:41:41.684+0000 7fa92ee2f940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 2023-12-19T09:41:41.685+0000 7fa92ee2f940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 2023-12-19T09:41:41.685+0000 7fa92ee2f940 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosList.ListObjects (14831 ms) 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (5278 ms) 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2023-12-19T09:46:27.020 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: myset foo1,foo2,foo3 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo1 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo2 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo3 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: myset foo1,foo4,foo5 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo4 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo5 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo1 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: myset foo6,foo7 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo7 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: foo6 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2023-12-19T09:46:27.021 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: ns1:foo4 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: ns1:foo5 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: ns2:foo7 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: ns2:foo6 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: ns1:foo1 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: :foo1 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: :foo2 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: :foo3 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (57479 ms) 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 1 0 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 10 0 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 13 0 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 7 0 2023-12-19T09:46:27.022 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 14 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 0 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 15 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 11 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 5 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 8 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 6 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 3 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 4 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 12 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 9 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 2 0 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (87694 ms) 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2023-12-19T09:46:27.023 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: x cursor=MIN 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=1 cursor=11:02547ec2:::1:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=10 cursor=11:52ea6a34:::10:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=13 cursor=11:566253c9:::13:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=7 cursor=11:5c6b0b28:::7:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=14 cursor=11:62a1935d:::14:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=0 cursor=11:6cac518f:::0:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=15 cursor=11:863748b0:::15:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=11 cursor=11:89d3ae78:::11:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=5 cursor=11:b29083e3:::5:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=8 cursor=11:bd63b0f1:::8:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=6 cursor=11:c4fdafeb:::6:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=3 cursor=11:cfc208b3:::3:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=4 cursor=11:d83876eb:::4:head 2023-12-19T09:46:27.024 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=12 cursor=11:de5d7c5f:::12:head 2023-12-19T09:46:27.025 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=9 cursor=11:e960b815:::9:head 2023-12-19T09:46:27.025 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > oid=2 cursor=11:f905c69b:::2:head 2023-12-19T09:46:27.025 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: FIRST> seek to MIN oid=1 2023-12-19T09:46:27.025 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=1 cursor=11:02547ec2:::1:head 2023-12-19T09:46:27.025 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:02547ec2:::1:head 2023-12-19T09:46:27.025 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:02547ec2:::1:head -> 1 2023-12-19T09:46:27.025 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=10 cursor=11:52ea6a34:::10:head 2023-12-19T09:47:09.104 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:52ea6a open_pools_parallel: process_1_[85093]: starting. 2023-12-19T09:47:09.104 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_1_[85093]: creating pool ceph_test_rados_open_pools_parallel.smithi099-85057 2023-12-19T09:47:09.104 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_1_[85093]: created object 0... 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_1_[85093]: created object 25... 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_1_[85093]: created object 49... 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_1_[85093]: finishing. 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_1_[85093]: shutting down. 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_2_[85094]: starting. 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_2_[85094]: rados_pool_create. 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_2_[85094]: rados_ioctx_create. 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_2_[85094]: shutting down. 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: ******************************* 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_3_[148225]: starting. 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_3_[148225]: creating pool ceph_test_rados_open_pools_parallel.smithi099-85057 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_3_[148225]: created object 0... 2023-12-19T09:47:09.105 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_3_[148225]: created object 25... 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_3_[148225]: created object 49... 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_3_[148225]: finishing. 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_3_[148225]: shutting down. 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: ******************************* 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_4_[148226]: starting. 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_4_[148226]: rados_pool_create. 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_4_[148226]: rados_ioctx_create. 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: process_4_[148226]: shutting down. 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: ******************************* 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: ******************************* 2023-12-19T09:47:09.106 INFO:tasks.workunit.client.0.smithi099.stdout: open_pools_parallel: ******* SUCCESS ********** 2023-12-19T09:48:38.265 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_1_[85151]: starting. 2023-12-19T09:48:38.265 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_1_[85151]: creating pool ceph_test_rados_delete_pools_parallel.smithi099-85103 2023-12-19T09:48:38.265 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_1_[85151]: created object 0... 2023-12-19T09:48:38.265 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_1_[85151]: created object 25... 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_1_[85151]: created object 49... 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_1_[85151]: finishing. 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_1_[85151]: shutting down. 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_2_[85154]: starting. 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_2_[85154]: deleting pool ceph_test_rados_delete_pools_parallel.smithi099-85103 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_2_[85154]: shutting down. 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: ******************************* 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_3_[148136]: starting. 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_3_[148136]: creating pool ceph_test_rados_delete_pools_parallel.smithi099-85103 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_3_[148136]: created object 0... 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_3_[148136]: created object 25... 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_3_[148136]: created object 49... 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_3_[148136]: finishing. 2023-12-19T09:48:38.266 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_3_[148136]: shutting down. 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: ******************************* 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_5_[148138]: starting. 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_5_[148138]: listing objects. 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_5_[148138]: listed object 0... 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_5_[148138]: listed object 25... 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_5_[148138]: saw 50 objects 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_5_[148138]: shutting down. 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: ******************************* 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_4_[148137]: starting. 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_4_[148137]: deleting pool ceph_test_rados_delete_pools_parallel.smithi099-85103 2023-12-19T09:48:38.267 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: process_4_[148137]: shutting down. 2023-12-19T09:48:38.268 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: ******************************* 2023-12-19T09:48:38.268 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: ******************************* 2023-12-19T09:48:38.268 INFO:tasks.workunit.client.0.smithi099.stdout: delete_pools_parallel: ******* SUCCESS ********** 2023-12-19T09:48:38.269 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84656 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84656 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84540 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84540 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84333 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84333 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84590 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84590 2023-12-19T09:48:38.270 INFO:tasks.workunit.client.0.smithi099.stdout:error in api_watch_notify_pp (84590) 2023-12-19T09:48:38.271 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo 'error in api_watch_notify_pp (84590)' 2023-12-19T09:48:38.271 INFO:tasks.workunit.client.0.smithi099.stderr:+ ret=1 2023-12-19T09:48:38.271 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:48:38.271 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84352 2023-12-19T09:48:38.271 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84352 2023-12-19T09:48:47.520 INFO:tasks.workunit.client.0.smithi099.stdout:34:::10:head 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:52ea6a34:::10:head -> 10 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=13 cursor=11:566253c9:::13:head 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:566253c9:::13:head 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:566253c9:::13:head -> 13 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=7 cursor=11:5c6b0b28:::7:head 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:5c6b0b28:::7:head 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:5c6b0b28:::7:head -> 7 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=14 cursor=11:62a1935d:::14:head 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:62a1935d:::14:head 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:62a1935d:::14:head -> 14 2023-12-19T09:48:47.521 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=0 cursor=11:6cac518f:::0:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:6cac518f:::0:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:6cac518f:::0:head -> 0 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=15 cursor=11:863748b0:::15:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:863748b0:::15:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:863748b0:::15:head -> 15 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=11 cursor=11:89d3ae78:::11:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:89d3ae78:::11:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:89d3ae78:::11:head -> 11 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=5 cursor=11:b29083e3:::5:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:b29083e3:::5:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:b29083e3:::5:head -> 5 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=8 cursor=11:bd63b0f1:::8:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:bd63b0f1:::8:head 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:bd63b0f1:::8:head -> 8 2023-12-19T09:48:47.522 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=6 cursor=11:c4fdafeb:::6:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:c4fdafeb:::6:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:c4fdafeb:::6:head -> 6 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=3 cursor=11:cfc208b3:::3:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:cfc208b3:::3:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:cfc208b3:::3:head -> 3 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=4 cursor=11:d83876eb:::4:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:d83876eb:::4:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:d83876eb:::4:head -> 4 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=12 cursor=11:de5d7c5f:::12:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:de5d7c5f:::12:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:de5d7c5f:::12:head -> 12 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=9 cursor=11:e960b815:::9:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:e960b815:::9:head 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:e960b815:::9:head -> 9 2023-12-19T09:48:47.523 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : oid=2 cursor=11:f905c69b:::2:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:f905c69b:::2:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:f905c69b:::2:head -> 2 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:02547ec2:::1:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:02547ec2:::1:head expected=11:02547ec2:::1:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:02547ec2:::1:head -> 1 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=1 expected=1 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:f905c69b:::2:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:f905c69b:::2:head expected=11:f905c69b:::2:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:f905c69b:::2:head -> 2 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=2 expected=2 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:e960b815:::9:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:e960b815:::9:head expected=11:e960b815:::9:head 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:e960b815:::9:head -> 9 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=9 expected=9 2023-12-19T09:48:47.524 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:de5d7c5f:::12:head 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:de5d7c5f:::12:head expected=11:de5d7c5f:::12:head 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:de5d7c5f:::12:head -> 12 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=12 expected=12 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:d83876eb:::4:head 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:d83876eb:::4:head expected=11:d83876eb:::4:head 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:d83876eb:::4:head -> 4 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=4 expected=4 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:cfc208b3:::3:head 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:cfc208b3:::3:head expected=11:cfc208b3:::3:head 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:cfc208b3:::3:head -> 3 2023-12-19T09:48:47.525 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=3 expected=3 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : s api_aio: Running main() from gmock_main.cc 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [----------] Global test environment set-up. 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [----------] 26 tests from LibRadosAio 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2476 ms) 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2023-12-19T09:49:20.145 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (9023 ms) 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (7030 ms) 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (6890 ms) 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (9036 ms) 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (31991 ms) 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (12011 ms) 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (7029 ms) 2023-12-19T09:49:20.146 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (5023 ms) 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (17989 ms) 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (17088 ms) 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (5022 ms) 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (21114 ms) 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (14788 ms) 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2023-12-19T09:49:20.147 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.Flush (8007 ms) 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (34994 ms) 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (14053 ms) 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (37954 ms) 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (18998 ms) 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (12299 ms) 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (38036 ms) 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2023-12-19T09:49:20.148 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (21689 ms) 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (39275 ms) 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (38893 ms) 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (9159 ms) 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (18667 ms) 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [----------] 26 tests from LibRadosAio (458534 ms total) 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2023-12-19T09:49:20.149 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1100: Skipped 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1132: Skipped 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1149: Skipped 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1182: Skipped 2023-12-19T09:49:20.150 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1215: Skipped 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1286: Skipped 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1326: Skipped 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2023-12-19T09:49:20.151 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2023-12-19T09:49:20.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1366: Skipped 2023-12-19T09:49:20.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2023-12-19T09:49:20.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2023-12-19T09:49:20.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1385: Skipped 2023-12-19T09:49:20.152 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1415: Skipped 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1454: Skipped 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2023-12-19T09:49:20.153 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1498: Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1532: Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1593: Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1649: Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.154 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio.cc:1681: Skipped 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: Not supported by crimson yet. Skipped 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (0 ms total) 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [----------] Global test environment tear-down 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (458534 ms total) 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ PASSED ] 26 tests. 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] 16 tests, listed below: 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleWrite 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.WaitForComplete 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip 2023-12-19T09:49:20.155 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTrip2 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripAppend 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsComplete 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.IsSafe 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ReturnValue 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.Flush 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.FlushAsync 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStat 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.SimpleStatNS 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.StatRemove 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.ExecuteClass 2023-12-19T09:49:20.156 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio: [ SKIPPED ] LibRadosAioEC.MultiWrite 2023-12-19T09:51:16.179 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Running main() from gmock_main.cc 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] Global test environment set-up. 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2471 ms) 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (26952 ms) 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (51045 ms) 2023-12-19T09:51:16.180 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (10036 ms) 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (14975 ms) 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (25124 ms) 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (25855 ms) 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (11983 ms) 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (24159 ms) 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (13890 ms) 2023-12-19T09:51:16.181 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (10033 ms) 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (30127 ms) 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (15821 ms) 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (7003 ms) 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (16297 ms) 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (46076 ms) 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (12645 ms) 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2023-12-19T09:51:16.182 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (27413 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (35602 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (20182 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (12174 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (31965 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (12710 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (29012 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (14325 ms) 2023-12-19T09:51:16.183 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2023-12-19T09:51:16.184 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (16679 ms) 2023-12-19T09:51:16.184 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2023-12-19T09:52:44.496 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [eek to 11:c4fdafeb:::6:head 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:c4fdafeb:::6:head expected=11:c4fdafeb:::6:head 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:c4fdafeb:::6:head -> 6 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=6 expected=6 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:bd63b0f1:::8:head 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:bd63b0f1:::8:head expected=11:bd63b0f1:::8:head 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:bd63b0f1:::8:head -> 8 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=8 expected=8 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:b29083e3:::5:head 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:b29083e3:::5:head expected=11:b29083e3:::5:head 2023-12-19T09:52:44.497 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:b29083e3:::5:head -> 5 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=5 expected=5 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:89d3ae78:::11:head 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:89d3ae78:::11:head expected=11:89d3ae78:::11:head 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:89d3ae78:::11:head -> 11 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=11 expected=11 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:863748b0:::15:head 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:863748b0:::15:head expected=11:863748b0:::15:head 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:863748b0:::15:head -> 15 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=15 expected=15 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:6cac518f:::0:head 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:6cac518f:::0:head expected=11:6cac518f:::0:head 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:6cac518f:::0:head -> 0 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=0 expected=0 2023-12-19T09:52:44.498 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:62a1935d:::14:head 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:62a1935d:::14:head expected=11:62a1935d:::14:head 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:62a1935d:::14:head -> 14 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=14 expected=14 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:5c6b0b28:::7:head 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:5c6b0b28:::7:head expected=11:5c6b0b28:::7:head 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:5c6b0b28:::7:head -> 7 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=7 expected=7 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:566253c9:::13:head 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:566253c9:::13:head expected=11:566253c9:::13:head 2023-12-19T09:52:44.499 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:566253c9:::13:head -> 13 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=13 expected=13 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : seek to 11:52ea6a34:::10:head 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : cursor()=11:52ea6a34:::10:head expected=11:52ea6a34:::10:head 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: > 11:52ea6a34:::10:head -> 10 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: : entry=10 expected=10 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (376733 ms) 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (30853 ms) 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: split 0/5 -> MIN 11:33333333::::head 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: split 1/5 -> 11:33333333::::head 11:66666666::::head 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: split 2/5 -> 11:66666666::::head 11:99999999::::head 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: split 3/5 -> 11:99999999::::head 11:cccccccc::::head 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: split 4/5 -> 11:cccccccc::::head MAX 2023-12-19T09:52:44.500 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (88344 ms) 2023-12-19T09:52:44.501 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] 7 tests from LibRadosList (661212 ms total) 2023-12-19T09:52:44.501 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 2023-12-19T09:52:44.501 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] 3 tests from LibRadosListEC 2023-12-19T09:52:44.501 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:70: Skipped 2023-12-19T09:52:44.501 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:52:44.501 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2023-12-19T09:53:10.242 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:84: Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:96: Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:84: Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:96: Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2023-12-19T09:53:10.243 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:84: Skipped 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:96: Skipped 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/TestCase.cc:78: Skipped 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: Not supported by crimson yet. Skipped 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] 3 tests from LibRadosListEC (0 ms total) 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] 1 test from LibRadosListNP 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (25742 ms) 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] 1 test from LibRadosListNP (25743 ms total) 2023-12-19T09:53:10.244 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: 2023-12-19T09:53:10.245 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [----------] Global test environment tear-down 2023-12-19T09:53:10.245 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [==========] 11 tests from 3 test suites ran. (688554 ms total) 2023-12-19T09:53:10.245 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ PASSED ] 8 tests. 2023-12-19T09:53:10.245 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ SKIPPED ] 3 tests, listed below: 2023-12-19T09:53:10.245 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ SKIPPED ] LibRadosListEC.ListObjects 2023-12-19T09:53:10.245 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ SKIPPED ] LibRadosListEC.ListObjectsNS 2023-12-19T09:53:10.245 INFO:tasks.workunit.client.0.smithi099.stdout: api_list: [ SKIPPED ] LibRadosListEC.ListObjectsStart 2023-12-19T09:54:17.562 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: Running main() from gmock_main.cc 2023-12-19T09:54:17.562 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2023-12-19T09:54:17.562 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [----------] Global test environment set-up. 2023-12-19T09:54:17.562 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (12239 ms) 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (8036 ms) 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (11889 ms) 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (46024 ms) 2023-12-19T09:54:17.563 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (13059 ms) 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (22015 ms) 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (642419 ms) 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (755681 ms total) 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [----------] Global test environment tear-down 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (755681 ms total) 2023-12-19T09:54:17.564 INFO:tasks.workunit.client.0.smithi099.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2023-12-19T09:54:26.007 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_1_[85099]: starting. 2023-12-19T09:54:26.007 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_1_[85099]: creating pool ceph_test_rados_list_parallel.smithi099-85073 2023-12-19T09:54:26.007 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_1_[85099]: created object 0... 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_1_[85099]: created object 25... 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_1_[85099]: created object 49... 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_1_[85099]: finishing. 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_1_[85099]: shutting down. 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_2_[85100]: starting. 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_2_[85100]: listing objects. 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_2_[85100]: listed object 0... 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_2_[85100]: listed object 25... 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_2_[85100]: saw 50 objects 2023-12-19T09:54:26.008 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_2_[85100]: shutting down. 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_3_[148085]: starting. 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_3_[148085]: creating pool ceph_test_rados_list_parallel.smithi099-85073 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_3_[148085]: created object 0... 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_3_[148085]: created object 25... 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_3_[148085]: created object 49... 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_3_[148085]: finishing. 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_3_[148085]: shutting down. 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.009 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_4_[148086]: starting. 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_4_[148086]: listing objects. 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_4_[148086]: listed object 0... 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_4_[148086]: listed object 25... 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_4_[148086]: saw 48 objects 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_4_[148086]: shutting down. 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_5_[148087]: starting. 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_5_[148087]: removed 25 objects... 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_5_[148087]: removed half of the objects 2023-12-19T09:54:26.010 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_5_[148087]: removed 50 objects... 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_5_[148087]: removed 50 objects 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_5_[148087]: shutting down. 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_6_[148786]: starting. 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_6_[148786]: creating pool ceph_test_rados_list_parallel.smithi099-85073 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_6_[148786]: created object 0... 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_6_[148786]: created object 25... 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_6_[148786]: created object 49... 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_6_[148786]: finishing. 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_6_[148786]: shutting down. 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.011 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_7_[148787]: starting. 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_7_[148787]: listing objects. 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_7_[148787]: listed object 0... 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_7_[148787]: listed object 25... 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_7_[148787]: listed object 50... 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_7_[148787]: saw 54 objects 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_7_[148787]: shutting down. 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_8_[148788]: starting. 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_8_[148788]: added 25 objects... 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_8_[148788]: added half of the objects 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_8_[148788]: added 50 objects... 2023-12-19T09:54:26.012 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_8_[148788]: added 50 objects 2023-12-19T09:54:26.013 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_8_[148788]: shutting down. 2023-12-19T09:54:26.013 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:54:26.013 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:56:04.259 INFO:tasks.workunit.client.0.smithi099.stdout: OK ] LibRadosAio.RoundTripAppendPP (30010 ms) 2023-12-19T09:56:04.259 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (26349 ms) 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (12673 ms) 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (39120 ms) 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: setting pool EIO 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: waiting for 1000 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: waiting for 1000 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: waiting for 1000 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: max_success 0, min_failed 1 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (15885 ms) 2023-12-19T09:56:04.260 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (28017 ms) 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (696608 ms total) 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (35997 ms) 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (36389 ms) 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (37704 ms) 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2023-12-19T09:56:04.261 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (45944 ms) 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (156034 ms total) 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (10001 ms) 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (10001 ms total) 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1384: Skipped 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2023-12-19T09:56:04.262 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1419: Skipped 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1436: Skipped 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1467: Skipped 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2023-12-19T09:56:04.263 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1500: Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1605: Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1637: Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1705: Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.264 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1742: Skipped 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1780: Skipped 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1796: Skipped 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2023-12-19T09:56:04.265 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1824: Skipped 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1859: Skipped 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1904: Skipped 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2023-12-19T09:56:04.266 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1946: Skipped 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:1977: Skipped 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:2008: Skipped 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:2059: Skipped 2023-12-19T09:56:04.267 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:2089: Skipped 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/aio_cxx.cc:2124: Skipped 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (0 ms total) 2023-12-19T09:56:04.268 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [----------] Global test environment tear-down 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (862643 ms total) 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ PASSED ] 37 tests. 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] 20 tests, listed below: 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.SimpleWritePP 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.WaitForSafePP 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripPP 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripPP2 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripPP3 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2023-12-19T09:56:04.269 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.IsCompletePP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.IsSafePP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.ReturnValuePP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.FlushPP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.SimpleStatPP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.StatRemovePP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.OmapPP 2023-12-19T09:56:04.270 INFO:tasks.workunit.client.0.smithi099.stdout: api_aio_pp: [ SKIPPED ] LibRadosAioEC.MultiWritePP 2023-12-19T09:56:07.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2023-12-19T09:56:07.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] Global test environment set-up. 2023-12-19T09:56:07.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2023-12-19T09:56:07.043 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: seed 84401 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:41:41.698+0000 7fadb326b7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:41:41.698+0000 7fadb326b7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:41:41.698+0000 7fadb326b7c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (12035 ms) 2023-12-19T09:56:07.044 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (2718 ms) 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (4103 ms) 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (100 ms) 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (1110 ms) 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (1599 ms) 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (1208 ms) 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (494 ms) 2023-12-19T09:56:07.045 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (1467 ms) 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (1986 ms) 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (1939 ms) 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (58 ms) 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: osd_max_attr_size = 0 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (835140 ms) 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/misc_cxx.cc:386: Skipped 2023-12-19T09:56:07.046 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:07.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2023-12-19T09:56:07.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2023-12-19T09:56:07.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/misc_cxx.cc:549: Skipped 2023-12-19T09:56:07.047 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:59.630 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (27 ms) 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (13 ms) 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4185 ms) 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2023-12-19T09:56:59.631 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (868183 ms total) 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/misc_cxx.cc:476: Skipped 2023-12-19T09:56:59.632 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/misc_cxx.cc:498: Skipped 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/misc_cxx.cc:504: Skipped 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/misc_cxx.cc:491: Skipped 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:56:59.633 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2023-12-19T09:56:59.634 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:56:59.634 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2023-12-19T09:56:59.634 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2023-12-19T09:56:59.634 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (10951 ms) 2023-12-19T09:56:59.634 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (6187 ms) 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (17138 ms total) 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (14569 ms) 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (10367 ms) 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (24936 ms total) 2023-12-19T09:56:59.635 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:57:19.293 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::cr list_parallel: ******************************* 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_9_[148949]: starting. 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_9_[148949]: creating pool ceph_test_rados_list_parallel.smithi099-85073 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_9_[148949]: created object 0... 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_9_[148949]: created object 25... 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_9_[148949]: created object 49... 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_9_[148949]: finishing. 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_9_[148949]: shutting down. 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.294 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: starting. 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: listing objects. 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: listed object 0... 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: listed object 25... 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: listed object 50... 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: listed object 75... 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: saw 99 objects 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_10_[148950]: shutting down. 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_13_[148953]: starting. 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_13_[148953]: removed 25 objects... 2023-12-19T09:57:19.295 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_13_[148953]: removed half of the objects 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_13_[148953]: removed 50 objects... 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_13_[148953]: removed 50 objects 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_13_[148953]: shutting down. 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_12_[148952]: starting. 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_12_[148952]: added 25 objects... 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_12_[148952]: added half of the objects 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_12_[148952]: added 50 objects... 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_12_[148952]: added 50 objects 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_12_[148952]: shutting down. 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.296 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_11_[148951]: starting. 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_11_[148951]: added 25 objects... 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_11_[148951]: added half of the objects 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_11_[148951]: added 50 objects... 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_11_[148951]: added 50 objects 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_11_[148951]: shutting down. 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.297 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_14_[149319]: starting. 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_14_[149319]: creating pool ceph_test_rados_list_parallel.smithi099-85073 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_14_[149319]: created object 0... 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_14_[149319]: created object 25... 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_14_[149319]: created object 49... 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_14_[149319]: finishing. 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_14_[149319]: shutting down. 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: starting. 2023-12-19T09:57:19.298 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: listing objects. 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: listed object 0... 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: listed object 25... 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: listed object 50... 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: listed object 75... 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: listed object 100... 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: listed object 125... 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: saw 150 objects 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_15_[149320]: shutting down. 2023-12-19T09:57:19.556 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_16_[149321]: starting. 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_16_[149321]: added 25 objects... 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_16_[149321]: added half of the objects 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_16_[149321]: added 50 objects... 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_16_[149321]: added 50 objects 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: process_16_[149321]: shutting down. 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.557 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******************************* 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout: list_parallel: ******* SUCCESS ********** 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout:c32c, ceph_le > 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (17361 ms) 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (26 ms) 2023-12-19T09:57:19.558 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (17387 ms total) 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:373: Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:387: Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:400: Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-231-g729869e4/rpm/el9/BUILD/ceph-19.0.0-231-g729869e4/src/test/librados/testcase_cxx.cc:381: Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: Not supported by crimson yet. Skipped 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (0 ms total) 2023-12-19T09:57:19.559 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [----------] Global test environment tear-down 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (937856 ms total) 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ PASSED ] 27 tests. 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] 4 tests, listed below: 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyPP 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2023-12-19T09:57:19.560 INFO:tasks.workunit.client.0.smithi099.stdout: api_misc_pp: [ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2023-12-19T09:57:19.563 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.563 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84869 2023-12-19T09:57:19.563 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84869 2023-12-19T09:57:19.563 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.563 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84217 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84217 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84280 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84280 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84915 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84915 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84208 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84208 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84230 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84230 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84498 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84498 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84566 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84566 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84509 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84509 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84937 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84937 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84826 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84826 2023-12-19T09:57:19.565 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84383 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84383 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84708 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84708 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84201 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84201 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84261 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84261 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84627 2023-12-19T09:57:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84627 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84303 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84303 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84724 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84724 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ for t in "${!pids[@]}" 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ pid=84734 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ wait 84734 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ exit 1 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ cleanup 2023-12-19T09:57:19.567 INFO:tasks.workunit.client.0.smithi099.stderr:+ pkill -P 84196 2023-12-19T09:57:19.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:57:19.580 INFO:tasks.workunit.client.0.smithi099.stderr:+ true 2023-12-19T09:57:19.581 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2023-12-19T09:57:19.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-19T09:57:19.880 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=729869e4a72e72e756b33d15b6f2fbf113fa1a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-12-19T09:57:19.955 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=ac175a4eea8745cd992444fca1c28732 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_Matan-B_ceph_729869e4a72e72e756b33d15b6f2fbf113fa1a2d/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rados/test.sh) on smithi099 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=729869e4a72e72e756b33d15b6f2fbf113fa1a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-12-19T09:57:19.958 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T09:57:19.967 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T09:57:19.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T09:57:20.083 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.080+0000 7f574126d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:20.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.084+0000 7f574126d640 1 Processor -- start 2023-12-19T09:57:20.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.084+0000 7f574126d640 1 -- start start 2023-12-19T09:57:20.084 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f574126d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f573c133690 0x7f573c1392d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f574126d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0a1870 con 0x7f573c0a1040 2023-12-19T09:57:20.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f574126d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c09cb90 con 0x7f573c133690 2023-12-19T09:57:20.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f573a7fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f573c133690 0x7f573c1392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f573affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f573c0a1040 0x7f573c132f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50390/0 (socket says 172.21.15.99:50390) 2023-12-19T09:57:20.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f573affd640 1 -- 172.21.15.99:0/71008518 learned_addr learned my addr 172.21.15.99:0/71008518 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:20.085 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f573a7fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f573c133690 0x7f573c1392d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51406/0 (socket says 172.21.15.99:51406) 2023-12-19T09:57:20.086 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f573a7fc640 1 -- 172.21.15.99:0/71008518 >> v1:172.21.15.99:6789/0 conn(0x7f573c0a1040 legacy=0x7f573c132f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f5739ffb640 1 -- 172.21.15.99:0/71008518 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513838591 0 0) 0x7f573c0a1870 con 0x7f573c0a1040 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.085+0000 7f573a7fc640 1 -- 172.21.15.99:0/71008518 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c1300a0 con 0x7f573c133690 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.086+0000 7f573a7fc640 1 --2- 172.21.15.99:0/71008518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c133690 0x7f573c1392d0 crc :-1 s=READY pgs=12653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb0920325c46bc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.086+0000 7f5739ffb640 1 -- 172.21.15.99:0/71008518 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5730009ce0 con 0x7f573c133690 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.086+0000 7f5739ffb640 1 -- 172.21.15.99:0/71008518 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5730009e40 con 0x7f573c133690 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.086+0000 7f5739ffb640 1 -- 172.21.15.99:0/71008518 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f573000e360 con 0x7f573c133690 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 1 -- 172.21.15.99:0/71008518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c133690 msgr2=0x7f573c1392d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.087 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 1 --2- 172.21.15.99:0/71008518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c133690 0x7f573c1392d0 crc :-1 s=READY pgs=12653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.088 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 1 -- 172.21.15.99:0/71008518 shutdown_connections 2023-12-19T09:57:20.088 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 1 --2- 172.21.15.99:0/71008518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c133690 0x7f573c1392d0 unknown :-1 s=CLOSED pgs=12653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.088 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 1 -- 172.21.15.99:0/71008518 >> 172.21.15.99:0/71008518 conn(0x7f573c06c9c0 msgr2=0x7f573c06cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:20.088 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 1 -- 172.21.15.99:0/71008518 shutdown_connections 2023-12-19T09:57:20.088 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 1 -- 172.21.15.99:0/71008518 wait complete. 2023-12-19T09:57:20.088 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.087+0000 7f574126d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:20.090 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.088+0000 7f574126d640 1 Processor -- start 2023-12-19T09:57:20.090 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.088+0000 7f574126d640 1 -- start start 2023-12-19T09:57:20.090 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.089+0000 7f574126d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0a1040 0x7f573c11b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.090 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.089+0000 7f574126d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c11d180 con 0x7f573c0a1040 2023-12-19T09:57:20.090 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.089+0000 7f573affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0a1040 0x7f573c11b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.089+0000 7f573affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0a1040 0x7f573c11b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51412/0 (socket says 172.21.15.99:51412) 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.089+0000 7f573affd640 1 -- 172.21.15.99:0/3410955404 learned_addr learned my addr 172.21.15.99:0/3410955404 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.089+0000 7f573affd640 1 -- 172.21.15.99:0/3410955404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c12f640 con 0x7f573c0a1040 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.090+0000 7f573affd640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0a1040 0x7f573c11b860 crc :-1 s=READY pgs=12654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.090+0000 7f57237fe640 1 -- 172.21.15.99:0/3410955404 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f572c004af0 con 0x7f573c0a1040 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.090+0000 7f57237fe640 1 -- 172.21.15.99:0/3410955404 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f572c004c50 con 0x7f573c0a1040 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.090+0000 7f57237fe640 1 -- 172.21.15.99:0/3410955404 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f572c007120 con 0x7f573c0a1040 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.090+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c11da60 con 0x7f573c0a1040 2023-12-19T09:57:20.091 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.090+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c11eb90 con 0x7f573c0a1040 2023-12-19T09:57:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.091+0000 7f57237fe640 1 -- 172.21.15.99:0/3410955404 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f572c0072d0 con 0x7f573c0a1040 2023-12-19T09:57:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.091+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c11ddd0 con 0x7f573c0a1040 2023-12-19T09:57:20.092 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.091+0000 7f57237fe640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f5728037810 0x7f5728039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.091+0000 7f57237fe640 1 -- 172.21.15.99:0/3410955404 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7f572c0471c0 con 0x7f573c0a1040 2023-12-19T09:57:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.092+0000 7f573a7fc640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f5728037810 0x7f5728039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.092+0000 7f573a7fc640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f5728037810 0x7f5728039d20 crc :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.096 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.096+0000 7f57237fe640 1 -- 172.21.15.99:0/3410955404 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f572c00a940 con 0x7f573c0a1040 2023-12-19T09:57:20.273 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.273+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f573c12fd90 con 0x7f5728037810 2023-12-19T09:57:20.281 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.279+0000 7f57237fe640 1 -- 172.21.15.99:0/3410955404 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+184177 (crc 0 0 0) 0x7f573000e510 con 0x7f5728037810 2023-12-19T09:57:20.283 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:57:20.284 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2023-12-19T09:57:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.281+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f5728037810 msgr2=0x7f5728039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.281+0000 7f574126d640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f5728037810 0x7f5728039d20 crc :-1 s=READY pgs=3642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.281+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0a1040 msgr2=0x7f573c11b860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.281+0000 7f574126d640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0a1040 0x7f573c11b860 crc :-1 s=READY pgs=12654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.281+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 shutdown_connections 2023-12-19T09:57:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.282+0000 7f574126d640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f5728037810 0x7f5728039d20 unknown :-1 s=CLOSED pgs=3642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.282+0000 7f574126d640 1 --2- 172.21.15.99:0/3410955404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f573c0a1040 0x7f573c11b860 unknown :-1 s=CLOSED pgs=12654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.282+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 >> 172.21.15.99:0/3410955404 conn(0x7f573c06c9c0 msgr2=0x7f573c0a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.282+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 shutdown_connections 2023-12-19T09:57:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.282+0000 7f574126d640 1 -- 172.21.15.99:0/3410955404 wait complete. 2023-12-19T09:57:20.294 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1180,"stamp":"2023-12-19T09:57:19.553635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591397,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":152,"num_write_kb":1909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":355632,"kb_used_data":29904,"kb_used_omap":0,"kb_used_meta":325696,"kb_avail":419074768,"statfs":{"total":429496729600,"available":429132562432,"internally_reserved":0,"allocated":30621696,"data_stored":18960138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":333512704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17451,"num_objects":-122,"num_object_clones":0,"num_object_copies":-244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-372,"num_write_kb":-372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.058014"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.215434+0000","last_change":"2023-12-19T09:41:43.996729+0000","last_active":"2023-12-19T09:57:15.215434+0000","last_peered":"2023-12-19T09:57:15.215434+0000","last_clean":"2023-12-19T09:57:15.215434+0000","last_became_active":"2023-12-19T09:41:43.988867+0000","last_became_peered":"2023-12-19T09:41:43.988867+0000","last_unstale":"2023-12-19T09:57:15.215434+0000","last_undegraded":"2023-12-19T09:57:15.215434+0000","last_fullsized":"2023-12-19T09:57:15.215434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.974542+0000","last_change":"2023-12-19T09:41:49.091716+0000","last_active":"2023-12-19T09:57:15.974542+0000","last_peered":"2023-12-19T09:57:15.974542+0000","last_clean":"2023-12-19T09:57:15.974542+0000","last_became_active":"2023-12-19T09:41:49.078919+0000","last_became_peered":"2023-12-19T09:41:49.078919+0000","last_unstale":"2023-12-19T09:57:15.974542+0000","last_undegraded":"2023-12-19T09:57:15.974542+0000","last_fullsized":"2023-12-19T09:57:15.974542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.776271+0000","last_change":"2023-12-19T09:41:44.097849+0000","last_active":"2023-12-19T09:57:17.776271+0000","last_peered":"2023-12-19T09:57:17.776271+0000","last_clean":"2023-12-19T09:57:17.776271+0000","last_became_active":"2023-12-19T09:41:44.070813+0000","last_became_peered":"2023-12-19T09:41:44.070813+0000","last_unstale":"2023-12-19T09:57:17.776271+0000","last_undegraded":"2023-12-19T09:57:17.776271+0000","last_fullsized":"2023-12-19T09:57:17.776271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.830375+0000","last_change":"2023-12-19T09:41:47.646204+0000","last_active":"2023-12-19T09:57:17.830375+0000","last_peered":"2023-12-19T09:57:17.830375+0000","last_clean":"2023-12-19T09:57:17.830375+0000","last_became_active":"2023-12-19T09:41:47.638438+0000","last_became_peered":"2023-12-19T09:41:47.638438+0000","last_unstale":"2023-12-19T09:57:17.830375+0000","last_undegraded":"2023-12-19T09:57:17.830375+0000","last_fullsized":"2023-12-19T09:57:17.830375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.060098+0000","last_change":"2023-12-19T09:41:44.414780+0000","last_active":"2023-12-19T09:57:16.060098+0000","last_peered":"2023-12-19T09:57:16.060098+0000","last_clean":"2023-12-19T09:57:16.060098+0000","last_became_active":"2023-12-19T09:41:44.399400+0000","last_became_peered":"2023-12-19T09:41:44.399400+0000","last_unstale":"2023-12-19T09:57:16.060098+0000","last_undegraded":"2023-12-19T09:57:16.060098+0000","last_fullsized":"2023-12-19T09:57:16.060098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.272185+0000","last_change":"2023-12-19T09:41:48.952590+0000","last_active":"2023-12-19T09:57:16.272185+0000","last_peered":"2023-12-19T09:57:16.272185+0000","last_clean":"2023-12-19T09:57:16.272185+0000","last_became_active":"2023-12-19T09:41:48.947301+0000","last_became_peered":"2023-12-19T09:41:48.947301+0000","last_unstale":"2023-12-19T09:57:16.272185+0000","last_undegraded":"2023-12-19T09:57:16.272185+0000","last_fullsized":"2023-12-19T09:57:16.272185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.637016+0000","last_change":"2023-12-19T09:41:44.707713+0000","last_active":"2023-12-19T09:57:17.637016+0000","last_peered":"2023-12-19T09:57:17.637016+0000","last_clean":"2023-12-19T09:57:17.637016+0000","last_became_active":"2023-12-19T09:41:44.695211+0000","last_became_peered":"2023-12-19T09:41:44.695211+0000","last_unstale":"2023-12-19T09:57:17.637016+0000","last_undegraded":"2023-12-19T09:57:17.637016+0000","last_fullsized":"2023-12-19T09:57:17.637016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.810718+0000","last_change":"2023-12-19T09:41:48.985139+0000","last_active":"2023-12-19T09:57:15.810718+0000","last_peered":"2023-12-19T09:57:15.810718+0000","last_clean":"2023-12-19T09:57:15.810718+0000","last_became_active":"2023-12-19T09:41:48.981358+0000","last_became_peered":"2023-12-19T09:41:48.981358+0000","last_unstale":"2023-12-19T09:57:15.810718+0000","last_undegraded":"2023-12-19T09:57:15.810718+0000","last_fullsized":"2023-12-19T09:57:15.810718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.497635+0000","last_change":"2023-12-19T09:41:44.014471+0000","last_active":"2023-12-19T09:57:17.497635+0000","last_peered":"2023-12-19T09:57:17.497635+0000","last_clean":"2023-12-19T09:57:17.497635+0000","last_became_active":"2023-12-19T09:41:44.010134+0000","last_became_peered":"2023-12-19T09:41:44.010134+0000","last_unstale":"2023-12-19T09:57:17.497635+0000","last_undegraded":"2023-12-19T09:57:17.497635+0000","last_fullsized":"2023-12-19T09:57:17.497635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.a","version":"48'3","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.788019+0000","last_change":"2023-12-19T09:41:50.049917+0000","last_active":"2023-12-19T09:57:17.788019+0000","last_peered":"2023-12-19T09:57:17.788019+0000","last_clean":"2023-12-19T09:57:17.788019+0000","last_became_active":"2023-12-19T09:41:50.042450+0000","last_became_peered":"2023-12-19T09:41:50.042450+0000","last_unstale":"2023-12-19T09:57:17.788019+0000","last_undegraded":"2023-12-19T09:57:17.788019+0000","last_fullsized":"2023-12-19T09:57:17.788019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.032342+0000","last_change":"2023-12-19T09:41:44.728818+0000","last_active":"2023-12-19T09:57:18.032342+0000","last_peered":"2023-12-19T09:57:18.032342+0000","last_clean":"2023-12-19T09:57:18.032342+0000","last_became_active":"2023-12-19T09:41:44.723909+0000","last_became_peered":"2023-12-19T09:41:44.723909+0000","last_unstale":"2023-12-19T09:57:18.032342+0000","last_undegraded":"2023-12-19T09:57:18.032342+0000","last_fullsized":"2023-12-19T09:57:18.032342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1200,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.576213+0000","last_change":"2023-12-19T09:41:47.838325+0000","last_active":"2023-12-19T09:57:17.576213+0000","last_peered":"2023-12-19T09:57:17.576213+0000","last_clean":"2023-12-19T09:57:17.576213+0000","last_became_active":"2023-12-19T09:41:47.832642+0000","last_became_peered":"2023-12-19T09:41:47.832642+0000","last_unstale":"2023-12-19T09:57:17.576213+0000","last_undegraded":"2023-12-19T09:57:17.576213+0000","last_fullsized":"2023-12-19T09:57:17.576213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.252148+0000","last_change":"2023-12-19T09:41:44.592810+0000","last_active":"2023-12-19T09:57:18.252148+0000","last_peered":"2023-12-19T09:57:18.252148+0000","last_clean":"2023-12-19T09:57:18.252148+0000","last_became_active":"2023-12-19T09:41:44.585031+0000","last_became_peered":"2023-12-19T09:41:44.585031+0000","last_unstale":"2023-12-19T09:57:18.252148+0000","last_undegraded":"2023-12-19T09:57:18.252148+0000","last_fullsized":"2023-12-19T09:57:18.252148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.229948+0000","last_change":"2023-12-19T09:41:47.669623+0000","last_active":"2023-12-19T09:57:18.229948+0000","last_peered":"2023-12-19T09:57:18.229948+0000","last_clean":"2023-12-19T09:57:18.229948+0000","last_became_active":"2023-12-19T09:41:47.651334+0000","last_became_peered":"2023-12-19T09:41:47.651334+0000","last_unstale":"2023-12-19T09:57:18.229948+0000","last_undegraded":"2023-12-19T09:57:18.229948+0000","last_fullsized":"2023-12-19T09:57:18.229948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.175349+0000","last_change":"2023-12-19T09:41:43.967186+0000","last_active":"2023-12-19T09:57:15.175349+0000","last_peered":"2023-12-19T09:57:15.175349+0000","last_clean":"2023-12-19T09:57:15.175349+0000","last_became_active":"2023-12-19T09:41:43.956781+0000","last_became_peered":"2023-12-19T09:41:43.956781+0000","last_unstale":"2023-12-19T09:57:15.175349+0000","last_undegraded":"2023-12-19T09:57:15.175349+0000","last_fullsized":"2023-12-19T09:57:15.175349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.902654+0000","last_change":"2023-12-19T09:41:50.824272+0000","last_active":"2023-12-19T09:57:16.902654+0000","last_peered":"2023-12-19T09:57:16.902654+0000","last_clean":"2023-12-19T09:57:16.902654+0000","last_became_active":"2023-12-19T09:41:50.819734+0000","last_became_peered":"2023-12-19T09:41:50.819734+0000","last_unstale":"2023-12-19T09:57:16.902654+0000","last_undegraded":"2023-12-19T09:57:16.902654+0000","last_fullsized":"2023-12-19T09:57:16.902654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.199867+0000","last_change":"2023-12-19T09:41:43.948061+0000","last_active":"2023-12-19T09:57:17.199867+0000","last_peered":"2023-12-19T09:57:17.199867+0000","last_clean":"2023-12-19T09:57:17.199867+0000","last_became_active":"2023-12-19T09:41:43.945414+0000","last_became_peered":"2023-12-19T09:41:43.945414+0000","last_unstale":"2023-12-19T09:57:17.199867+0000","last_undegraded":"2023-12-19T09:57:17.199867+0000","last_fullsized":"2023-12-19T09:57:17.199867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"30'3","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.792964+0000","last_change":"2023-12-19T09:41:48.128963+0000","last_active":"2023-12-19T09:57:16.792964+0000","last_peered":"2023-12-19T09:57:16.792964+0000","last_clean":"2023-12-19T09:57:16.792964+0000","last_became_active":"2023-12-19T09:41:48.126255+0000","last_became_peered":"2023-12-19T09:41:48.126255+0000","last_unstale":"2023-12-19T09:57:16.792964+0000","last_undegraded":"2023-12-19T09:57:16.792964+0000","last_fullsized":"2023-12-19T09:57:16.792964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.021359+0000","last_change":"2023-12-19T09:41:44.807942+0000","last_active":"2023-12-19T09:57:18.021359+0000","last_peered":"2023-12-19T09:57:18.021359+0000","last_clean":"2023-12-19T09:57:18.021359+0000","last_became_active":"2023-12-19T09:41:44.792603+0000","last_became_peered":"2023-12-19T09:41:44.792603+0000","last_unstale":"2023-12-19T09:57:18.021359+0000","last_undegraded":"2023-12-19T09:57:18.021359+0000","last_fullsized":"2023-12-19T09:57:18.021359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.730650+0000","last_change":"2023-12-19T09:41:50.700445+0000","last_active":"2023-12-19T09:57:17.730650+0000","last_peered":"2023-12-19T09:57:17.730650+0000","last_clean":"2023-12-19T09:57:17.730650+0000","last_became_active":"2023-12-19T09:41:50.697862+0000","last_became_peered":"2023-12-19T09:41:50.697862+0000","last_unstale":"2023-12-19T09:57:17.730650+0000","last_undegraded":"2023-12-19T09:57:17.730650+0000","last_fullsized":"2023-12-19T09:57:17.730650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.647865+0000","last_change":"2023-12-19T09:41:43.864107+0000","last_active":"2023-12-19T09:57:16.647865+0000","last_peered":"2023-12-19T09:57:16.647865+0000","last_clean":"2023-12-19T09:57:16.647865+0000","last_became_active":"2023-12-19T09:41:43.861579+0000","last_became_peered":"2023-12-19T09:41:43.861579+0000","last_unstale":"2023-12-19T09:57:16.647865+0000","last_undegraded":"2023-12-19T09:57:16.647865+0000","last_fullsized":"2023-12-19T09:57:16.647865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1184,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.086474+0000","last_change":"2023-12-19T09:41:46.851420+0000","last_active":"2023-12-19T09:57:15.086474+0000","last_peered":"2023-12-19T09:57:15.086474+0000","last_clean":"2023-12-19T09:57:15.086474+0000","last_became_active":"2023-12-19T09:41:46.841291+0000","last_became_peered":"2023-12-19T09:41:46.841291+0000","last_unstale":"2023-12-19T09:57:15.086474+0000","last_undegraded":"2023-12-19T09:57:15.086474+0000","last_fullsized":"2023-12-19T09:57:15.086474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.133104+0000","last_change":"2023-12-19T09:41:44.833180+0000","last_active":"2023-12-19T09:57:17.133104+0000","last_peered":"2023-12-19T09:57:17.133104+0000","last_clean":"2023-12-19T09:57:17.133104+0000","last_became_active":"2023-12-19T09:41:44.829928+0000","last_became_peered":"2023-12-19T09:41:44.829928+0000","last_unstale":"2023-12-19T09:57:17.133104+0000","last_undegraded":"2023-12-19T09:57:17.133104+0000","last_fullsized":"2023-12-19T09:57:17.133104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.496095+0000","last_change":"2023-12-19T09:41:47.003324+0000","last_active":"2023-12-19T09:57:17.496095+0000","last_peered":"2023-12-19T09:57:17.496095+0000","last_clean":"2023-12-19T09:57:17.496095+0000","last_became_active":"2023-12-19T09:41:46.996512+0000","last_became_peered":"2023-12-19T09:41:46.996512+0000","last_unstale":"2023-12-19T09:57:17.496095+0000","last_undegraded":"2023-12-19T09:57:17.496095+0000","last_fullsized":"2023-12-19T09:57:17.496095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.224327+0000","last_change":"2023-12-19T09:41:44.771796+0000","last_active":"2023-12-19T09:57:18.224327+0000","last_peered":"2023-12-19T09:57:18.224327+0000","last_clean":"2023-12-19T09:57:18.224327+0000","last_became_active":"2023-12-19T09:41:44.765249+0000","last_became_peered":"2023-12-19T09:41:44.765249+0000","last_unstale":"2023-12-19T09:57:18.224327+0000","last_undegraded":"2023-12-19T09:57:18.224327+0000","last_fullsized":"2023-12-19T09:57:18.224327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1210,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.006602+0000","last_change":"2023-12-19T09:40:55.377872+0000","last_active":"2023-12-19T09:57:16.006602+0000","last_peered":"2023-12-19T09:57:16.006602+0000","last_clean":"2023-12-19T09:57:16.006602+0000","last_became_active":"2023-12-19T09:40:55.374430+0000","last_became_peered":"2023-12-19T09:40:55.374430+0000","last_unstale":"2023-12-19T09:57:16.006602+0000","last_undegraded":"2023-12-19T09:57:16.006602+0000","last_fullsized":"2023-12-19T09:57:16.006602+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.871144+0000","last_change":"2023-12-19T09:41:49.534320+0000","last_active":"2023-12-19T09:57:15.871144+0000","last_peered":"2023-12-19T09:57:15.871144+0000","last_clean":"2023-12-19T09:57:15.871144+0000","last_became_active":"2023-12-19T09:41:49.152035+0000","last_became_peered":"2023-12-19T09:41:49.152035+0000","last_unstale":"2023-12-19T09:57:15.871144+0000","last_undegraded":"2023-12-19T09:57:15.871144+0000","last_fullsized":"2023-12-19T09:57:15.871144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.921005+0000","last_change":"2023-12-19T09:41:44.539061+0000","last_active":"2023-12-19T09:57:16.921005+0000","last_peered":"2023-12-19T09:57:16.921005+0000","last_clean":"2023-12-19T09:57:16.921005+0000","last_became_active":"2023-12-19T09:41:44.523963+0000","last_became_peered":"2023-12-19T09:41:44.523963+0000","last_unstale":"2023-12-19T09:57:16.921005+0000","last_undegraded":"2023-12-19T09:57:16.921005+0000","last_fullsized":"2023-12-19T09:57:16.921005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.295466+0000","last_change":"2023-12-19T09:40:55.373709+0000","last_active":"2023-12-19T09:57:15.295466+0000","last_peered":"2023-12-19T09:57:15.295466+0000","last_clean":"2023-12-19T09:57:15.295466+0000","last_became_active":"2023-12-19T09:40:55.370833+0000","last_became_peered":"2023-12-19T09:40:55.370833+0000","last_unstale":"2023-12-19T09:57:15.295466+0000","last_undegraded":"2023-12-19T09:57:15.295466+0000","last_fullsized":"2023-12-19T09:57:15.295466+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.165684+0000","last_change":"2023-12-19T09:41:49.775064+0000","last_active":"2023-12-19T09:57:17.165684+0000","last_peered":"2023-12-19T09:57:17.165684+0000","last_clean":"2023-12-19T09:57:17.165684+0000","last_became_active":"2023-12-19T09:41:49.756848+0000","last_became_peered":"2023-12-19T09:41:49.756848+0000","last_unstale":"2023-12-19T09:57:17.165684+0000","last_undegraded":"2023-12-19T09:57:17.165684+0000","last_fullsized":"2023-12-19T09:57:17.165684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.126505+0000","last_change":"2023-12-19T09:41:43.867265+0000","last_active":"2023-12-19T09:57:17.126505+0000","last_peered":"2023-12-19T09:57:17.126505+0000","last_clean":"2023-12-19T09:57:17.126505+0000","last_became_active":"2023-12-19T09:41:43.863691+0000","last_became_peered":"2023-12-19T09:41:43.863691+0000","last_unstale":"2023-12-19T09:57:17.126505+0000","last_undegraded":"2023-12-19T09:57:17.126505+0000","last_fullsized":"2023-12-19T09:57:17.126505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1084,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.161294+0000","last_change":"2023-12-19T09:40:55.385057+0000","last_active":"2023-12-19T09:57:17.161294+0000","last_peered":"2023-12-19T09:57:17.161294+0000","last_clean":"2023-12-19T09:57:17.161294+0000","last_became_active":"2023-12-19T09:40:55.376880+0000","last_became_peered":"2023-12-19T09:40:55.376880+0000","last_unstale":"2023-12-19T09:57:17.161294+0000","last_undegraded":"2023-12-19T09:57:17.161294+0000","last_fullsized":"2023-12-19T09:57:17.161294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.920110+0000","last_change":"2023-12-19T09:41:51.637214+0000","last_active":"2023-12-19T09:57:16.920110+0000","last_peered":"2023-12-19T09:57:16.920110+0000","last_clean":"2023-12-19T09:57:16.920110+0000","last_became_active":"2023-12-19T09:41:51.634526+0000","last_became_peered":"2023-12-19T09:41:51.634526+0000","last_unstale":"2023-12-19T09:57:16.920110+0000","last_undegraded":"2023-12-19T09:57:16.920110+0000","last_fullsized":"2023-12-19T09:57:16.920110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"25'7","reported_seq":1225,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.333160+0000","last_change":"2023-12-19T09:41:44.543364+0000","last_active":"2023-12-19T09:57:17.333160+0000","last_peered":"2023-12-19T09:57:17.333160+0000","last_clean":"2023-12-19T09:57:17.333160+0000","last_became_active":"2023-12-19T09:41:44.536492+0000","last_became_peered":"2023-12-19T09:41:44.536492+0000","last_unstale":"2023-12-19T09:57:17.333160+0000","last_undegraded":"2023-12-19T09:57:17.333160+0000","last_fullsized":"2023-12-19T09:57:17.333160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:14.974989+0000","last_change":"2023-12-19T09:40:55.375889+0000","last_active":"2023-12-19T09:57:14.974989+0000","last_peered":"2023-12-19T09:57:14.974989+0000","last_clean":"2023-12-19T09:57:14.974989+0000","last_became_active":"2023-12-19T09:40:55.367503+0000","last_became_peered":"2023-12-19T09:40:55.367503+0000","last_unstale":"2023-12-19T09:57:14.974989+0000","last_undegraded":"2023-12-19T09:57:14.974989+0000","last_fullsized":"2023-12-19T09:57:14.974989+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.14","version":"40'3","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.549382+0000","last_change":"2023-12-19T09:41:48.888516+0000","last_active":"2023-12-19T09:57:16.549382+0000","last_peered":"2023-12-19T09:57:16.549382+0000","last_clean":"2023-12-19T09:57:16.549382+0000","last_became_active":"2023-12-19T09:41:48.880264+0000","last_became_peered":"2023-12-19T09:41:48.880264+0000","last_unstale":"2023-12-19T09:57:16.549382+0000","last_undegraded":"2023-12-19T09:57:16.549382+0000","last_fullsized":"2023-12-19T09:57:16.549382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.529624+0000","last_change":"2023-12-19T09:41:44.092861+0000","last_active":"2023-12-19T09:57:16.529624+0000","last_peered":"2023-12-19T09:57:16.529624+0000","last_clean":"2023-12-19T09:57:16.529624+0000","last_became_active":"2023-12-19T09:41:44.067765+0000","last_became_peered":"2023-12-19T09:41:44.067765+0000","last_unstale":"2023-12-19T09:57:16.529624+0000","last_undegraded":"2023-12-19T09:57:16.529624+0000","last_fullsized":"2023-12-19T09:57:16.529624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1218,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.273161+0000","last_change":"2023-12-19T09:40:55.369239+0000","last_active":"2023-12-19T09:57:17.273161+0000","last_peered":"2023-12-19T09:57:17.273161+0000","last_clean":"2023-12-19T09:57:17.273161+0000","last_became_active":"2023-12-19T09:40:55.366264+0000","last_became_peered":"2023-12-19T09:40:55.366264+0000","last_unstale":"2023-12-19T09:57:17.273161+0000","last_undegraded":"2023-12-19T09:57:17.273161+0000","last_fullsized":"2023-12-19T09:57:17.273161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1186,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.065418+0000","last_change":"2023-12-19T09:41:46.849208+0000","last_active":"2023-12-19T09:57:17.065418+0000","last_peered":"2023-12-19T09:57:17.065418+0000","last_clean":"2023-12-19T09:57:17.065418+0000","last_became_active":"2023-12-19T09:41:46.846639+0000","last_became_peered":"2023-12-19T09:41:46.846639+0000","last_unstale":"2023-12-19T09:57:17.065418+0000","last_undegraded":"2023-12-19T09:57:17.065418+0000","last_fullsized":"2023-12-19T09:57:17.065418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.451385+0000","last_change":"2023-12-19T09:41:43.967652+0000","last_active":"2023-12-19T09:57:15.451385+0000","last_peered":"2023-12-19T09:57:15.451385+0000","last_clean":"2023-12-19T09:57:15.451385+0000","last_became_active":"2023-12-19T09:41:43.965003+0000","last_became_peered":"2023-12-19T09:41:43.965003+0000","last_unstale":"2023-12-19T09:57:15.451385+0000","last_undegraded":"2023-12-19T09:57:15.451385+0000","last_fullsized":"2023-12-19T09:57:15.451385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1210,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.768475+0000","last_change":"2023-12-19T09:40:55.390358+0000","last_active":"2023-12-19T09:57:16.768475+0000","last_peered":"2023-12-19T09:57:16.768475+0000","last_clean":"2023-12-19T09:57:16.768475+0000","last_became_active":"2023-12-19T09:40:55.387550+0000","last_became_peered":"2023-12-19T09:40:55.387550+0000","last_unstale":"2023-12-19T09:57:16.768475+0000","last_undegraded":"2023-12-19T09:57:16.768475+0000","last_fullsized":"2023-12-19T09:57:16.768475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1197,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.537774+0000","last_change":"2023-12-19T09:41:48.731885+0000","last_active":"2023-12-19T09:57:16.537774+0000","last_peered":"2023-12-19T09:57:16.537774+0000","last_clean":"2023-12-19T09:57:16.537774+0000","last_became_active":"2023-12-19T09:41:48.724265+0000","last_became_peered":"2023-12-19T09:41:48.724265+0000","last_unstale":"2023-12-19T09:57:16.537774+0000","last_undegraded":"2023-12-19T09:57:16.537774+0000","last_fullsized":"2023-12-19T09:57:16.537774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.728154+0000","last_change":"2023-12-19T09:41:43.899191+0000","last_active":"2023-12-19T09:57:15.728154+0000","last_peered":"2023-12-19T09:57:15.728154+0000","last_clean":"2023-12-19T09:57:15.728154+0000","last_became_active":"2023-12-19T09:41:43.895270+0000","last_became_peered":"2023-12-19T09:41:43.895270+0000","last_unstale":"2023-12-19T09:57:15.728154+0000","last_undegraded":"2023-12-19T09:57:15.728154+0000","last_fullsized":"2023-12-19T09:57:15.728154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1216,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.976061+0000","last_change":"2023-12-19T09:40:55.370124+0000","last_active":"2023-12-19T09:57:15.976061+0000","last_peered":"2023-12-19T09:57:15.976061+0000","last_clean":"2023-12-19T09:57:15.976061+0000","last_became_active":"2023-12-19T09:40:55.366632+0000","last_became_peered":"2023-12-19T09:40:55.366632+0000","last_unstale":"2023-12-19T09:57:15.976061+0000","last_undegraded":"2023-12-19T09:57:15.976061+0000","last_fullsized":"2023-12-19T09:57:15.976061+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.053204+0000","last_change":"2023-12-19T09:41:48.960658+0000","last_active":"2023-12-19T09:57:15.053204+0000","last_peered":"2023-12-19T09:57:15.053204+0000","last_clean":"2023-12-19T09:57:15.053204+0000","last_became_active":"2023-12-19T09:41:48.957786+0000","last_became_peered":"2023-12-19T09:41:48.957786+0000","last_unstale":"2023-12-19T09:57:15.053204+0000","last_undegraded":"2023-12-19T09:57:15.053204+0000","last_fullsized":"2023-12-19T09:57:15.053204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.172532+0000","last_change":"2023-12-19T09:41:44.646026+0000","last_active":"2023-12-19T09:57:17.172532+0000","last_peered":"2023-12-19T09:57:17.172532+0000","last_clean":"2023-12-19T09:57:17.172532+0000","last_became_active":"2023-12-19T09:41:44.640388+0000","last_became_peered":"2023-12-19T09:41:44.640388+0000","last_unstale":"2023-12-19T09:57:17.172532+0000","last_undegraded":"2023-12-19T09:57:17.172532+0000","last_fullsized":"2023-12-19T09:57:17.172532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1211,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.113902+0000","last_change":"2023-12-19T09:40:55.377818+0000","last_active":"2023-12-19T09:57:17.113902+0000","last_peered":"2023-12-19T09:57:17.113902+0000","last_clean":"2023-12-19T09:57:17.113902+0000","last_became_active":"2023-12-19T09:40:55.374987+0000","last_became_peered":"2023-12-19T09:40:55.374987+0000","last_unstale":"2023-12-19T09:57:17.113902+0000","last_undegraded":"2023-12-19T09:57:17.113902+0000","last_fullsized":"2023-12-19T09:57:17.113902+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":1215,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.297522+0000","last_change":"2023-12-19T09:40:53.332271+0000","last_active":"2023-12-19T09:57:17.297522+0000","last_peered":"2023-12-19T09:57:17.297522+0000","last_clean":"2023-12-19T09:57:17.297522+0000","last_became_active":"2023-12-19T09:40:53.328758+0000","last_became_peered":"2023-12-19T09:40:53.328758+0000","last_unstale":"2023-12-19T09:57:17.297522+0000","last_undegraded":"2023-12-19T09:57:17.297522+0000","last_fullsized":"2023-12-19T09:57:17.297522+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_clean_scrub_stamp":"2023-12-19T09:40:52.293719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"36'3","reported_seq":1207,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.833538+0000","last_change":"2023-12-19T09:41:49.052920+0000","last_active":"2023-12-19T09:57:16.833538+0000","last_peered":"2023-12-19T09:57:16.833538+0000","last_clean":"2023-12-19T09:57:16.833538+0000","last_became_active":"2023-12-19T09:41:49.049321+0000","last_became_peered":"2023-12-19T09:41:49.049321+0000","last_unstale":"2023-12-19T09:57:16.833538+0000","last_undegraded":"2023-12-19T09:57:16.833538+0000","last_fullsized":"2023-12-19T09:57:16.833538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.401999+0000","last_change":"2023-12-19T09:41:44.628513+0000","last_active":"2023-12-19T09:57:17.401999+0000","last_peered":"2023-12-19T09:57:17.401999+0000","last_clean":"2023-12-19T09:57:17.401999+0000","last_became_active":"2023-12-19T09:41:44.625833+0000","last_became_peered":"2023-12-19T09:41:44.625833+0000","last_unstale":"2023-12-19T09:57:17.401999+0000","last_undegraded":"2023-12-19T09:57:17.401999+0000","last_fullsized":"2023-12-19T09:57:17.401999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.982620+0000","last_change":"2023-12-19T09:41:49.909088+0000","last_active":"2023-12-19T09:57:16.982620+0000","last_peered":"2023-12-19T09:57:16.982620+0000","last_clean":"2023-12-19T09:57:16.982620+0000","last_became_active":"2023-12-19T09:41:49.906227+0000","last_became_peered":"2023-12-19T09:41:49.906227+0000","last_unstale":"2023-12-19T09:57:16.982620+0000","last_undegraded":"2023-12-19T09:57:16.982620+0000","last_fullsized":"2023-12-19T09:57:16.982620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.333079+0000","last_change":"2023-12-19T09:41:43.791102+0000","last_active":"2023-12-19T09:57:15.333079+0000","last_peered":"2023-12-19T09:57:15.333079+0000","last_clean":"2023-12-19T09:57:15.333079+0000","last_became_active":"2023-12-19T09:41:43.788014+0000","last_became_peered":"2023-12-19T09:41:43.788014+0000","last_unstale":"2023-12-19T09:57:15.333079+0000","last_undegraded":"2023-12-19T09:57:15.333079+0000","last_fullsized":"2023-12-19T09:57:15.333079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.18","version":"57'1","reported_seq":1076,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.093795+0000","last_change":"2023-12-19T09:41:47.850812+0000","last_active":"2023-12-19T09:57:18.093795+0000","last_peered":"2023-12-19T09:57:18.093795+0000","last_clean":"2023-12-19T09:57:18.093795+0000","last_became_active":"2023-12-19T09:41:47.839786+0000","last_became_peered":"2023-12-19T09:41:47.839786+0000","last_unstale":"2023-12-19T09:57:18.093795+0000","last_undegraded":"2023-12-19T09:57:18.093795+0000","last_fullsized":"2023-12-19T09:57:18.093795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.150975+0000","last_change":"2023-12-19T09:41:44.510414+0000","last_active":"2023-12-19T09:57:16.150975+0000","last_peered":"2023-12-19T09:57:16.150975+0000","last_clean":"2023-12-19T09:57:16.150975+0000","last_became_active":"2023-12-19T09:41:44.502218+0000","last_became_peered":"2023-12-19T09:41:44.502218+0000","last_unstale":"2023-12-19T09:57:16.150975+0000","last_undegraded":"2023-12-19T09:57:16.150975+0000","last_fullsized":"2023-12-19T09:57:16.150975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1198,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.492093+0000","last_change":"2023-12-19T09:41:50.117367+0000","last_active":"2023-12-19T09:57:17.492093+0000","last_peered":"2023-12-19T09:57:17.492093+0000","last_clean":"2023-12-19T09:57:17.492093+0000","last_became_active":"2023-12-19T09:41:50.100260+0000","last_became_peered":"2023-12-19T09:41:50.100260+0000","last_unstale":"2023-12-19T09:57:17.492093+0000","last_undegraded":"2023-12-19T09:57:17.492093+0000","last_fullsized":"2023-12-19T09:57:17.492093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.025474+0000","last_change":"2023-12-19T09:41:44.694402+0000","last_active":"2023-12-19T09:57:17.025474+0000","last_peered":"2023-12-19T09:57:17.025474+0000","last_clean":"2023-12-19T09:57:17.025474+0000","last_became_active":"2023-12-19T09:41:44.689340+0000","last_became_peered":"2023-12-19T09:41:44.689340+0000","last_unstale":"2023-12-19T09:57:17.025474+0000","last_undegraded":"2023-12-19T09:57:17.025474+0000","last_fullsized":"2023-12-19T09:57:17.025474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1a","version":"24'3","reported_seq":1080,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.189487+0000","last_change":"2023-12-19T09:41:47.760578+0000","last_active":"2023-12-19T09:57:18.189487+0000","last_peered":"2023-12-19T09:57:18.189487+0000","last_clean":"2023-12-19T09:57:18.189487+0000","last_became_active":"2023-12-19T09:41:47.751422+0000","last_became_peered":"2023-12-19T09:41:47.751422+0000","last_unstale":"2023-12-19T09:57:18.189487+0000","last_undegraded":"2023-12-19T09:57:18.189487+0000","last_fullsized":"2023-12-19T09:57:18.189487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.501099+0000","last_change":"2023-12-19T09:41:44.652693+0000","last_active":"2023-12-19T09:57:17.501099+0000","last_peered":"2023-12-19T09:57:17.501099+0000","last_clean":"2023-12-19T09:57:17.501099+0000","last_became_active":"2023-12-19T09:41:44.641823+0000","last_became_peered":"2023-12-19T09:41:44.641823+0000","last_unstale":"2023-12-19T09:57:17.501099+0000","last_undegraded":"2023-12-19T09:57:17.501099+0000","last_fullsized":"2023-12-19T09:57:17.501099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1074,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.108296+0000","last_change":"2023-12-19T09:41:47.918436+0000","last_active":"2023-12-19T09:57:17.108296+0000","last_peered":"2023-12-19T09:57:17.108296+0000","last_clean":"2023-12-19T09:57:17.108296+0000","last_became_active":"2023-12-19T09:41:47.915328+0000","last_became_peered":"2023-12-19T09:41:47.915328+0000","last_unstale":"2023-12-19T09:57:17.108296+0000","last_undegraded":"2023-12-19T09:57:17.108296+0000","last_fullsized":"2023-12-19T09:57:17.108296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.223504+0000","last_change":"2023-12-19T09:41:44.622479+0000","last_active":"2023-12-19T09:57:15.223504+0000","last_peered":"2023-12-19T09:57:15.223504+0000","last_clean":"2023-12-19T09:57:15.223504+0000","last_became_active":"2023-12-19T09:41:44.611913+0000","last_became_peered":"2023-12-19T09:41:44.611913+0000","last_unstale":"2023-12-19T09:57:15.223504+0000","last_undegraded":"2023-12-19T09:57:15.223504+0000","last_fullsized":"2023-12-19T09:57:15.223504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.922722+0000","last_change":"2023-12-19T09:41:48.997784+0000","last_active":"2023-12-19T09:57:16.922722+0000","last_peered":"2023-12-19T09:57:16.922722+0000","last_clean":"2023-12-19T09:57:16.922722+0000","last_became_active":"2023-12-19T09:41:48.992519+0000","last_became_peered":"2023-12-19T09:41:48.992519+0000","last_unstale":"2023-12-19T09:57:16.922722+0000","last_undegraded":"2023-12-19T09:57:16.922722+0000","last_fullsized":"2023-12-19T09:57:16.922722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.269180+0000","last_change":"2023-12-19T09:41:44.528794+0000","last_active":"2023-12-19T09:57:17.269180+0000","last_peered":"2023-12-19T09:57:17.269180+0000","last_clean":"2023-12-19T09:57:17.269180+0000","last_became_active":"2023-12-19T09:41:44.520591+0000","last_became_peered":"2023-12-19T09:41:44.520591+0000","last_unstale":"2023-12-19T09:57:17.269180+0000","last_undegraded":"2023-12-19T09:57:17.269180+0000","last_fullsized":"2023-12-19T09:57:17.269180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"45'3","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.122531+0000","last_change":"2023-12-19T09:41:47.021642+0000","last_active":"2023-12-19T09:57:15.122531+0000","last_peered":"2023-12-19T09:57:15.122531+0000","last_clean":"2023-12-19T09:57:15.122531+0000","last_became_active":"2023-12-19T09:41:47.010899+0000","last_became_peered":"2023-12-19T09:41:47.010899+0000","last_unstale":"2023-12-19T09:57:15.122531+0000","last_undegraded":"2023-12-19T09:57:15.122531+0000","last_fullsized":"2023-12-19T09:57:15.122531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.228486+0000","last_change":"2023-12-19T09:41:44.704700+0000","last_active":"2023-12-19T09:57:17.228486+0000","last_peered":"2023-12-19T09:57:17.228486+0000","last_clean":"2023-12-19T09:57:17.228486+0000","last_became_active":"2023-12-19T09:41:44.689193+0000","last_became_peered":"2023-12-19T09:41:44.689193+0000","last_unstale":"2023-12-19T09:57:17.228486+0000","last_undegraded":"2023-12-19T09:57:17.228486+0000","last_fullsized":"2023-12-19T09:57:17.228486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.972364+0000","last_change":"2023-12-19T09:41:50.654472+0000","last_active":"2023-12-19T09:57:16.972364+0000","last_peered":"2023-12-19T09:57:16.972364+0000","last_clean":"2023-12-19T09:57:16.972364+0000","last_became_active":"2023-12-19T09:41:50.645171+0000","last_became_peered":"2023-12-19T09:41:50.645171+0000","last_unstale":"2023-12-19T09:57:16.972364+0000","last_undegraded":"2023-12-19T09:57:16.972364+0000","last_fullsized":"2023-12-19T09:57:16.972364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.790161+0000","last_change":"2023-12-19T09:41:44.648689+0000","last_active":"2023-12-19T09:57:17.790161+0000","last_peered":"2023-12-19T09:57:17.790161+0000","last_clean":"2023-12-19T09:57:17.790161+0000","last_became_active":"2023-12-19T09:41:44.635214+0000","last_became_peered":"2023-12-19T09:41:44.635214+0000","last_unstale":"2023-12-19T09:57:17.790161+0000","last_undegraded":"2023-12-19T09:57:17.790161+0000","last_fullsized":"2023-12-19T09:57:17.790161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1","version":"32'3","reported_seq":1079,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.206891+0000","last_change":"2023-12-19T09:41:47.793198+0000","last_active":"2023-12-19T09:57:18.206891+0000","last_peered":"2023-12-19T09:57:18.206891+0000","last_clean":"2023-12-19T09:57:18.206891+0000","last_became_active":"2023-12-19T09:41:47.781592+0000","last_became_peered":"2023-12-19T09:41:47.781592+0000","last_unstale":"2023-12-19T09:57:18.206891+0000","last_undegraded":"2023-12-19T09:57:18.206891+0000","last_fullsized":"2023-12-19T09:57:18.206891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.974154+0000","last_change":"2023-12-19T09:41:43.991485+0000","last_active":"2023-12-19T09:57:16.974154+0000","last_peered":"2023-12-19T09:57:16.974154+0000","last_clean":"2023-12-19T09:57:16.974154+0000","last_became_active":"2023-12-19T09:41:43.985931+0000","last_became_peered":"2023-12-19T09:41:43.985931+0000","last_unstale":"2023-12-19T09:57:16.974154+0000","last_undegraded":"2023-12-19T09:57:16.974154+0000","last_fullsized":"2023-12-19T09:57:16.974154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1187,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.581304+0000","last_change":"2023-12-19T09:41:46.831650+0000","last_active":"2023-12-19T09:57:16.581304+0000","last_peered":"2023-12-19T09:57:16.581304+0000","last_clean":"2023-12-19T09:57:16.581304+0000","last_became_active":"2023-12-19T09:41:46.825353+0000","last_became_peered":"2023-12-19T09:41:46.825353+0000","last_unstale":"2023-12-19T09:57:16.581304+0000","last_undegraded":"2023-12-19T09:57:16.581304+0000","last_fullsized":"2023-12-19T09:57:16.581304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1191,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.498107+0000","last_change":"2023-12-19T09:41:44.065242+0000","last_active":"2023-12-19T09:57:15.498107+0000","last_peered":"2023-12-19T09:57:15.498107+0000","last_clean":"2023-12-19T09:57:15.498107+0000","last_became_active":"2023-12-19T09:41:44.062711+0000","last_became_peered":"2023-12-19T09:41:44.062711+0000","last_unstale":"2023-12-19T09:57:15.498107+0000","last_undegraded":"2023-12-19T09:57:15.498107+0000","last_fullsized":"2023-12-19T09:57:15.498107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1186,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.298978+0000","last_change":"2023-12-19T09:41:46.880242+0000","last_active":"2023-12-19T09:57:17.298978+0000","last_peered":"2023-12-19T09:57:17.298978+0000","last_clean":"2023-12-19T09:57:17.298978+0000","last_became_active":"2023-12-19T09:41:46.877617+0000","last_became_peered":"2023-12-19T09:41:46.877617+0000","last_unstale":"2023-12-19T09:57:17.298978+0000","last_undegraded":"2023-12-19T09:57:17.298978+0000","last_fullsized":"2023-12-19T09:57:17.298978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.931091+0000","last_change":"2023-12-19T09:41:44.513456+0000","last_active":"2023-12-19T09:57:15.931091+0000","last_peered":"2023-12-19T09:57:15.931091+0000","last_clean":"2023-12-19T09:57:15.931091+0000","last_became_active":"2023-12-19T09:41:44.493716+0000","last_became_peered":"2023-12-19T09:41:44.493716+0000","last_unstale":"2023-12-19T09:57:15.931091+0000","last_undegraded":"2023-12-19T09:57:15.931091+0000","last_fullsized":"2023-12-19T09:57:15.931091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1076,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.203696+0000","last_change":"2023-12-19T09:41:47.979679+0000","last_active":"2023-12-19T09:57:18.203696+0000","last_peered":"2023-12-19T09:57:18.203696+0000","last_clean":"2023-12-19T09:57:18.203696+0000","last_became_active":"2023-12-19T09:41:47.964957+0000","last_became_peered":"2023-12-19T09:41:47.964957+0000","last_unstale":"2023-12-19T09:57:18.203696+0000","last_undegraded":"2023-12-19T09:57:18.203696+0000","last_fullsized":"2023-12-19T09:57:18.203696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1024,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":119420,"kb_used_data":7796,"kb_used_omap":0,"kb_used_meta":111616,"kb_avail":104738180,"statfs":{"total":107374182400,"available":107251896320,"internally_reserved":0,"allocated":7983104,"data_stored":5042706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114294784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":60500,"kb_used_data":7180,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104797100,"statfs":{"total":107374182400,"available":107312230400,"internally_reserved":0,"allocated":7352320,"data_stored":4443559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654706585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":114480,"kb_used_data":7016,"kb_used_omap":0,"kb_used_meta":107456,"kb_avail":104743120,"statfs":{"total":107374182400,"available":107256954880,"internally_reserved":0,"allocated":7184384,"data_stored":4442162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110034944},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654706584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":61232,"kb_used_data":7912,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104796368,"statfs":{"total":107374182400,"available":107311480832,"internally_reserved":0,"allocated":8101888,"data_stored":5031711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-19T09:57:20.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T09:57:20.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.409+0000 7f9c5ce64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:20.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.413+0000 7f9c5ce64640 1 Processor -- start 2023-12-19T09:57:20.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.413+0000 7f9c5ce64640 1 -- start start 2023-12-19T09:57:20.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.414+0000 7f9c5ce64640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c580a1040 0x7f9c58132f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.414+0000 7f9c5ce64640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c580a1870 con 0x7f9c581334c0 2023-12-19T09:57:20.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.414+0000 7f9c5ce64640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5809cb90 con 0x7f9c580a1040 2023-12-19T09:57:20.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.414+0000 7f9c5659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c580a1040 0x7f9c58132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.414 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.414+0000 7f9c55d9b640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9c581334c0 0x7f9c581382c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50396/0 (socket says 172.21.15.99:50396) 2023-12-19T09:57:20.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5659c640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c580a1040 0x7f9c58132f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51428/0 (socket says 172.21.15.99:51428) 2023-12-19T09:57:20.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c55d9b640 1 -- 172.21.15.99:0/4045381033 learned_addr learned my addr 172.21.15.99:0/4045381033 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5659c640 1 -- 172.21.15.99:0/4045381033 >> v1:172.21.15.99:6789/0 conn(0x7f9c581334c0 legacy=0x7f9c581382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5559a640 1 -- 172.21.15.99:0/4045381033 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780309678 0 0) 0x7f9c580a1870 con 0x7f9c581334c0 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5659c640 1 -- 172.21.15.99:0/4045381033 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c581300a0 con 0x7f9c580a1040 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5659c640 1 --2- 172.21.15.99:0/4045381033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c58132f80 crc :-1 s=READY pgs=12656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bc101f509ed8a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5559a640 1 -- 172.21.15.99:0/4045381033 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9c48009ce0 con 0x7f9c580a1040 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5559a640 1 -- 172.21.15.99:0/4045381033 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9c48009e40 con 0x7f9c580a1040 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.415+0000 7f9c5559a640 1 -- 172.21.15.99:0/4045381033 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9c4800e360 con 0x7f9c580a1040 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.416+0000 7f9c5ce64640 1 -- 172.21.15.99:0/4045381033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 msgr2=0x7f9c58132f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.416+0000 7f9c5ce64640 1 --2- 172.21.15.99:0/4045381033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c58132f80 crc :-1 s=READY pgs=12656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.416+0000 7f9c5ce64640 1 -- 172.21.15.99:0/4045381033 shutdown_connections 2023-12-19T09:57:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.416+0000 7f9c5ce64640 1 --2- 172.21.15.99:0/4045381033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c58132f80 unknown :-1 s=CLOSED pgs=12656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.416+0000 7f9c5ce64640 1 -- 172.21.15.99:0/4045381033 >> 172.21.15.99:0/4045381033 conn(0x7f9c5806c9c0 msgr2=0x7f9c5806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.416+0000 7f9c5ce64640 1 -- 172.21.15.99:0/4045381033 shutdown_connections 2023-12-19T09:57:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.416+0000 7f9c5ce64640 1 -- 172.21.15.99:0/4045381033 wait complete. 2023-12-19T09:57:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.417+0000 7f9c5ce64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.418+0000 7f9c5ce64640 1 Processor -- start 2023-12-19T09:57:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.418+0000 7f9c5ce64640 1 -- start start 2023-12-19T09:57:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.418+0000 7f9c5ce64640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c5811dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.418+0000 7f9c5ce64640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c581201f0 con 0x7f9c580a1040 2023-12-19T09:57:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.418+0000 7f9c5659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c5811dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.419+0000 7f9c5659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c5811dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51444/0 (socket says 172.21.15.99:51444) 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.419+0000 7f9c5659c640 1 -- 172.21.15.99:0/1759261678 learned_addr learned my addr 172.21.15.99:0/1759261678 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.419+0000 7f9c5659c640 1 -- 172.21.15.99:0/1759261678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5811f780 con 0x7f9c580a1040 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.419+0000 7f9c5659c640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c5811dc50 crc :-1 s=READY pgs=12657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.419+0000 7f9c46ffd640 1 -- 172.21.15.99:0/1759261678 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9c48014540 con 0x7f9c580a1040 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.419+0000 7f9c46ffd640 1 -- 172.21.15.99:0/1759261678 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f9c480146a0 con 0x7f9c580a1040 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.419+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c58120e00 con 0x7f9c580a1040 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.420+0000 7f9c46ffd640 1 -- 172.21.15.99:0/1759261678 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f9c48014940 con 0x7f9c580a1040 2023-12-19T09:57:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.420+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c58121ce0 con 0x7f9c580a1040 2023-12-19T09:57:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.420+0000 7f9c46ffd640 1 -- 172.21.15.99:0/1759261678 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f9c48014af0 con 0x7f9c580a1040 2023-12-19T09:57:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.420+0000 7f9c46ffd640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f9c38037810 0x7f9c38039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.421+0000 7f9c46ffd640 1 -- 172.21.15.99:0/1759261678 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7f9c48010310 con 0x7f9c580a1040 2023-12-19T09:57:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.421+0000 7f9c55d9b640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f9c38037810 0x7f9c38039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.421+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c58067c60 con 0x7f9c580a1040 2023-12-19T09:57:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.421+0000 7f9c55d9b640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f9c38037810 0x7f9c38039d20 crc :-1 s=READY pgs=3643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.425 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.426+0000 7f9c46ffd640 1 -- 172.21.15.99:0/1759261678 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f9c4800d1c0 con 0x7f9c580a1040 2023-12-19T09:57:20.598 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.598+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c5812fd90 con 0x7f9c38037810 2023-12-19T09:57:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.603+0000 7f9c46ffd640 1 -- 172.21.15.99:0/1759261678 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+184177 (crc 0 0 0) 0x7f9c4c001250 con 0x7f9c38037810 2023-12-19T09:57:20.605 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:57:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2023-12-19T09:57:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f9c38037810 msgr2=0x7f9c38039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f9c38037810 0x7f9c38039d20 crc :-1 s=READY pgs=3643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 msgr2=0x7f9c5811dc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c5811dc50 crc :-1 s=READY pgs=12657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 shutdown_connections 2023-12-19T09:57:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f9c38037810 0x7f9c38039d20 unknown :-1 s=CLOSED pgs=3643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 --2- 172.21.15.99:0/1759261678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c580a1040 0x7f9c5811dc50 unknown :-1 s=CLOSED pgs=12657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 >> 172.21.15.99:0/1759261678 conn(0x7f9c5806c9c0 msgr2=0x7f9c580a1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 shutdown_connections 2023-12-19T09:57:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.606+0000 7f9c5ce64640 1 -- 172.21.15.99:0/1759261678 wait complete. 2023-12-19T09:57:20.618 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1181,"stamp":"2023-12-19T09:57:20.497625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591397,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":152,"num_write_kb":1909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":355632,"kb_used_data":29904,"kb_used_omap":0,"kb_used_meta":325696,"kb_avail":419074768,"statfs":{"total":429496729600,"available":429132562432,"internally_reserved":0,"allocated":30621696,"data_stored":18960138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":333512704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17682,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-373,"num_write_kb":-373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001582"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.215434+0000","last_change":"2023-12-19T09:41:43.996729+0000","last_active":"2023-12-19T09:57:15.215434+0000","last_peered":"2023-12-19T09:57:15.215434+0000","last_clean":"2023-12-19T09:57:15.215434+0000","last_became_active":"2023-12-19T09:41:43.988867+0000","last_became_peered":"2023-12-19T09:41:43.988867+0000","last_unstale":"2023-12-19T09:57:15.215434+0000","last_undegraded":"2023-12-19T09:57:15.215434+0000","last_fullsized":"2023-12-19T09:57:15.215434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.974542+0000","last_change":"2023-12-19T09:41:49.091716+0000","last_active":"2023-12-19T09:57:15.974542+0000","last_peered":"2023-12-19T09:57:15.974542+0000","last_clean":"2023-12-19T09:57:15.974542+0000","last_became_active":"2023-12-19T09:41:49.078919+0000","last_became_peered":"2023-12-19T09:41:49.078919+0000","last_unstale":"2023-12-19T09:57:15.974542+0000","last_undegraded":"2023-12-19T09:57:15.974542+0000","last_fullsized":"2023-12-19T09:57:15.974542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.776271+0000","last_change":"2023-12-19T09:41:44.097849+0000","last_active":"2023-12-19T09:57:17.776271+0000","last_peered":"2023-12-19T09:57:17.776271+0000","last_clean":"2023-12-19T09:57:17.776271+0000","last_became_active":"2023-12-19T09:41:44.070813+0000","last_became_peered":"2023-12-19T09:41:44.070813+0000","last_unstale":"2023-12-19T09:57:17.776271+0000","last_undegraded":"2023-12-19T09:57:17.776271+0000","last_fullsized":"2023-12-19T09:57:17.776271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.830375+0000","last_change":"2023-12-19T09:41:47.646204+0000","last_active":"2023-12-19T09:57:17.830375+0000","last_peered":"2023-12-19T09:57:17.830375+0000","last_clean":"2023-12-19T09:57:17.830375+0000","last_became_active":"2023-12-19T09:41:47.638438+0000","last_became_peered":"2023-12-19T09:41:47.638438+0000","last_unstale":"2023-12-19T09:57:17.830375+0000","last_undegraded":"2023-12-19T09:57:17.830375+0000","last_fullsized":"2023-12-19T09:57:17.830375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.060098+0000","last_change":"2023-12-19T09:41:44.414780+0000","last_active":"2023-12-19T09:57:16.060098+0000","last_peered":"2023-12-19T09:57:16.060098+0000","last_clean":"2023-12-19T09:57:16.060098+0000","last_became_active":"2023-12-19T09:41:44.399400+0000","last_became_peered":"2023-12-19T09:41:44.399400+0000","last_unstale":"2023-12-19T09:57:16.060098+0000","last_undegraded":"2023-12-19T09:57:16.060098+0000","last_fullsized":"2023-12-19T09:57:16.060098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.272185+0000","last_change":"2023-12-19T09:41:48.952590+0000","last_active":"2023-12-19T09:57:16.272185+0000","last_peered":"2023-12-19T09:57:16.272185+0000","last_clean":"2023-12-19T09:57:16.272185+0000","last_became_active":"2023-12-19T09:41:48.947301+0000","last_became_peered":"2023-12-19T09:41:48.947301+0000","last_unstale":"2023-12-19T09:57:16.272185+0000","last_undegraded":"2023-12-19T09:57:16.272185+0000","last_fullsized":"2023-12-19T09:57:16.272185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.637016+0000","last_change":"2023-12-19T09:41:44.707713+0000","last_active":"2023-12-19T09:57:17.637016+0000","last_peered":"2023-12-19T09:57:17.637016+0000","last_clean":"2023-12-19T09:57:17.637016+0000","last_became_active":"2023-12-19T09:41:44.695211+0000","last_became_peered":"2023-12-19T09:41:44.695211+0000","last_unstale":"2023-12-19T09:57:17.637016+0000","last_undegraded":"2023-12-19T09:57:17.637016+0000","last_fullsized":"2023-12-19T09:57:17.637016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.810718+0000","last_change":"2023-12-19T09:41:48.985139+0000","last_active":"2023-12-19T09:57:15.810718+0000","last_peered":"2023-12-19T09:57:15.810718+0000","last_clean":"2023-12-19T09:57:15.810718+0000","last_became_active":"2023-12-19T09:41:48.981358+0000","last_became_peered":"2023-12-19T09:41:48.981358+0000","last_unstale":"2023-12-19T09:57:15.810718+0000","last_undegraded":"2023-12-19T09:57:15.810718+0000","last_fullsized":"2023-12-19T09:57:15.810718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.497635+0000","last_change":"2023-12-19T09:41:44.014471+0000","last_active":"2023-12-19T09:57:17.497635+0000","last_peered":"2023-12-19T09:57:17.497635+0000","last_clean":"2023-12-19T09:57:17.497635+0000","last_became_active":"2023-12-19T09:41:44.010134+0000","last_became_peered":"2023-12-19T09:41:44.010134+0000","last_unstale":"2023-12-19T09:57:17.497635+0000","last_undegraded":"2023-12-19T09:57:17.497635+0000","last_fullsized":"2023-12-19T09:57:17.497635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.a","version":"48'3","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.788019+0000","last_change":"2023-12-19T09:41:50.049917+0000","last_active":"2023-12-19T09:57:17.788019+0000","last_peered":"2023-12-19T09:57:17.788019+0000","last_clean":"2023-12-19T09:57:17.788019+0000","last_became_active":"2023-12-19T09:41:50.042450+0000","last_became_peered":"2023-12-19T09:41:50.042450+0000","last_unstale":"2023-12-19T09:57:17.788019+0000","last_undegraded":"2023-12-19T09:57:17.788019+0000","last_fullsized":"2023-12-19T09:57:17.788019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.032342+0000","last_change":"2023-12-19T09:41:44.728818+0000","last_active":"2023-12-19T09:57:18.032342+0000","last_peered":"2023-12-19T09:57:18.032342+0000","last_clean":"2023-12-19T09:57:18.032342+0000","last_became_active":"2023-12-19T09:41:44.723909+0000","last_became_peered":"2023-12-19T09:41:44.723909+0000","last_unstale":"2023-12-19T09:57:18.032342+0000","last_undegraded":"2023-12-19T09:57:18.032342+0000","last_fullsized":"2023-12-19T09:57:18.032342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1200,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.576213+0000","last_change":"2023-12-19T09:41:47.838325+0000","last_active":"2023-12-19T09:57:17.576213+0000","last_peered":"2023-12-19T09:57:17.576213+0000","last_clean":"2023-12-19T09:57:17.576213+0000","last_became_active":"2023-12-19T09:41:47.832642+0000","last_became_peered":"2023-12-19T09:41:47.832642+0000","last_unstale":"2023-12-19T09:57:17.576213+0000","last_undegraded":"2023-12-19T09:57:17.576213+0000","last_fullsized":"2023-12-19T09:57:17.576213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.252148+0000","last_change":"2023-12-19T09:41:44.592810+0000","last_active":"2023-12-19T09:57:18.252148+0000","last_peered":"2023-12-19T09:57:18.252148+0000","last_clean":"2023-12-19T09:57:18.252148+0000","last_became_active":"2023-12-19T09:41:44.585031+0000","last_became_peered":"2023-12-19T09:41:44.585031+0000","last_unstale":"2023-12-19T09:57:18.252148+0000","last_undegraded":"2023-12-19T09:57:18.252148+0000","last_fullsized":"2023-12-19T09:57:18.252148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.229948+0000","last_change":"2023-12-19T09:41:47.669623+0000","last_active":"2023-12-19T09:57:18.229948+0000","last_peered":"2023-12-19T09:57:18.229948+0000","last_clean":"2023-12-19T09:57:18.229948+0000","last_became_active":"2023-12-19T09:41:47.651334+0000","last_became_peered":"2023-12-19T09:41:47.651334+0000","last_unstale":"2023-12-19T09:57:18.229948+0000","last_undegraded":"2023-12-19T09:57:18.229948+0000","last_fullsized":"2023-12-19T09:57:18.229948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.175349+0000","last_change":"2023-12-19T09:41:43.967186+0000","last_active":"2023-12-19T09:57:15.175349+0000","last_peered":"2023-12-19T09:57:15.175349+0000","last_clean":"2023-12-19T09:57:15.175349+0000","last_became_active":"2023-12-19T09:41:43.956781+0000","last_became_peered":"2023-12-19T09:41:43.956781+0000","last_unstale":"2023-12-19T09:57:15.175349+0000","last_undegraded":"2023-12-19T09:57:15.175349+0000","last_fullsized":"2023-12-19T09:57:15.175349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.902654+0000","last_change":"2023-12-19T09:41:50.824272+0000","last_active":"2023-12-19T09:57:16.902654+0000","last_peered":"2023-12-19T09:57:16.902654+0000","last_clean":"2023-12-19T09:57:16.902654+0000","last_became_active":"2023-12-19T09:41:50.819734+0000","last_became_peered":"2023-12-19T09:41:50.819734+0000","last_unstale":"2023-12-19T09:57:16.902654+0000","last_undegraded":"2023-12-19T09:57:16.902654+0000","last_fullsized":"2023-12-19T09:57:16.902654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.199867+0000","last_change":"2023-12-19T09:41:43.948061+0000","last_active":"2023-12-19T09:57:17.199867+0000","last_peered":"2023-12-19T09:57:17.199867+0000","last_clean":"2023-12-19T09:57:17.199867+0000","last_became_active":"2023-12-19T09:41:43.945414+0000","last_became_peered":"2023-12-19T09:41:43.945414+0000","last_unstale":"2023-12-19T09:57:17.199867+0000","last_undegraded":"2023-12-19T09:57:17.199867+0000","last_fullsized":"2023-12-19T09:57:17.199867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"30'3","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.792964+0000","last_change":"2023-12-19T09:41:48.128963+0000","last_active":"2023-12-19T09:57:16.792964+0000","last_peered":"2023-12-19T09:57:16.792964+0000","last_clean":"2023-12-19T09:57:16.792964+0000","last_became_active":"2023-12-19T09:41:48.126255+0000","last_became_peered":"2023-12-19T09:41:48.126255+0000","last_unstale":"2023-12-19T09:57:16.792964+0000","last_undegraded":"2023-12-19T09:57:16.792964+0000","last_fullsized":"2023-12-19T09:57:16.792964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.021359+0000","last_change":"2023-12-19T09:41:44.807942+0000","last_active":"2023-12-19T09:57:18.021359+0000","last_peered":"2023-12-19T09:57:18.021359+0000","last_clean":"2023-12-19T09:57:18.021359+0000","last_became_active":"2023-12-19T09:41:44.792603+0000","last_became_peered":"2023-12-19T09:41:44.792603+0000","last_unstale":"2023-12-19T09:57:18.021359+0000","last_undegraded":"2023-12-19T09:57:18.021359+0000","last_fullsized":"2023-12-19T09:57:18.021359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.730650+0000","last_change":"2023-12-19T09:41:50.700445+0000","last_active":"2023-12-19T09:57:17.730650+0000","last_peered":"2023-12-19T09:57:17.730650+0000","last_clean":"2023-12-19T09:57:17.730650+0000","last_became_active":"2023-12-19T09:41:50.697862+0000","last_became_peered":"2023-12-19T09:41:50.697862+0000","last_unstale":"2023-12-19T09:57:17.730650+0000","last_undegraded":"2023-12-19T09:57:17.730650+0000","last_fullsized":"2023-12-19T09:57:17.730650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.647865+0000","last_change":"2023-12-19T09:41:43.864107+0000","last_active":"2023-12-19T09:57:16.647865+0000","last_peered":"2023-12-19T09:57:16.647865+0000","last_clean":"2023-12-19T09:57:16.647865+0000","last_became_active":"2023-12-19T09:41:43.861579+0000","last_became_peered":"2023-12-19T09:41:43.861579+0000","last_unstale":"2023-12-19T09:57:16.647865+0000","last_undegraded":"2023-12-19T09:57:16.647865+0000","last_fullsized":"2023-12-19T09:57:16.647865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1184,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.086474+0000","last_change":"2023-12-19T09:41:46.851420+0000","last_active":"2023-12-19T09:57:15.086474+0000","last_peered":"2023-12-19T09:57:15.086474+0000","last_clean":"2023-12-19T09:57:15.086474+0000","last_became_active":"2023-12-19T09:41:46.841291+0000","last_became_peered":"2023-12-19T09:41:46.841291+0000","last_unstale":"2023-12-19T09:57:15.086474+0000","last_undegraded":"2023-12-19T09:57:15.086474+0000","last_fullsized":"2023-12-19T09:57:15.086474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.133104+0000","last_change":"2023-12-19T09:41:44.833180+0000","last_active":"2023-12-19T09:57:17.133104+0000","last_peered":"2023-12-19T09:57:17.133104+0000","last_clean":"2023-12-19T09:57:17.133104+0000","last_became_active":"2023-12-19T09:41:44.829928+0000","last_became_peered":"2023-12-19T09:41:44.829928+0000","last_unstale":"2023-12-19T09:57:17.133104+0000","last_undegraded":"2023-12-19T09:57:17.133104+0000","last_fullsized":"2023-12-19T09:57:17.133104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.496095+0000","last_change":"2023-12-19T09:41:47.003324+0000","last_active":"2023-12-19T09:57:17.496095+0000","last_peered":"2023-12-19T09:57:17.496095+0000","last_clean":"2023-12-19T09:57:17.496095+0000","last_became_active":"2023-12-19T09:41:46.996512+0000","last_became_peered":"2023-12-19T09:41:46.996512+0000","last_unstale":"2023-12-19T09:57:17.496095+0000","last_undegraded":"2023-12-19T09:57:17.496095+0000","last_fullsized":"2023-12-19T09:57:17.496095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.224327+0000","last_change":"2023-12-19T09:41:44.771796+0000","last_active":"2023-12-19T09:57:18.224327+0000","last_peered":"2023-12-19T09:57:18.224327+0000","last_clean":"2023-12-19T09:57:18.224327+0000","last_became_active":"2023-12-19T09:41:44.765249+0000","last_became_peered":"2023-12-19T09:41:44.765249+0000","last_unstale":"2023-12-19T09:57:18.224327+0000","last_undegraded":"2023-12-19T09:57:18.224327+0000","last_fullsized":"2023-12-19T09:57:18.224327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1210,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.006602+0000","last_change":"2023-12-19T09:40:55.377872+0000","last_active":"2023-12-19T09:57:16.006602+0000","last_peered":"2023-12-19T09:57:16.006602+0000","last_clean":"2023-12-19T09:57:16.006602+0000","last_became_active":"2023-12-19T09:40:55.374430+0000","last_became_peered":"2023-12-19T09:40:55.374430+0000","last_unstale":"2023-12-19T09:57:16.006602+0000","last_undegraded":"2023-12-19T09:57:16.006602+0000","last_fullsized":"2023-12-19T09:57:16.006602+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.871144+0000","last_change":"2023-12-19T09:41:49.534320+0000","last_active":"2023-12-19T09:57:15.871144+0000","last_peered":"2023-12-19T09:57:15.871144+0000","last_clean":"2023-12-19T09:57:15.871144+0000","last_became_active":"2023-12-19T09:41:49.152035+0000","last_became_peered":"2023-12-19T09:41:49.152035+0000","last_unstale":"2023-12-19T09:57:15.871144+0000","last_undegraded":"2023-12-19T09:57:15.871144+0000","last_fullsized":"2023-12-19T09:57:15.871144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.921005+0000","last_change":"2023-12-19T09:41:44.539061+0000","last_active":"2023-12-19T09:57:16.921005+0000","last_peered":"2023-12-19T09:57:16.921005+0000","last_clean":"2023-12-19T09:57:16.921005+0000","last_became_active":"2023-12-19T09:41:44.523963+0000","last_became_peered":"2023-12-19T09:41:44.523963+0000","last_unstale":"2023-12-19T09:57:16.921005+0000","last_undegraded":"2023-12-19T09:57:16.921005+0000","last_fullsized":"2023-12-19T09:57:16.921005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.295466+0000","last_change":"2023-12-19T09:40:55.373709+0000","last_active":"2023-12-19T09:57:15.295466+0000","last_peered":"2023-12-19T09:57:15.295466+0000","last_clean":"2023-12-19T09:57:15.295466+0000","last_became_active":"2023-12-19T09:40:55.370833+0000","last_became_peered":"2023-12-19T09:40:55.370833+0000","last_unstale":"2023-12-19T09:57:15.295466+0000","last_undegraded":"2023-12-19T09:57:15.295466+0000","last_fullsized":"2023-12-19T09:57:15.295466+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.165684+0000","last_change":"2023-12-19T09:41:49.775064+0000","last_active":"2023-12-19T09:57:17.165684+0000","last_peered":"2023-12-19T09:57:17.165684+0000","last_clean":"2023-12-19T09:57:17.165684+0000","last_became_active":"2023-12-19T09:41:49.756848+0000","last_became_peered":"2023-12-19T09:41:49.756848+0000","last_unstale":"2023-12-19T09:57:17.165684+0000","last_undegraded":"2023-12-19T09:57:17.165684+0000","last_fullsized":"2023-12-19T09:57:17.165684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.126505+0000","last_change":"2023-12-19T09:41:43.867265+0000","last_active":"2023-12-19T09:57:17.126505+0000","last_peered":"2023-12-19T09:57:17.126505+0000","last_clean":"2023-12-19T09:57:17.126505+0000","last_became_active":"2023-12-19T09:41:43.863691+0000","last_became_peered":"2023-12-19T09:41:43.863691+0000","last_unstale":"2023-12-19T09:57:17.126505+0000","last_undegraded":"2023-12-19T09:57:17.126505+0000","last_fullsized":"2023-12-19T09:57:17.126505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1084,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.161294+0000","last_change":"2023-12-19T09:40:55.385057+0000","last_active":"2023-12-19T09:57:17.161294+0000","last_peered":"2023-12-19T09:57:17.161294+0000","last_clean":"2023-12-19T09:57:17.161294+0000","last_became_active":"2023-12-19T09:40:55.376880+0000","last_became_peered":"2023-12-19T09:40:55.376880+0000","last_unstale":"2023-12-19T09:57:17.161294+0000","last_undegraded":"2023-12-19T09:57:17.161294+0000","last_fullsized":"2023-12-19T09:57:17.161294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.920110+0000","last_change":"2023-12-19T09:41:51.637214+0000","last_active":"2023-12-19T09:57:16.920110+0000","last_peered":"2023-12-19T09:57:16.920110+0000","last_clean":"2023-12-19T09:57:16.920110+0000","last_became_active":"2023-12-19T09:41:51.634526+0000","last_became_peered":"2023-12-19T09:41:51.634526+0000","last_unstale":"2023-12-19T09:57:16.920110+0000","last_undegraded":"2023-12-19T09:57:16.920110+0000","last_fullsized":"2023-12-19T09:57:16.920110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"25'7","reported_seq":1225,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.333160+0000","last_change":"2023-12-19T09:41:44.543364+0000","last_active":"2023-12-19T09:57:17.333160+0000","last_peered":"2023-12-19T09:57:17.333160+0000","last_clean":"2023-12-19T09:57:17.333160+0000","last_became_active":"2023-12-19T09:41:44.536492+0000","last_became_peered":"2023-12-19T09:41:44.536492+0000","last_unstale":"2023-12-19T09:57:17.333160+0000","last_undegraded":"2023-12-19T09:57:17.333160+0000","last_fullsized":"2023-12-19T09:57:17.333160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:14.974989+0000","last_change":"2023-12-19T09:40:55.375889+0000","last_active":"2023-12-19T09:57:14.974989+0000","last_peered":"2023-12-19T09:57:14.974989+0000","last_clean":"2023-12-19T09:57:14.974989+0000","last_became_active":"2023-12-19T09:40:55.367503+0000","last_became_peered":"2023-12-19T09:40:55.367503+0000","last_unstale":"2023-12-19T09:57:14.974989+0000","last_undegraded":"2023-12-19T09:57:14.974989+0000","last_fullsized":"2023-12-19T09:57:14.974989+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.14","version":"40'3","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.549382+0000","last_change":"2023-12-19T09:41:48.888516+0000","last_active":"2023-12-19T09:57:16.549382+0000","last_peered":"2023-12-19T09:57:16.549382+0000","last_clean":"2023-12-19T09:57:16.549382+0000","last_became_active":"2023-12-19T09:41:48.880264+0000","last_became_peered":"2023-12-19T09:41:48.880264+0000","last_unstale":"2023-12-19T09:57:16.549382+0000","last_undegraded":"2023-12-19T09:57:16.549382+0000","last_fullsized":"2023-12-19T09:57:16.549382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.529624+0000","last_change":"2023-12-19T09:41:44.092861+0000","last_active":"2023-12-19T09:57:16.529624+0000","last_peered":"2023-12-19T09:57:16.529624+0000","last_clean":"2023-12-19T09:57:16.529624+0000","last_became_active":"2023-12-19T09:41:44.067765+0000","last_became_peered":"2023-12-19T09:41:44.067765+0000","last_unstale":"2023-12-19T09:57:16.529624+0000","last_undegraded":"2023-12-19T09:57:16.529624+0000","last_fullsized":"2023-12-19T09:57:16.529624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1218,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.273161+0000","last_change":"2023-12-19T09:40:55.369239+0000","last_active":"2023-12-19T09:57:17.273161+0000","last_peered":"2023-12-19T09:57:17.273161+0000","last_clean":"2023-12-19T09:57:17.273161+0000","last_became_active":"2023-12-19T09:40:55.366264+0000","last_became_peered":"2023-12-19T09:40:55.366264+0000","last_unstale":"2023-12-19T09:57:17.273161+0000","last_undegraded":"2023-12-19T09:57:17.273161+0000","last_fullsized":"2023-12-19T09:57:17.273161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1186,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.065418+0000","last_change":"2023-12-19T09:41:46.849208+0000","last_active":"2023-12-19T09:57:17.065418+0000","last_peered":"2023-12-19T09:57:17.065418+0000","last_clean":"2023-12-19T09:57:17.065418+0000","last_became_active":"2023-12-19T09:41:46.846639+0000","last_became_peered":"2023-12-19T09:41:46.846639+0000","last_unstale":"2023-12-19T09:57:17.065418+0000","last_undegraded":"2023-12-19T09:57:17.065418+0000","last_fullsized":"2023-12-19T09:57:17.065418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.451385+0000","last_change":"2023-12-19T09:41:43.967652+0000","last_active":"2023-12-19T09:57:15.451385+0000","last_peered":"2023-12-19T09:57:15.451385+0000","last_clean":"2023-12-19T09:57:15.451385+0000","last_became_active":"2023-12-19T09:41:43.965003+0000","last_became_peered":"2023-12-19T09:41:43.965003+0000","last_unstale":"2023-12-19T09:57:15.451385+0000","last_undegraded":"2023-12-19T09:57:15.451385+0000","last_fullsized":"2023-12-19T09:57:15.451385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1210,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.768475+0000","last_change":"2023-12-19T09:40:55.390358+0000","last_active":"2023-12-19T09:57:16.768475+0000","last_peered":"2023-12-19T09:57:16.768475+0000","last_clean":"2023-12-19T09:57:16.768475+0000","last_became_active":"2023-12-19T09:40:55.387550+0000","last_became_peered":"2023-12-19T09:40:55.387550+0000","last_unstale":"2023-12-19T09:57:16.768475+0000","last_undegraded":"2023-12-19T09:57:16.768475+0000","last_fullsized":"2023-12-19T09:57:16.768475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1197,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.537774+0000","last_change":"2023-12-19T09:41:48.731885+0000","last_active":"2023-12-19T09:57:16.537774+0000","last_peered":"2023-12-19T09:57:16.537774+0000","last_clean":"2023-12-19T09:57:16.537774+0000","last_became_active":"2023-12-19T09:41:48.724265+0000","last_became_peered":"2023-12-19T09:41:48.724265+0000","last_unstale":"2023-12-19T09:57:16.537774+0000","last_undegraded":"2023-12-19T09:57:16.537774+0000","last_fullsized":"2023-12-19T09:57:16.537774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.728154+0000","last_change":"2023-12-19T09:41:43.899191+0000","last_active":"2023-12-19T09:57:15.728154+0000","last_peered":"2023-12-19T09:57:15.728154+0000","last_clean":"2023-12-19T09:57:15.728154+0000","last_became_active":"2023-12-19T09:41:43.895270+0000","last_became_peered":"2023-12-19T09:41:43.895270+0000","last_unstale":"2023-12-19T09:57:15.728154+0000","last_undegraded":"2023-12-19T09:57:15.728154+0000","last_fullsized":"2023-12-19T09:57:15.728154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1216,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.976061+0000","last_change":"2023-12-19T09:40:55.370124+0000","last_active":"2023-12-19T09:57:15.976061+0000","last_peered":"2023-12-19T09:57:15.976061+0000","last_clean":"2023-12-19T09:57:15.976061+0000","last_became_active":"2023-12-19T09:40:55.366632+0000","last_became_peered":"2023-12-19T09:40:55.366632+0000","last_unstale":"2023-12-19T09:57:15.976061+0000","last_undegraded":"2023-12-19T09:57:15.976061+0000","last_fullsized":"2023-12-19T09:57:15.976061+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.053204+0000","last_change":"2023-12-19T09:41:48.960658+0000","last_active":"2023-12-19T09:57:15.053204+0000","last_peered":"2023-12-19T09:57:15.053204+0000","last_clean":"2023-12-19T09:57:15.053204+0000","last_became_active":"2023-12-19T09:41:48.957786+0000","last_became_peered":"2023-12-19T09:41:48.957786+0000","last_unstale":"2023-12-19T09:57:15.053204+0000","last_undegraded":"2023-12-19T09:57:15.053204+0000","last_fullsized":"2023-12-19T09:57:15.053204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.172532+0000","last_change":"2023-12-19T09:41:44.646026+0000","last_active":"2023-12-19T09:57:17.172532+0000","last_peered":"2023-12-19T09:57:17.172532+0000","last_clean":"2023-12-19T09:57:17.172532+0000","last_became_active":"2023-12-19T09:41:44.640388+0000","last_became_peered":"2023-12-19T09:41:44.640388+0000","last_unstale":"2023-12-19T09:57:17.172532+0000","last_undegraded":"2023-12-19T09:57:17.172532+0000","last_fullsized":"2023-12-19T09:57:17.172532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1211,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.113902+0000","last_change":"2023-12-19T09:40:55.377818+0000","last_active":"2023-12-19T09:57:17.113902+0000","last_peered":"2023-12-19T09:57:17.113902+0000","last_clean":"2023-12-19T09:57:17.113902+0000","last_became_active":"2023-12-19T09:40:55.374987+0000","last_became_peered":"2023-12-19T09:40:55.374987+0000","last_unstale":"2023-12-19T09:57:17.113902+0000","last_undegraded":"2023-12-19T09:57:17.113902+0000","last_fullsized":"2023-12-19T09:57:17.113902+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":1215,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.297522+0000","last_change":"2023-12-19T09:40:53.332271+0000","last_active":"2023-12-19T09:57:17.297522+0000","last_peered":"2023-12-19T09:57:17.297522+0000","last_clean":"2023-12-19T09:57:17.297522+0000","last_became_active":"2023-12-19T09:40:53.328758+0000","last_became_peered":"2023-12-19T09:40:53.328758+0000","last_unstale":"2023-12-19T09:57:17.297522+0000","last_undegraded":"2023-12-19T09:57:17.297522+0000","last_fullsized":"2023-12-19T09:57:17.297522+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_clean_scrub_stamp":"2023-12-19T09:40:52.293719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"36'3","reported_seq":1207,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.833538+0000","last_change":"2023-12-19T09:41:49.052920+0000","last_active":"2023-12-19T09:57:16.833538+0000","last_peered":"2023-12-19T09:57:16.833538+0000","last_clean":"2023-12-19T09:57:16.833538+0000","last_became_active":"2023-12-19T09:41:49.049321+0000","last_became_peered":"2023-12-19T09:41:49.049321+0000","last_unstale":"2023-12-19T09:57:16.833538+0000","last_undegraded":"2023-12-19T09:57:16.833538+0000","last_fullsized":"2023-12-19T09:57:16.833538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.401999+0000","last_change":"2023-12-19T09:41:44.628513+0000","last_active":"2023-12-19T09:57:17.401999+0000","last_peered":"2023-12-19T09:57:17.401999+0000","last_clean":"2023-12-19T09:57:17.401999+0000","last_became_active":"2023-12-19T09:41:44.625833+0000","last_became_peered":"2023-12-19T09:41:44.625833+0000","last_unstale":"2023-12-19T09:57:17.401999+0000","last_undegraded":"2023-12-19T09:57:17.401999+0000","last_fullsized":"2023-12-19T09:57:17.401999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.982620+0000","last_change":"2023-12-19T09:41:49.909088+0000","last_active":"2023-12-19T09:57:16.982620+0000","last_peered":"2023-12-19T09:57:16.982620+0000","last_clean":"2023-12-19T09:57:16.982620+0000","last_became_active":"2023-12-19T09:41:49.906227+0000","last_became_peered":"2023-12-19T09:41:49.906227+0000","last_unstale":"2023-12-19T09:57:16.982620+0000","last_undegraded":"2023-12-19T09:57:16.982620+0000","last_fullsized":"2023-12-19T09:57:16.982620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.333079+0000","last_change":"2023-12-19T09:41:43.791102+0000","last_active":"2023-12-19T09:57:15.333079+0000","last_peered":"2023-12-19T09:57:15.333079+0000","last_clean":"2023-12-19T09:57:15.333079+0000","last_became_active":"2023-12-19T09:41:43.788014+0000","last_became_peered":"2023-12-19T09:41:43.788014+0000","last_unstale":"2023-12-19T09:57:15.333079+0000","last_undegraded":"2023-12-19T09:57:15.333079+0000","last_fullsized":"2023-12-19T09:57:15.333079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.18","version":"57'1","reported_seq":1076,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.093795+0000","last_change":"2023-12-19T09:41:47.850812+0000","last_active":"2023-12-19T09:57:18.093795+0000","last_peered":"2023-12-19T09:57:18.093795+0000","last_clean":"2023-12-19T09:57:18.093795+0000","last_became_active":"2023-12-19T09:41:47.839786+0000","last_became_peered":"2023-12-19T09:41:47.839786+0000","last_unstale":"2023-12-19T09:57:18.093795+0000","last_undegraded":"2023-12-19T09:57:18.093795+0000","last_fullsized":"2023-12-19T09:57:18.093795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.150975+0000","last_change":"2023-12-19T09:41:44.510414+0000","last_active":"2023-12-19T09:57:16.150975+0000","last_peered":"2023-12-19T09:57:16.150975+0000","last_clean":"2023-12-19T09:57:16.150975+0000","last_became_active":"2023-12-19T09:41:44.502218+0000","last_became_peered":"2023-12-19T09:41:44.502218+0000","last_unstale":"2023-12-19T09:57:16.150975+0000","last_undegraded":"2023-12-19T09:57:16.150975+0000","last_fullsized":"2023-12-19T09:57:16.150975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1198,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.492093+0000","last_change":"2023-12-19T09:41:50.117367+0000","last_active":"2023-12-19T09:57:17.492093+0000","last_peered":"2023-12-19T09:57:17.492093+0000","last_clean":"2023-12-19T09:57:17.492093+0000","last_became_active":"2023-12-19T09:41:50.100260+0000","last_became_peered":"2023-12-19T09:41:50.100260+0000","last_unstale":"2023-12-19T09:57:17.492093+0000","last_undegraded":"2023-12-19T09:57:17.492093+0000","last_fullsized":"2023-12-19T09:57:17.492093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.025474+0000","last_change":"2023-12-19T09:41:44.694402+0000","last_active":"2023-12-19T09:57:17.025474+0000","last_peered":"2023-12-19T09:57:17.025474+0000","last_clean":"2023-12-19T09:57:17.025474+0000","last_became_active":"2023-12-19T09:41:44.689340+0000","last_became_peered":"2023-12-19T09:41:44.689340+0000","last_unstale":"2023-12-19T09:57:17.025474+0000","last_undegraded":"2023-12-19T09:57:17.025474+0000","last_fullsized":"2023-12-19T09:57:17.025474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1a","version":"24'3","reported_seq":1080,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.189487+0000","last_change":"2023-12-19T09:41:47.760578+0000","last_active":"2023-12-19T09:57:18.189487+0000","last_peered":"2023-12-19T09:57:18.189487+0000","last_clean":"2023-12-19T09:57:18.189487+0000","last_became_active":"2023-12-19T09:41:47.751422+0000","last_became_peered":"2023-12-19T09:41:47.751422+0000","last_unstale":"2023-12-19T09:57:18.189487+0000","last_undegraded":"2023-12-19T09:57:18.189487+0000","last_fullsized":"2023-12-19T09:57:18.189487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.501099+0000","last_change":"2023-12-19T09:41:44.652693+0000","last_active":"2023-12-19T09:57:17.501099+0000","last_peered":"2023-12-19T09:57:17.501099+0000","last_clean":"2023-12-19T09:57:17.501099+0000","last_became_active":"2023-12-19T09:41:44.641823+0000","last_became_peered":"2023-12-19T09:41:44.641823+0000","last_unstale":"2023-12-19T09:57:17.501099+0000","last_undegraded":"2023-12-19T09:57:17.501099+0000","last_fullsized":"2023-12-19T09:57:17.501099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1074,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.108296+0000","last_change":"2023-12-19T09:41:47.918436+0000","last_active":"2023-12-19T09:57:17.108296+0000","last_peered":"2023-12-19T09:57:17.108296+0000","last_clean":"2023-12-19T09:57:17.108296+0000","last_became_active":"2023-12-19T09:41:47.915328+0000","last_became_peered":"2023-12-19T09:41:47.915328+0000","last_unstale":"2023-12-19T09:57:17.108296+0000","last_undegraded":"2023-12-19T09:57:17.108296+0000","last_fullsized":"2023-12-19T09:57:17.108296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.223504+0000","last_change":"2023-12-19T09:41:44.622479+0000","last_active":"2023-12-19T09:57:15.223504+0000","last_peered":"2023-12-19T09:57:15.223504+0000","last_clean":"2023-12-19T09:57:15.223504+0000","last_became_active":"2023-12-19T09:41:44.611913+0000","last_became_peered":"2023-12-19T09:41:44.611913+0000","last_unstale":"2023-12-19T09:57:15.223504+0000","last_undegraded":"2023-12-19T09:57:15.223504+0000","last_fullsized":"2023-12-19T09:57:15.223504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.922722+0000","last_change":"2023-12-19T09:41:48.997784+0000","last_active":"2023-12-19T09:57:16.922722+0000","last_peered":"2023-12-19T09:57:16.922722+0000","last_clean":"2023-12-19T09:57:16.922722+0000","last_became_active":"2023-12-19T09:41:48.992519+0000","last_became_peered":"2023-12-19T09:41:48.992519+0000","last_unstale":"2023-12-19T09:57:16.922722+0000","last_undegraded":"2023-12-19T09:57:16.922722+0000","last_fullsized":"2023-12-19T09:57:16.922722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.269180+0000","last_change":"2023-12-19T09:41:44.528794+0000","last_active":"2023-12-19T09:57:17.269180+0000","last_peered":"2023-12-19T09:57:17.269180+0000","last_clean":"2023-12-19T09:57:17.269180+0000","last_became_active":"2023-12-19T09:41:44.520591+0000","last_became_peered":"2023-12-19T09:41:44.520591+0000","last_unstale":"2023-12-19T09:57:17.269180+0000","last_undegraded":"2023-12-19T09:57:17.269180+0000","last_fullsized":"2023-12-19T09:57:17.269180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"45'3","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.122531+0000","last_change":"2023-12-19T09:41:47.021642+0000","last_active":"2023-12-19T09:57:15.122531+0000","last_peered":"2023-12-19T09:57:15.122531+0000","last_clean":"2023-12-19T09:57:15.122531+0000","last_became_active":"2023-12-19T09:41:47.010899+0000","last_became_peered":"2023-12-19T09:41:47.010899+0000","last_unstale":"2023-12-19T09:57:15.122531+0000","last_undegraded":"2023-12-19T09:57:15.122531+0000","last_fullsized":"2023-12-19T09:57:15.122531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.228486+0000","last_change":"2023-12-19T09:41:44.704700+0000","last_active":"2023-12-19T09:57:17.228486+0000","last_peered":"2023-12-19T09:57:17.228486+0000","last_clean":"2023-12-19T09:57:17.228486+0000","last_became_active":"2023-12-19T09:41:44.689193+0000","last_became_peered":"2023-12-19T09:41:44.689193+0000","last_unstale":"2023-12-19T09:57:17.228486+0000","last_undegraded":"2023-12-19T09:57:17.228486+0000","last_fullsized":"2023-12-19T09:57:17.228486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.972364+0000","last_change":"2023-12-19T09:41:50.654472+0000","last_active":"2023-12-19T09:57:16.972364+0000","last_peered":"2023-12-19T09:57:16.972364+0000","last_clean":"2023-12-19T09:57:16.972364+0000","last_became_active":"2023-12-19T09:41:50.645171+0000","last_became_peered":"2023-12-19T09:41:50.645171+0000","last_unstale":"2023-12-19T09:57:16.972364+0000","last_undegraded":"2023-12-19T09:57:16.972364+0000","last_fullsized":"2023-12-19T09:57:16.972364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.790161+0000","last_change":"2023-12-19T09:41:44.648689+0000","last_active":"2023-12-19T09:57:17.790161+0000","last_peered":"2023-12-19T09:57:17.790161+0000","last_clean":"2023-12-19T09:57:17.790161+0000","last_became_active":"2023-12-19T09:41:44.635214+0000","last_became_peered":"2023-12-19T09:41:44.635214+0000","last_unstale":"2023-12-19T09:57:17.790161+0000","last_undegraded":"2023-12-19T09:57:17.790161+0000","last_fullsized":"2023-12-19T09:57:17.790161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1","version":"32'3","reported_seq":1079,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.206891+0000","last_change":"2023-12-19T09:41:47.793198+0000","last_active":"2023-12-19T09:57:18.206891+0000","last_peered":"2023-12-19T09:57:18.206891+0000","last_clean":"2023-12-19T09:57:18.206891+0000","last_became_active":"2023-12-19T09:41:47.781592+0000","last_became_peered":"2023-12-19T09:41:47.781592+0000","last_unstale":"2023-12-19T09:57:18.206891+0000","last_undegraded":"2023-12-19T09:57:18.206891+0000","last_fullsized":"2023-12-19T09:57:18.206891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.974154+0000","last_change":"2023-12-19T09:41:43.991485+0000","last_active":"2023-12-19T09:57:16.974154+0000","last_peered":"2023-12-19T09:57:16.974154+0000","last_clean":"2023-12-19T09:57:16.974154+0000","last_became_active":"2023-12-19T09:41:43.985931+0000","last_became_peered":"2023-12-19T09:41:43.985931+0000","last_unstale":"2023-12-19T09:57:16.974154+0000","last_undegraded":"2023-12-19T09:57:16.974154+0000","last_fullsized":"2023-12-19T09:57:16.974154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1187,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.581304+0000","last_change":"2023-12-19T09:41:46.831650+0000","last_active":"2023-12-19T09:57:16.581304+0000","last_peered":"2023-12-19T09:57:16.581304+0000","last_clean":"2023-12-19T09:57:16.581304+0000","last_became_active":"2023-12-19T09:41:46.825353+0000","last_became_peered":"2023-12-19T09:41:46.825353+0000","last_unstale":"2023-12-19T09:57:16.581304+0000","last_undegraded":"2023-12-19T09:57:16.581304+0000","last_fullsized":"2023-12-19T09:57:16.581304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1191,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.498107+0000","last_change":"2023-12-19T09:41:44.065242+0000","last_active":"2023-12-19T09:57:15.498107+0000","last_peered":"2023-12-19T09:57:15.498107+0000","last_clean":"2023-12-19T09:57:15.498107+0000","last_became_active":"2023-12-19T09:41:44.062711+0000","last_became_peered":"2023-12-19T09:41:44.062711+0000","last_unstale":"2023-12-19T09:57:15.498107+0000","last_undegraded":"2023-12-19T09:57:15.498107+0000","last_fullsized":"2023-12-19T09:57:15.498107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1186,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.298978+0000","last_change":"2023-12-19T09:41:46.880242+0000","last_active":"2023-12-19T09:57:17.298978+0000","last_peered":"2023-12-19T09:57:17.298978+0000","last_clean":"2023-12-19T09:57:17.298978+0000","last_became_active":"2023-12-19T09:41:46.877617+0000","last_became_peered":"2023-12-19T09:41:46.877617+0000","last_unstale":"2023-12-19T09:57:17.298978+0000","last_undegraded":"2023-12-19T09:57:17.298978+0000","last_fullsized":"2023-12-19T09:57:17.298978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.931091+0000","last_change":"2023-12-19T09:41:44.513456+0000","last_active":"2023-12-19T09:57:15.931091+0000","last_peered":"2023-12-19T09:57:15.931091+0000","last_clean":"2023-12-19T09:57:15.931091+0000","last_became_active":"2023-12-19T09:41:44.493716+0000","last_became_peered":"2023-12-19T09:41:44.493716+0000","last_unstale":"2023-12-19T09:57:15.931091+0000","last_undegraded":"2023-12-19T09:57:15.931091+0000","last_fullsized":"2023-12-19T09:57:15.931091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1076,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.203696+0000","last_change":"2023-12-19T09:41:47.979679+0000","last_active":"2023-12-19T09:57:18.203696+0000","last_peered":"2023-12-19T09:57:18.203696+0000","last_clean":"2023-12-19T09:57:18.203696+0000","last_became_active":"2023-12-19T09:41:47.964957+0000","last_became_peered":"2023-12-19T09:41:47.964957+0000","last_unstale":"2023-12-19T09:57:18.203696+0000","last_undegraded":"2023-12-19T09:57:18.203696+0000","last_fullsized":"2023-12-19T09:57:18.203696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1024,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":119420,"kb_used_data":7796,"kb_used_omap":0,"kb_used_meta":111616,"kb_avail":104738180,"statfs":{"total":107374182400,"available":107251896320,"internally_reserved":0,"allocated":7983104,"data_stored":5042706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114294784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":60500,"kb_used_data":7180,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104797100,"statfs":{"total":107374182400,"available":107312230400,"internally_reserved":0,"allocated":7352320,"data_stored":4443559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654706585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":114480,"kb_used_data":7016,"kb_used_omap":0,"kb_used_meta":107456,"kb_avail":104743120,"statfs":{"total":107374182400,"available":107256954880,"internally_reserved":0,"allocated":7184384,"data_stored":4442162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110034944},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654706584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":61232,"kb_used_data":7912,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104796368,"statfs":{"total":107374182400,"available":107311480832,"internally_reserved":0,"allocated":8101888,"data_stored":5031711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-19T09:57:20.621 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T09:57:20.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T09:57:20.732 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.728+0000 7f614a75e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:20.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.733+0000 7f614a75e640 1 Processor -- start 2023-12-19T09:57:20.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.733+0000 7f614a75e640 1 -- start start 2023-12-19T09:57:20.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.734+0000 7f614a75e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f614409f1a0 0x7f614409f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.734+0000 7f614a75e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614409d580 con 0x7f6144131690 2023-12-19T09:57:20.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.734+0000 7f614a75e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614409aa30 con 0x7f614409f1a0 2023-12-19T09:57:20.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.734+0000 7f61437fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f614409f1a0 0x7f614409f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.734+0000 7f61437fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f614409f1a0 0x7f614409f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51452/0 (socket says 172.21.15.99:51452) 2023-12-19T09:57:20.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.734+0000 7f6143fff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6144131690 0x7f614409ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50402/0 (socket says 172.21.15.99:50402) 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.734+0000 7f61437fe640 1 -- 172.21.15.99:0/2054519737 learned_addr learned my addr 172.21.15.99:0/2054519737 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.735+0000 7f61437fe640 1 -- 172.21.15.99:0/2054519737 >> v1:172.21.15.99:6789/0 conn(0x7f6144131690 legacy=0x7f614409ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.735+0000 7f61437fe640 1 -- 172.21.15.99:0/2054519737 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144099d10 con 0x7f614409f1a0 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.735+0000 7f61437fe640 1 --2- 172.21.15.99:0/2054519737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f614409f5b0 crc :-1 s=READY pgs=12659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2510ec7a624529 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.735+0000 7f6142ffd640 1 -- 172.21.15.99:0/2054519737 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f6138009dd0 con 0x7f614409f1a0 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.735+0000 7f6142ffd640 1 -- 172.21.15.99:0/2054519737 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f613800e230 con 0x7f614409f1a0 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.735+0000 7f6142ffd640 1 -- 172.21.15.99:0/2054519737 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f613800e4d0 con 0x7f614409f1a0 2023-12-19T09:57:20.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.736+0000 7f614a75e640 1 -- 172.21.15.99:0/2054519737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 msgr2=0x7f614409f5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.739 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.736+0000 7f614a75e640 1 --2- 172.21.15.99:0/2054519737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f614409f5b0 crc :-1 s=READY pgs=12659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.739 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.736+0000 7f614a75e640 1 -- 172.21.15.99:0/2054519737 shutdown_connections 2023-12-19T09:57:20.739 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.736+0000 7f614a75e640 1 --2- 172.21.15.99:0/2054519737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f614409f5b0 unknown :-1 s=CLOSED pgs=12659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.739 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.736+0000 7f614a75e640 1 -- 172.21.15.99:0/2054519737 >> 172.21.15.99:0/2054519737 conn(0x7f6144098a20 msgr2=0x7f6144098e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:20.739 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.736+0000 7f614a75e640 1 -- 172.21.15.99:0/2054519737 shutdown_connections 2023-12-19T09:57:20.739 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.736+0000 7f614a75e640 1 -- 172.21.15.99:0/2054519737 wait complete. 2023-12-19T09:57:20.739 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.737+0000 7f614a75e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:20.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.738+0000 7f614a75e640 1 Processor -- start 2023-12-19T09:57:20.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.738+0000 7f614a75e640 1 -- start start 2023-12-19T09:57:20.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.739+0000 7f614a75e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f6144127fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.739+0000 7f614a75e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144071280 con 0x7f614409f1a0 2023-12-19T09:57:20.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6143fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f6144127fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6143fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f6144127fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51456/0 (socket says 172.21.15.99:51456) 2023-12-19T09:57:20.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6143fff640 1 -- 172.21.15.99:0/839919779 learned_addr learned my addr 172.21.15.99:0/839919779 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:20.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6143fff640 1 -- 172.21.15.99:0/839919779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614411ab50 con 0x7f614409f1a0 2023-12-19T09:57:20.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6143fff640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f6144127fc0 crc :-1 s=READY pgs=12660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6140ff9640 1 -- 172.21.15.99:0/839919779 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f61340071e0 con 0x7f614409f1a0 2023-12-19T09:57:20.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6140ff9640 1 -- 172.21.15.99:0/839919779 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f6134007340 con 0x7f614409f1a0 2023-12-19T09:57:20.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6144072380 con 0x7f614409f1a0 2023-12-19T09:57:20.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f6140ff9640 1 -- 172.21.15.99:0/839919779 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f61340075e0 con 0x7f614409f1a0 2023-12-19T09:57:20.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.740+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6144072730 con 0x7f614409f1a0 2023-12-19T09:57:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.741+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6144071a30 con 0x7f614409f1a0 2023-12-19T09:57:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.742+0000 7f6140ff9640 1 -- 172.21.15.99:0/839919779 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f61340057e0 con 0x7f614409f1a0 2023-12-19T09:57:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.742+0000 7f6140ff9640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f61300377c0 0x7f6130039cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.742+0000 7f6140ff9640 1 -- 172.21.15.99:0/839919779 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7f6134047010 con 0x7f614409f1a0 2023-12-19T09:57:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.742+0000 7f61437fe640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f61300377c0 0x7f6130039cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.743+0000 7f61437fe640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f61300377c0 0x7f6130039cd0 crc :-1 s=READY pgs=3644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.750+0000 7f6140ff9640 1 -- 172.21.15.99:0/839919779 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f613400d330 con 0x7f614409f1a0 2023-12-19T09:57:20.922 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.922+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f614409bdc0 con 0x7f61300377c0 2023-12-19T09:57:20.930 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.930+0000 7f6140ff9640 1 -- 172.21.15.99:0/839919779 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+184177 (crc 0 0 0) 0x7f6138009df0 con 0x7f61300377c0 2023-12-19T09:57:20.932 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:57:20.933 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2023-12-19T09:57:20.935 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f61300377c0 msgr2=0x7f6130039cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.935 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f61300377c0 0x7f6130039cd0 crc :-1 s=READY pgs=3644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.935 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 msgr2=0x7f6144127fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:20.935 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f6144127fc0 crc :-1 s=READY pgs=12660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 shutdown_connections 2023-12-19T09:57:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f61300377c0 0x7f6130039cd0 unknown :-1 s=CLOSED pgs=3644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 --2- 172.21.15.99:0/839919779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614409f1a0 0x7f6144127fc0 unknown :-1 s=CLOSED pgs=12660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 >> 172.21.15.99:0/839919779 conn(0x7f6144098a20 msgr2=0x7f614412e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 shutdown_connections 2023-12-19T09:57:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:20.933+0000 7f614a75e640 1 -- 172.21.15.99:0/839919779 wait complete. 2023-12-19T09:57:20.945 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1181,"stamp":"2023-12-19T09:57:20.497625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591397,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":152,"num_write_kb":1909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":355632,"kb_used_data":29904,"kb_used_omap":0,"kb_used_meta":325696,"kb_avail":419074768,"statfs":{"total":429496729600,"available":429132562432,"internally_reserved":0,"allocated":30621696,"data_stored":18960138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":333512704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17682,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-373,"num_write_kb":-373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001582"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.215434+0000","last_change":"2023-12-19T09:41:43.996729+0000","last_active":"2023-12-19T09:57:15.215434+0000","last_peered":"2023-12-19T09:57:15.215434+0000","last_clean":"2023-12-19T09:57:15.215434+0000","last_became_active":"2023-12-19T09:41:43.988867+0000","last_became_peered":"2023-12-19T09:41:43.988867+0000","last_unstale":"2023-12-19T09:57:15.215434+0000","last_undegraded":"2023-12-19T09:57:15.215434+0000","last_fullsized":"2023-12-19T09:57:15.215434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.974542+0000","last_change":"2023-12-19T09:41:49.091716+0000","last_active":"2023-12-19T09:57:15.974542+0000","last_peered":"2023-12-19T09:57:15.974542+0000","last_clean":"2023-12-19T09:57:15.974542+0000","last_became_active":"2023-12-19T09:41:49.078919+0000","last_became_peered":"2023-12-19T09:41:49.078919+0000","last_unstale":"2023-12-19T09:57:15.974542+0000","last_undegraded":"2023-12-19T09:57:15.974542+0000","last_fullsized":"2023-12-19T09:57:15.974542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.776271+0000","last_change":"2023-12-19T09:41:44.097849+0000","last_active":"2023-12-19T09:57:17.776271+0000","last_peered":"2023-12-19T09:57:17.776271+0000","last_clean":"2023-12-19T09:57:17.776271+0000","last_became_active":"2023-12-19T09:41:44.070813+0000","last_became_peered":"2023-12-19T09:41:44.070813+0000","last_unstale":"2023-12-19T09:57:17.776271+0000","last_undegraded":"2023-12-19T09:57:17.776271+0000","last_fullsized":"2023-12-19T09:57:17.776271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.830375+0000","last_change":"2023-12-19T09:41:47.646204+0000","last_active":"2023-12-19T09:57:17.830375+0000","last_peered":"2023-12-19T09:57:17.830375+0000","last_clean":"2023-12-19T09:57:17.830375+0000","last_became_active":"2023-12-19T09:41:47.638438+0000","last_became_peered":"2023-12-19T09:41:47.638438+0000","last_unstale":"2023-12-19T09:57:17.830375+0000","last_undegraded":"2023-12-19T09:57:17.830375+0000","last_fullsized":"2023-12-19T09:57:17.830375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.060098+0000","last_change":"2023-12-19T09:41:44.414780+0000","last_active":"2023-12-19T09:57:16.060098+0000","last_peered":"2023-12-19T09:57:16.060098+0000","last_clean":"2023-12-19T09:57:16.060098+0000","last_became_active":"2023-12-19T09:41:44.399400+0000","last_became_peered":"2023-12-19T09:41:44.399400+0000","last_unstale":"2023-12-19T09:57:16.060098+0000","last_undegraded":"2023-12-19T09:57:16.060098+0000","last_fullsized":"2023-12-19T09:57:16.060098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.272185+0000","last_change":"2023-12-19T09:41:48.952590+0000","last_active":"2023-12-19T09:57:16.272185+0000","last_peered":"2023-12-19T09:57:16.272185+0000","last_clean":"2023-12-19T09:57:16.272185+0000","last_became_active":"2023-12-19T09:41:48.947301+0000","last_became_peered":"2023-12-19T09:41:48.947301+0000","last_unstale":"2023-12-19T09:57:16.272185+0000","last_undegraded":"2023-12-19T09:57:16.272185+0000","last_fullsized":"2023-12-19T09:57:16.272185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.637016+0000","last_change":"2023-12-19T09:41:44.707713+0000","last_active":"2023-12-19T09:57:17.637016+0000","last_peered":"2023-12-19T09:57:17.637016+0000","last_clean":"2023-12-19T09:57:17.637016+0000","last_became_active":"2023-12-19T09:41:44.695211+0000","last_became_peered":"2023-12-19T09:41:44.695211+0000","last_unstale":"2023-12-19T09:57:17.637016+0000","last_undegraded":"2023-12-19T09:57:17.637016+0000","last_fullsized":"2023-12-19T09:57:17.637016+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.810718+0000","last_change":"2023-12-19T09:41:48.985139+0000","last_active":"2023-12-19T09:57:15.810718+0000","last_peered":"2023-12-19T09:57:15.810718+0000","last_clean":"2023-12-19T09:57:15.810718+0000","last_became_active":"2023-12-19T09:41:48.981358+0000","last_became_peered":"2023-12-19T09:41:48.981358+0000","last_unstale":"2023-12-19T09:57:15.810718+0000","last_undegraded":"2023-12-19T09:57:15.810718+0000","last_fullsized":"2023-12-19T09:57:15.810718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.497635+0000","last_change":"2023-12-19T09:41:44.014471+0000","last_active":"2023-12-19T09:57:17.497635+0000","last_peered":"2023-12-19T09:57:17.497635+0000","last_clean":"2023-12-19T09:57:17.497635+0000","last_became_active":"2023-12-19T09:41:44.010134+0000","last_became_peered":"2023-12-19T09:41:44.010134+0000","last_unstale":"2023-12-19T09:57:17.497635+0000","last_undegraded":"2023-12-19T09:57:17.497635+0000","last_fullsized":"2023-12-19T09:57:17.497635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.a","version":"48'3","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.788019+0000","last_change":"2023-12-19T09:41:50.049917+0000","last_active":"2023-12-19T09:57:17.788019+0000","last_peered":"2023-12-19T09:57:17.788019+0000","last_clean":"2023-12-19T09:57:17.788019+0000","last_became_active":"2023-12-19T09:41:50.042450+0000","last_became_peered":"2023-12-19T09:41:50.042450+0000","last_unstale":"2023-12-19T09:57:17.788019+0000","last_undegraded":"2023-12-19T09:57:17.788019+0000","last_fullsized":"2023-12-19T09:57:17.788019+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.032342+0000","last_change":"2023-12-19T09:41:44.728818+0000","last_active":"2023-12-19T09:57:18.032342+0000","last_peered":"2023-12-19T09:57:18.032342+0000","last_clean":"2023-12-19T09:57:18.032342+0000","last_became_active":"2023-12-19T09:41:44.723909+0000","last_became_peered":"2023-12-19T09:41:44.723909+0000","last_unstale":"2023-12-19T09:57:18.032342+0000","last_undegraded":"2023-12-19T09:57:18.032342+0000","last_fullsized":"2023-12-19T09:57:18.032342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1200,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.576213+0000","last_change":"2023-12-19T09:41:47.838325+0000","last_active":"2023-12-19T09:57:17.576213+0000","last_peered":"2023-12-19T09:57:17.576213+0000","last_clean":"2023-12-19T09:57:17.576213+0000","last_became_active":"2023-12-19T09:41:47.832642+0000","last_became_peered":"2023-12-19T09:41:47.832642+0000","last_unstale":"2023-12-19T09:57:17.576213+0000","last_undegraded":"2023-12-19T09:57:17.576213+0000","last_fullsized":"2023-12-19T09:57:17.576213+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.252148+0000","last_change":"2023-12-19T09:41:44.592810+0000","last_active":"2023-12-19T09:57:18.252148+0000","last_peered":"2023-12-19T09:57:18.252148+0000","last_clean":"2023-12-19T09:57:18.252148+0000","last_became_active":"2023-12-19T09:41:44.585031+0000","last_became_peered":"2023-12-19T09:41:44.585031+0000","last_unstale":"2023-12-19T09:57:18.252148+0000","last_undegraded":"2023-12-19T09:57:18.252148+0000","last_fullsized":"2023-12-19T09:57:18.252148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.229948+0000","last_change":"2023-12-19T09:41:47.669623+0000","last_active":"2023-12-19T09:57:18.229948+0000","last_peered":"2023-12-19T09:57:18.229948+0000","last_clean":"2023-12-19T09:57:18.229948+0000","last_became_active":"2023-12-19T09:41:47.651334+0000","last_became_peered":"2023-12-19T09:41:47.651334+0000","last_unstale":"2023-12-19T09:57:18.229948+0000","last_undegraded":"2023-12-19T09:57:18.229948+0000","last_fullsized":"2023-12-19T09:57:18.229948+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.175349+0000","last_change":"2023-12-19T09:41:43.967186+0000","last_active":"2023-12-19T09:57:15.175349+0000","last_peered":"2023-12-19T09:57:15.175349+0000","last_clean":"2023-12-19T09:57:15.175349+0000","last_became_active":"2023-12-19T09:41:43.956781+0000","last_became_peered":"2023-12-19T09:41:43.956781+0000","last_unstale":"2023-12-19T09:57:15.175349+0000","last_undegraded":"2023-12-19T09:57:15.175349+0000","last_fullsized":"2023-12-19T09:57:15.175349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.902654+0000","last_change":"2023-12-19T09:41:50.824272+0000","last_active":"2023-12-19T09:57:16.902654+0000","last_peered":"2023-12-19T09:57:16.902654+0000","last_clean":"2023-12-19T09:57:16.902654+0000","last_became_active":"2023-12-19T09:41:50.819734+0000","last_became_peered":"2023-12-19T09:41:50.819734+0000","last_unstale":"2023-12-19T09:57:16.902654+0000","last_undegraded":"2023-12-19T09:57:16.902654+0000","last_fullsized":"2023-12-19T09:57:16.902654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.199867+0000","last_change":"2023-12-19T09:41:43.948061+0000","last_active":"2023-12-19T09:57:17.199867+0000","last_peered":"2023-12-19T09:57:17.199867+0000","last_clean":"2023-12-19T09:57:17.199867+0000","last_became_active":"2023-12-19T09:41:43.945414+0000","last_became_peered":"2023-12-19T09:41:43.945414+0000","last_unstale":"2023-12-19T09:57:17.199867+0000","last_undegraded":"2023-12-19T09:57:17.199867+0000","last_fullsized":"2023-12-19T09:57:17.199867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"30'3","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.792964+0000","last_change":"2023-12-19T09:41:48.128963+0000","last_active":"2023-12-19T09:57:16.792964+0000","last_peered":"2023-12-19T09:57:16.792964+0000","last_clean":"2023-12-19T09:57:16.792964+0000","last_became_active":"2023-12-19T09:41:48.126255+0000","last_became_peered":"2023-12-19T09:41:48.126255+0000","last_unstale":"2023-12-19T09:57:16.792964+0000","last_undegraded":"2023-12-19T09:57:16.792964+0000","last_fullsized":"2023-12-19T09:57:16.792964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.021359+0000","last_change":"2023-12-19T09:41:44.807942+0000","last_active":"2023-12-19T09:57:18.021359+0000","last_peered":"2023-12-19T09:57:18.021359+0000","last_clean":"2023-12-19T09:57:18.021359+0000","last_became_active":"2023-12-19T09:41:44.792603+0000","last_became_peered":"2023-12-19T09:41:44.792603+0000","last_unstale":"2023-12-19T09:57:18.021359+0000","last_undegraded":"2023-12-19T09:57:18.021359+0000","last_fullsized":"2023-12-19T09:57:18.021359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1205,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.730650+0000","last_change":"2023-12-19T09:41:50.700445+0000","last_active":"2023-12-19T09:57:17.730650+0000","last_peered":"2023-12-19T09:57:17.730650+0000","last_clean":"2023-12-19T09:57:17.730650+0000","last_became_active":"2023-12-19T09:41:50.697862+0000","last_became_peered":"2023-12-19T09:41:50.697862+0000","last_unstale":"2023-12-19T09:57:17.730650+0000","last_undegraded":"2023-12-19T09:57:17.730650+0000","last_fullsized":"2023-12-19T09:57:17.730650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.647865+0000","last_change":"2023-12-19T09:41:43.864107+0000","last_active":"2023-12-19T09:57:16.647865+0000","last_peered":"2023-12-19T09:57:16.647865+0000","last_clean":"2023-12-19T09:57:16.647865+0000","last_became_active":"2023-12-19T09:41:43.861579+0000","last_became_peered":"2023-12-19T09:41:43.861579+0000","last_unstale":"2023-12-19T09:57:16.647865+0000","last_undegraded":"2023-12-19T09:57:16.647865+0000","last_fullsized":"2023-12-19T09:57:16.647865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1184,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.086474+0000","last_change":"2023-12-19T09:41:46.851420+0000","last_active":"2023-12-19T09:57:15.086474+0000","last_peered":"2023-12-19T09:57:15.086474+0000","last_clean":"2023-12-19T09:57:15.086474+0000","last_became_active":"2023-12-19T09:41:46.841291+0000","last_became_peered":"2023-12-19T09:41:46.841291+0000","last_unstale":"2023-12-19T09:57:15.086474+0000","last_undegraded":"2023-12-19T09:57:15.086474+0000","last_fullsized":"2023-12-19T09:57:15.086474+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.133104+0000","last_change":"2023-12-19T09:41:44.833180+0000","last_active":"2023-12-19T09:57:17.133104+0000","last_peered":"2023-12-19T09:57:17.133104+0000","last_clean":"2023-12-19T09:57:17.133104+0000","last_became_active":"2023-12-19T09:41:44.829928+0000","last_became_peered":"2023-12-19T09:41:44.829928+0000","last_unstale":"2023-12-19T09:57:17.133104+0000","last_undegraded":"2023-12-19T09:57:17.133104+0000","last_fullsized":"2023-12-19T09:57:17.133104+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1075,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.496095+0000","last_change":"2023-12-19T09:41:47.003324+0000","last_active":"2023-12-19T09:57:17.496095+0000","last_peered":"2023-12-19T09:57:17.496095+0000","last_clean":"2023-12-19T09:57:17.496095+0000","last_became_active":"2023-12-19T09:41:46.996512+0000","last_became_peered":"2023-12-19T09:41:46.996512+0000","last_unstale":"2023-12-19T09:57:17.496095+0000","last_undegraded":"2023-12-19T09:57:17.496095+0000","last_fullsized":"2023-12-19T09:57:17.496095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.224327+0000","last_change":"2023-12-19T09:41:44.771796+0000","last_active":"2023-12-19T09:57:18.224327+0000","last_peered":"2023-12-19T09:57:18.224327+0000","last_clean":"2023-12-19T09:57:18.224327+0000","last_became_active":"2023-12-19T09:41:44.765249+0000","last_became_peered":"2023-12-19T09:41:44.765249+0000","last_unstale":"2023-12-19T09:57:18.224327+0000","last_undegraded":"2023-12-19T09:57:18.224327+0000","last_fullsized":"2023-12-19T09:57:18.224327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1210,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.006602+0000","last_change":"2023-12-19T09:40:55.377872+0000","last_active":"2023-12-19T09:57:16.006602+0000","last_peered":"2023-12-19T09:57:16.006602+0000","last_clean":"2023-12-19T09:57:16.006602+0000","last_became_active":"2023-12-19T09:40:55.374430+0000","last_became_peered":"2023-12-19T09:40:55.374430+0000","last_unstale":"2023-12-19T09:57:16.006602+0000","last_undegraded":"2023-12-19T09:57:16.006602+0000","last_fullsized":"2023-12-19T09:57:16.006602+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.871144+0000","last_change":"2023-12-19T09:41:49.534320+0000","last_active":"2023-12-19T09:57:15.871144+0000","last_peered":"2023-12-19T09:57:15.871144+0000","last_clean":"2023-12-19T09:57:15.871144+0000","last_became_active":"2023-12-19T09:41:49.152035+0000","last_became_peered":"2023-12-19T09:41:49.152035+0000","last_unstale":"2023-12-19T09:57:15.871144+0000","last_undegraded":"2023-12-19T09:57:15.871144+0000","last_fullsized":"2023-12-19T09:57:15.871144+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.921005+0000","last_change":"2023-12-19T09:41:44.539061+0000","last_active":"2023-12-19T09:57:16.921005+0000","last_peered":"2023-12-19T09:57:16.921005+0000","last_clean":"2023-12-19T09:57:16.921005+0000","last_became_active":"2023-12-19T09:41:44.523963+0000","last_became_peered":"2023-12-19T09:41:44.523963+0000","last_unstale":"2023-12-19T09:57:16.921005+0000","last_undegraded":"2023-12-19T09:57:16.921005+0000","last_fullsized":"2023-12-19T09:57:16.921005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.295466+0000","last_change":"2023-12-19T09:40:55.373709+0000","last_active":"2023-12-19T09:57:15.295466+0000","last_peered":"2023-12-19T09:57:15.295466+0000","last_clean":"2023-12-19T09:57:15.295466+0000","last_became_active":"2023-12-19T09:40:55.370833+0000","last_became_peered":"2023-12-19T09:40:55.370833+0000","last_unstale":"2023-12-19T09:57:15.295466+0000","last_undegraded":"2023-12-19T09:57:15.295466+0000","last_fullsized":"2023-12-19T09:57:15.295466+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.165684+0000","last_change":"2023-12-19T09:41:49.775064+0000","last_active":"2023-12-19T09:57:17.165684+0000","last_peered":"2023-12-19T09:57:17.165684+0000","last_clean":"2023-12-19T09:57:17.165684+0000","last_became_active":"2023-12-19T09:41:49.756848+0000","last_became_peered":"2023-12-19T09:41:49.756848+0000","last_unstale":"2023-12-19T09:57:17.165684+0000","last_undegraded":"2023-12-19T09:57:17.165684+0000","last_fullsized":"2023-12-19T09:57:17.165684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.126505+0000","last_change":"2023-12-19T09:41:43.867265+0000","last_active":"2023-12-19T09:57:17.126505+0000","last_peered":"2023-12-19T09:57:17.126505+0000","last_clean":"2023-12-19T09:57:17.126505+0000","last_became_active":"2023-12-19T09:41:43.863691+0000","last_became_peered":"2023-12-19T09:41:43.863691+0000","last_unstale":"2023-12-19T09:57:17.126505+0000","last_undegraded":"2023-12-19T09:57:17.126505+0000","last_fullsized":"2023-12-19T09:57:17.126505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1084,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.161294+0000","last_change":"2023-12-19T09:40:55.385057+0000","last_active":"2023-12-19T09:57:17.161294+0000","last_peered":"2023-12-19T09:57:17.161294+0000","last_clean":"2023-12-19T09:57:17.161294+0000","last_became_active":"2023-12-19T09:40:55.376880+0000","last_became_peered":"2023-12-19T09:40:55.376880+0000","last_unstale":"2023-12-19T09:57:17.161294+0000","last_undegraded":"2023-12-19T09:57:17.161294+0000","last_fullsized":"2023-12-19T09:57:17.161294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.920110+0000","last_change":"2023-12-19T09:41:51.637214+0000","last_active":"2023-12-19T09:57:16.920110+0000","last_peered":"2023-12-19T09:57:16.920110+0000","last_clean":"2023-12-19T09:57:16.920110+0000","last_became_active":"2023-12-19T09:41:51.634526+0000","last_became_peered":"2023-12-19T09:41:51.634526+0000","last_unstale":"2023-12-19T09:57:16.920110+0000","last_undegraded":"2023-12-19T09:57:16.920110+0000","last_fullsized":"2023-12-19T09:57:16.920110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"25'7","reported_seq":1225,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.333160+0000","last_change":"2023-12-19T09:41:44.543364+0000","last_active":"2023-12-19T09:57:17.333160+0000","last_peered":"2023-12-19T09:57:17.333160+0000","last_clean":"2023-12-19T09:57:17.333160+0000","last_became_active":"2023-12-19T09:41:44.536492+0000","last_became_peered":"2023-12-19T09:41:44.536492+0000","last_unstale":"2023-12-19T09:57:17.333160+0000","last_undegraded":"2023-12-19T09:57:17.333160+0000","last_fullsized":"2023-12-19T09:57:17.333160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:14.974989+0000","last_change":"2023-12-19T09:40:55.375889+0000","last_active":"2023-12-19T09:57:14.974989+0000","last_peered":"2023-12-19T09:57:14.974989+0000","last_clean":"2023-12-19T09:57:14.974989+0000","last_became_active":"2023-12-19T09:40:55.367503+0000","last_became_peered":"2023-12-19T09:40:55.367503+0000","last_unstale":"2023-12-19T09:57:14.974989+0000","last_undegraded":"2023-12-19T09:57:14.974989+0000","last_fullsized":"2023-12-19T09:57:14.974989+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.14","version":"40'3","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.549382+0000","last_change":"2023-12-19T09:41:48.888516+0000","last_active":"2023-12-19T09:57:16.549382+0000","last_peered":"2023-12-19T09:57:16.549382+0000","last_clean":"2023-12-19T09:57:16.549382+0000","last_became_active":"2023-12-19T09:41:48.880264+0000","last_became_peered":"2023-12-19T09:41:48.880264+0000","last_unstale":"2023-12-19T09:57:16.549382+0000","last_undegraded":"2023-12-19T09:57:16.549382+0000","last_fullsized":"2023-12-19T09:57:16.549382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.529624+0000","last_change":"2023-12-19T09:41:44.092861+0000","last_active":"2023-12-19T09:57:16.529624+0000","last_peered":"2023-12-19T09:57:16.529624+0000","last_clean":"2023-12-19T09:57:16.529624+0000","last_became_active":"2023-12-19T09:41:44.067765+0000","last_became_peered":"2023-12-19T09:41:44.067765+0000","last_unstale":"2023-12-19T09:57:16.529624+0000","last_undegraded":"2023-12-19T09:57:16.529624+0000","last_fullsized":"2023-12-19T09:57:16.529624+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1218,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.273161+0000","last_change":"2023-12-19T09:40:55.369239+0000","last_active":"2023-12-19T09:57:17.273161+0000","last_peered":"2023-12-19T09:57:17.273161+0000","last_clean":"2023-12-19T09:57:17.273161+0000","last_became_active":"2023-12-19T09:40:55.366264+0000","last_became_peered":"2023-12-19T09:40:55.366264+0000","last_unstale":"2023-12-19T09:57:17.273161+0000","last_undegraded":"2023-12-19T09:57:17.273161+0000","last_fullsized":"2023-12-19T09:57:17.273161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1186,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.065418+0000","last_change":"2023-12-19T09:41:46.849208+0000","last_active":"2023-12-19T09:57:17.065418+0000","last_peered":"2023-12-19T09:57:17.065418+0000","last_clean":"2023-12-19T09:57:17.065418+0000","last_became_active":"2023-12-19T09:41:46.846639+0000","last_became_peered":"2023-12-19T09:41:46.846639+0000","last_unstale":"2023-12-19T09:57:17.065418+0000","last_undegraded":"2023-12-19T09:57:17.065418+0000","last_fullsized":"2023-12-19T09:57:17.065418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.451385+0000","last_change":"2023-12-19T09:41:43.967652+0000","last_active":"2023-12-19T09:57:15.451385+0000","last_peered":"2023-12-19T09:57:15.451385+0000","last_clean":"2023-12-19T09:57:15.451385+0000","last_became_active":"2023-12-19T09:41:43.965003+0000","last_became_peered":"2023-12-19T09:41:43.965003+0000","last_unstale":"2023-12-19T09:57:15.451385+0000","last_undegraded":"2023-12-19T09:57:15.451385+0000","last_fullsized":"2023-12-19T09:57:15.451385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1210,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.768475+0000","last_change":"2023-12-19T09:40:55.390358+0000","last_active":"2023-12-19T09:57:16.768475+0000","last_peered":"2023-12-19T09:57:16.768475+0000","last_clean":"2023-12-19T09:57:16.768475+0000","last_became_active":"2023-12-19T09:40:55.387550+0000","last_became_peered":"2023-12-19T09:40:55.387550+0000","last_unstale":"2023-12-19T09:57:16.768475+0000","last_undegraded":"2023-12-19T09:57:16.768475+0000","last_fullsized":"2023-12-19T09:57:16.768475+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1197,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.537774+0000","last_change":"2023-12-19T09:41:48.731885+0000","last_active":"2023-12-19T09:57:16.537774+0000","last_peered":"2023-12-19T09:57:16.537774+0000","last_clean":"2023-12-19T09:57:16.537774+0000","last_became_active":"2023-12-19T09:41:48.724265+0000","last_became_peered":"2023-12-19T09:41:48.724265+0000","last_unstale":"2023-12-19T09:57:16.537774+0000","last_undegraded":"2023-12-19T09:57:16.537774+0000","last_fullsized":"2023-12-19T09:57:16.537774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.728154+0000","last_change":"2023-12-19T09:41:43.899191+0000","last_active":"2023-12-19T09:57:15.728154+0000","last_peered":"2023-12-19T09:57:15.728154+0000","last_clean":"2023-12-19T09:57:15.728154+0000","last_became_active":"2023-12-19T09:41:43.895270+0000","last_became_peered":"2023-12-19T09:41:43.895270+0000","last_unstale":"2023-12-19T09:57:15.728154+0000","last_undegraded":"2023-12-19T09:57:15.728154+0000","last_fullsized":"2023-12-19T09:57:15.728154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1216,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.976061+0000","last_change":"2023-12-19T09:40:55.370124+0000","last_active":"2023-12-19T09:57:15.976061+0000","last_peered":"2023-12-19T09:57:15.976061+0000","last_clean":"2023-12-19T09:57:15.976061+0000","last_became_active":"2023-12-19T09:40:55.366632+0000","last_became_peered":"2023-12-19T09:40:55.366632+0000","last_unstale":"2023-12-19T09:57:15.976061+0000","last_undegraded":"2023-12-19T09:57:15.976061+0000","last_fullsized":"2023-12-19T09:57:15.976061+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1202,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.053204+0000","last_change":"2023-12-19T09:41:48.960658+0000","last_active":"2023-12-19T09:57:15.053204+0000","last_peered":"2023-12-19T09:57:15.053204+0000","last_clean":"2023-12-19T09:57:15.053204+0000","last_became_active":"2023-12-19T09:41:48.957786+0000","last_became_peered":"2023-12-19T09:41:48.957786+0000","last_unstale":"2023-12-19T09:57:15.053204+0000","last_undegraded":"2023-12-19T09:57:15.053204+0000","last_fullsized":"2023-12-19T09:57:15.053204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.172532+0000","last_change":"2023-12-19T09:41:44.646026+0000","last_active":"2023-12-19T09:57:17.172532+0000","last_peered":"2023-12-19T09:57:17.172532+0000","last_clean":"2023-12-19T09:57:17.172532+0000","last_became_active":"2023-12-19T09:41:44.640388+0000","last_became_peered":"2023-12-19T09:41:44.640388+0000","last_unstale":"2023-12-19T09:57:17.172532+0000","last_undegraded":"2023-12-19T09:57:17.172532+0000","last_fullsized":"2023-12-19T09:57:17.172532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1211,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.113902+0000","last_change":"2023-12-19T09:40:55.377818+0000","last_active":"2023-12-19T09:57:17.113902+0000","last_peered":"2023-12-19T09:57:17.113902+0000","last_clean":"2023-12-19T09:57:17.113902+0000","last_became_active":"2023-12-19T09:40:55.374987+0000","last_became_peered":"2023-12-19T09:40:55.374987+0000","last_unstale":"2023-12-19T09:57:17.113902+0000","last_undegraded":"2023-12-19T09:57:17.113902+0000","last_fullsized":"2023-12-19T09:57:17.113902+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":1215,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.297522+0000","last_change":"2023-12-19T09:40:53.332271+0000","last_active":"2023-12-19T09:57:17.297522+0000","last_peered":"2023-12-19T09:57:17.297522+0000","last_clean":"2023-12-19T09:57:17.297522+0000","last_became_active":"2023-12-19T09:40:53.328758+0000","last_became_peered":"2023-12-19T09:40:53.328758+0000","last_unstale":"2023-12-19T09:57:17.297522+0000","last_undegraded":"2023-12-19T09:57:17.297522+0000","last_fullsized":"2023-12-19T09:57:17.297522+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_clean_scrub_stamp":"2023-12-19T09:40:52.293719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"36'3","reported_seq":1207,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.833538+0000","last_change":"2023-12-19T09:41:49.052920+0000","last_active":"2023-12-19T09:57:16.833538+0000","last_peered":"2023-12-19T09:57:16.833538+0000","last_clean":"2023-12-19T09:57:16.833538+0000","last_became_active":"2023-12-19T09:41:49.049321+0000","last_became_peered":"2023-12-19T09:41:49.049321+0000","last_unstale":"2023-12-19T09:57:16.833538+0000","last_undegraded":"2023-12-19T09:57:16.833538+0000","last_fullsized":"2023-12-19T09:57:16.833538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1192,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.401999+0000","last_change":"2023-12-19T09:41:44.628513+0000","last_active":"2023-12-19T09:57:17.401999+0000","last_peered":"2023-12-19T09:57:17.401999+0000","last_clean":"2023-12-19T09:57:17.401999+0000","last_became_active":"2023-12-19T09:41:44.625833+0000","last_became_peered":"2023-12-19T09:41:44.625833+0000","last_unstale":"2023-12-19T09:57:17.401999+0000","last_undegraded":"2023-12-19T09:57:17.401999+0000","last_fullsized":"2023-12-19T09:57:17.401999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1203,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.982620+0000","last_change":"2023-12-19T09:41:49.909088+0000","last_active":"2023-12-19T09:57:16.982620+0000","last_peered":"2023-12-19T09:57:16.982620+0000","last_clean":"2023-12-19T09:57:16.982620+0000","last_became_active":"2023-12-19T09:41:49.906227+0000","last_became_peered":"2023-12-19T09:41:49.906227+0000","last_unstale":"2023-12-19T09:57:16.982620+0000","last_undegraded":"2023-12-19T09:57:16.982620+0000","last_fullsized":"2023-12-19T09:57:16.982620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.333079+0000","last_change":"2023-12-19T09:41:43.791102+0000","last_active":"2023-12-19T09:57:15.333079+0000","last_peered":"2023-12-19T09:57:15.333079+0000","last_clean":"2023-12-19T09:57:15.333079+0000","last_became_active":"2023-12-19T09:41:43.788014+0000","last_became_peered":"2023-12-19T09:41:43.788014+0000","last_unstale":"2023-12-19T09:57:15.333079+0000","last_undegraded":"2023-12-19T09:57:15.333079+0000","last_fullsized":"2023-12-19T09:57:15.333079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.18","version":"57'1","reported_seq":1076,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.093795+0000","last_change":"2023-12-19T09:41:47.850812+0000","last_active":"2023-12-19T09:57:18.093795+0000","last_peered":"2023-12-19T09:57:18.093795+0000","last_clean":"2023-12-19T09:57:18.093795+0000","last_became_active":"2023-12-19T09:41:47.839786+0000","last_became_peered":"2023-12-19T09:41:47.839786+0000","last_unstale":"2023-12-19T09:57:18.093795+0000","last_undegraded":"2023-12-19T09:57:18.093795+0000","last_fullsized":"2023-12-19T09:57:18.093795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.150975+0000","last_change":"2023-12-19T09:41:44.510414+0000","last_active":"2023-12-19T09:57:16.150975+0000","last_peered":"2023-12-19T09:57:16.150975+0000","last_clean":"2023-12-19T09:57:16.150975+0000","last_became_active":"2023-12-19T09:41:44.502218+0000","last_became_peered":"2023-12-19T09:41:44.502218+0000","last_unstale":"2023-12-19T09:57:16.150975+0000","last_undegraded":"2023-12-19T09:57:16.150975+0000","last_fullsized":"2023-12-19T09:57:16.150975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1198,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.492093+0000","last_change":"2023-12-19T09:41:50.117367+0000","last_active":"2023-12-19T09:57:17.492093+0000","last_peered":"2023-12-19T09:57:17.492093+0000","last_clean":"2023-12-19T09:57:17.492093+0000","last_became_active":"2023-12-19T09:41:50.100260+0000","last_became_peered":"2023-12-19T09:41:50.100260+0000","last_unstale":"2023-12-19T09:57:17.492093+0000","last_undegraded":"2023-12-19T09:57:17.492093+0000","last_fullsized":"2023-12-19T09:57:17.492093+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.025474+0000","last_change":"2023-12-19T09:41:44.694402+0000","last_active":"2023-12-19T09:57:17.025474+0000","last_peered":"2023-12-19T09:57:17.025474+0000","last_clean":"2023-12-19T09:57:17.025474+0000","last_became_active":"2023-12-19T09:41:44.689340+0000","last_became_peered":"2023-12-19T09:41:44.689340+0000","last_unstale":"2023-12-19T09:57:17.025474+0000","last_undegraded":"2023-12-19T09:57:17.025474+0000","last_fullsized":"2023-12-19T09:57:17.025474+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1a","version":"24'3","reported_seq":1080,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.189487+0000","last_change":"2023-12-19T09:41:47.760578+0000","last_active":"2023-12-19T09:57:18.189487+0000","last_peered":"2023-12-19T09:57:18.189487+0000","last_clean":"2023-12-19T09:57:18.189487+0000","last_became_active":"2023-12-19T09:41:47.751422+0000","last_became_peered":"2023-12-19T09:41:47.751422+0000","last_unstale":"2023-12-19T09:57:18.189487+0000","last_undegraded":"2023-12-19T09:57:18.189487+0000","last_fullsized":"2023-12-19T09:57:18.189487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.501099+0000","last_change":"2023-12-19T09:41:44.652693+0000","last_active":"2023-12-19T09:57:17.501099+0000","last_peered":"2023-12-19T09:57:17.501099+0000","last_clean":"2023-12-19T09:57:17.501099+0000","last_became_active":"2023-12-19T09:41:44.641823+0000","last_became_peered":"2023-12-19T09:41:44.641823+0000","last_unstale":"2023-12-19T09:57:17.501099+0000","last_undegraded":"2023-12-19T09:57:17.501099+0000","last_fullsized":"2023-12-19T09:57:17.501099+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1074,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.108296+0000","last_change":"2023-12-19T09:41:47.918436+0000","last_active":"2023-12-19T09:57:17.108296+0000","last_peered":"2023-12-19T09:57:17.108296+0000","last_clean":"2023-12-19T09:57:17.108296+0000","last_became_active":"2023-12-19T09:41:47.915328+0000","last_became_peered":"2023-12-19T09:41:47.915328+0000","last_unstale":"2023-12-19T09:57:17.108296+0000","last_undegraded":"2023-12-19T09:57:17.108296+0000","last_fullsized":"2023-12-19T09:57:17.108296+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.223504+0000","last_change":"2023-12-19T09:41:44.622479+0000","last_active":"2023-12-19T09:57:15.223504+0000","last_peered":"2023-12-19T09:57:15.223504+0000","last_clean":"2023-12-19T09:57:15.223504+0000","last_became_active":"2023-12-19T09:41:44.611913+0000","last_became_peered":"2023-12-19T09:41:44.611913+0000","last_unstale":"2023-12-19T09:57:15.223504+0000","last_undegraded":"2023-12-19T09:57:15.223504+0000","last_fullsized":"2023-12-19T09:57:15.223504+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.922722+0000","last_change":"2023-12-19T09:41:48.997784+0000","last_active":"2023-12-19T09:57:16.922722+0000","last_peered":"2023-12-19T09:57:16.922722+0000","last_clean":"2023-12-19T09:57:16.922722+0000","last_became_active":"2023-12-19T09:41:48.992519+0000","last_became_peered":"2023-12-19T09:41:48.992519+0000","last_unstale":"2023-12-19T09:57:16.922722+0000","last_undegraded":"2023-12-19T09:57:16.922722+0000","last_fullsized":"2023-12-19T09:57:16.922722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.269180+0000","last_change":"2023-12-19T09:41:44.528794+0000","last_active":"2023-12-19T09:57:17.269180+0000","last_peered":"2023-12-19T09:57:17.269180+0000","last_clean":"2023-12-19T09:57:17.269180+0000","last_became_active":"2023-12-19T09:41:44.520591+0000","last_became_peered":"2023-12-19T09:41:44.520591+0000","last_unstale":"2023-12-19T09:57:17.269180+0000","last_undegraded":"2023-12-19T09:57:17.269180+0000","last_fullsized":"2023-12-19T09:57:17.269180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"45'3","reported_seq":1190,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.122531+0000","last_change":"2023-12-19T09:41:47.021642+0000","last_active":"2023-12-19T09:57:15.122531+0000","last_peered":"2023-12-19T09:57:15.122531+0000","last_clean":"2023-12-19T09:57:15.122531+0000","last_became_active":"2023-12-19T09:41:47.010899+0000","last_became_peered":"2023-12-19T09:41:47.010899+0000","last_unstale":"2023-12-19T09:57:15.122531+0000","last_undegraded":"2023-12-19T09:57:15.122531+0000","last_fullsized":"2023-12-19T09:57:15.122531+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1078,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.228486+0000","last_change":"2023-12-19T09:41:44.704700+0000","last_active":"2023-12-19T09:57:17.228486+0000","last_peered":"2023-12-19T09:57:17.228486+0000","last_clean":"2023-12-19T09:57:17.228486+0000","last_became_active":"2023-12-19T09:41:44.689193+0000","last_became_peered":"2023-12-19T09:41:44.689193+0000","last_unstale":"2023-12-19T09:57:17.228486+0000","last_undegraded":"2023-12-19T09:57:17.228486+0000","last_fullsized":"2023-12-19T09:57:17.228486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1196,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.972364+0000","last_change":"2023-12-19T09:41:50.654472+0000","last_active":"2023-12-19T09:57:16.972364+0000","last_peered":"2023-12-19T09:57:16.972364+0000","last_clean":"2023-12-19T09:57:16.972364+0000","last_became_active":"2023-12-19T09:41:50.645171+0000","last_became_peered":"2023-12-19T09:41:50.645171+0000","last_unstale":"2023-12-19T09:57:16.972364+0000","last_undegraded":"2023-12-19T09:57:16.972364+0000","last_fullsized":"2023-12-19T09:57:16.972364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1206,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.790161+0000","last_change":"2023-12-19T09:41:44.648689+0000","last_active":"2023-12-19T09:57:17.790161+0000","last_peered":"2023-12-19T09:57:17.790161+0000","last_clean":"2023-12-19T09:57:17.790161+0000","last_became_active":"2023-12-19T09:41:44.635214+0000","last_became_peered":"2023-12-19T09:41:44.635214+0000","last_unstale":"2023-12-19T09:57:17.790161+0000","last_undegraded":"2023-12-19T09:57:17.790161+0000","last_fullsized":"2023-12-19T09:57:17.790161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1","version":"32'3","reported_seq":1079,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.206891+0000","last_change":"2023-12-19T09:41:47.793198+0000","last_active":"2023-12-19T09:57:18.206891+0000","last_peered":"2023-12-19T09:57:18.206891+0000","last_clean":"2023-12-19T09:57:18.206891+0000","last_became_active":"2023-12-19T09:41:47.781592+0000","last_became_peered":"2023-12-19T09:41:47.781592+0000","last_unstale":"2023-12-19T09:57:18.206891+0000","last_undegraded":"2023-12-19T09:57:18.206891+0000","last_fullsized":"2023-12-19T09:57:18.206891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1212,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.974154+0000","last_change":"2023-12-19T09:41:43.991485+0000","last_active":"2023-12-19T09:57:16.974154+0000","last_peered":"2023-12-19T09:57:16.974154+0000","last_clean":"2023-12-19T09:57:16.974154+0000","last_became_active":"2023-12-19T09:41:43.985931+0000","last_became_peered":"2023-12-19T09:41:43.985931+0000","last_unstale":"2023-12-19T09:57:16.974154+0000","last_undegraded":"2023-12-19T09:57:16.974154+0000","last_fullsized":"2023-12-19T09:57:16.974154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1187,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:16.581304+0000","last_change":"2023-12-19T09:41:46.831650+0000","last_active":"2023-12-19T09:57:16.581304+0000","last_peered":"2023-12-19T09:57:16.581304+0000","last_clean":"2023-12-19T09:57:16.581304+0000","last_became_active":"2023-12-19T09:41:46.825353+0000","last_became_peered":"2023-12-19T09:41:46.825353+0000","last_unstale":"2023-12-19T09:57:16.581304+0000","last_undegraded":"2023-12-19T09:57:16.581304+0000","last_fullsized":"2023-12-19T09:57:16.581304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1191,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.498107+0000","last_change":"2023-12-19T09:41:44.065242+0000","last_active":"2023-12-19T09:57:15.498107+0000","last_peered":"2023-12-19T09:57:15.498107+0000","last_clean":"2023-12-19T09:57:15.498107+0000","last_became_active":"2023-12-19T09:41:44.062711+0000","last_became_peered":"2023-12-19T09:41:44.062711+0000","last_unstale":"2023-12-19T09:57:15.498107+0000","last_undegraded":"2023-12-19T09:57:15.498107+0000","last_fullsized":"2023-12-19T09:57:15.498107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1186,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:17.298978+0000","last_change":"2023-12-19T09:41:46.880242+0000","last_active":"2023-12-19T09:57:17.298978+0000","last_peered":"2023-12-19T09:57:17.298978+0000","last_clean":"2023-12-19T09:57:17.298978+0000","last_became_active":"2023-12-19T09:41:46.877617+0000","last_became_peered":"2023-12-19T09:41:46.877617+0000","last_unstale":"2023-12-19T09:57:17.298978+0000","last_undegraded":"2023-12-19T09:57:17.298978+0000","last_fullsized":"2023-12-19T09:57:17.298978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1204,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:15.931091+0000","last_change":"2023-12-19T09:41:44.513456+0000","last_active":"2023-12-19T09:57:15.931091+0000","last_peered":"2023-12-19T09:57:15.931091+0000","last_clean":"2023-12-19T09:57:15.931091+0000","last_became_active":"2023-12-19T09:41:44.493716+0000","last_became_peered":"2023-12-19T09:41:44.493716+0000","last_unstale":"2023-12-19T09:57:15.931091+0000","last_undegraded":"2023-12-19T09:57:15.931091+0000","last_fullsized":"2023-12-19T09:57:15.931091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1076,"reported_epoch":692,"state":"active+clean","last_fresh":"2023-12-19T09:57:18.203696+0000","last_change":"2023-12-19T09:41:47.979679+0000","last_active":"2023-12-19T09:57:18.203696+0000","last_peered":"2023-12-19T09:57:18.203696+0000","last_clean":"2023-12-19T09:57:18.203696+0000","last_became_active":"2023-12-19T09:41:47.964957+0000","last_became_peered":"2023-12-19T09:41:47.964957+0000","last_unstale":"2023-12-19T09:57:18.203696+0000","last_undegraded":"2023-12-19T09:57:18.203696+0000","last_fullsized":"2023-12-19T09:57:18.203696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1024,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":119420,"kb_used_data":7796,"kb_used_omap":0,"kb_used_meta":111616,"kb_avail":104738180,"statfs":{"total":107374182400,"available":107251896320,"internally_reserved":0,"allocated":7983104,"data_stored":5042706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114294784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":60500,"kb_used_data":7180,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104797100,"statfs":{"total":107374182400,"available":107312230400,"internally_reserved":0,"allocated":7352320,"data_stored":4443559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654706585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":114480,"kb_used_data":7016,"kb_used_omap":0,"kb_used_meta":107456,"kb_avail":104743120,"statfs":{"total":107374182400,"available":107256954880,"internally_reserved":0,"allocated":7184384,"data_stored":4442162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110034944},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654706584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":61232,"kb_used_data":7912,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104796368,"statfs":{"total":107374182400,"available":107311480832,"internally_reserved":0,"allocated":8101888,"data_stored":5031711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-19T09:57:20.947 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T09:57:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.054+0000 7f7c89b1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.058+0000 7f7c89b1e640 1 Processor -- start 2023-12-19T09:57:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.058+0000 7f7c89b1e640 1 -- start start 2023-12-19T09:57:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c89b1e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7c840a0fc0 0x7f7c84133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c89b1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8409deb0 con 0x7f7c840a0bb0 2023-12-19T09:57:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c89b1e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8409d2b0 con 0x7f7c840a0fc0 2023-12-19T09:57:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c82ffd640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7c840a0fc0 0x7f7c84133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c837fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7c840a0bb0 0x7f7c84132f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50418/0 (socket says 172.21.15.99:50418) 2023-12-19T09:57:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c837fe640 1 -- 172.21.15.99:0/1764476543 learned_addr learned my addr 172.21.15.99:0/1764476543 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c82ffd640 1 -- 172.21.15.99:0/1764476543 >> v1:172.21.15.99:6789/0 conn(0x7f7c840a0bb0 legacy=0x7f7c84132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c82ffd640 1 -- 172.21.15.99:0/1764476543 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c841302d0 con 0x7f7c840a0fc0 2023-12-19T09:57:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c82ffd640 1 --2- 172.21.15.99:0/1764476543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0fc0 0x7f7c84133620 crc :-1 s=READY pgs=12662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46df3a86b77b0dac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c827fc640 1 -- 172.21.15.99:0/1764476543 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c78009ce0 con 0x7f7c840a0fc0 2023-12-19T09:57:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c827fc640 1 -- 172.21.15.99:0/1764476543 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7c78009e40 con 0x7f7c840a0fc0 2023-12-19T09:57:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.059+0000 7f7c827fc640 1 -- 172.21.15.99:0/1764476543 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c7800e360 con 0x7f7c840a0fc0 2023-12-19T09:57:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 1 -- 172.21.15.99:0/1764476543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0fc0 msgr2=0x7f7c84133620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:21.061 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 1 --2- 172.21.15.99:0/1764476543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0fc0 0x7f7c84133620 crc :-1 s=READY pgs=12662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 1 -- 172.21.15.99:0/1764476543 shutdown_connections 2023-12-19T09:57:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 1 --2- 172.21.15.99:0/1764476543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0fc0 0x7f7c84133620 unknown :-1 s=CLOSED pgs=12662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 1 -- 172.21.15.99:0/1764476543 >> 172.21.15.99:0/1764476543 conn(0x7f7c8406c9a0 msgr2=0x7f7c8406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 1 -- 172.21.15.99:0/1764476543 shutdown_connections 2023-12-19T09:57:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 1 -- 172.21.15.99:0/1764476543 wait complete. 2023-12-19T09:57:21.062 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.061+0000 7f7c89b1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.062+0000 7f7c89b1e640 1 Processor -- start 2023-12-19T09:57:21.063 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.063+0000 7f7c89b1e640 1 -- start start 2023-12-19T09:57:21.064 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c89b1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0bb0 0x7f7c8411b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:21.064 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c89b1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8411e830 con 0x7f7c840a0bb0 2023-12-19T09:57:21.064 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c837fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0bb0 0x7f7c8411b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:21.064 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c837fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0bb0 0x7f7c8411b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51460/0 (socket says 172.21.15.99:51460) 2023-12-19T09:57:21.065 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c837fe640 1 -- 172.21.15.99:0/3638659582 learned_addr learned my addr 172.21.15.99:0/3638659582 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:21.065 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c837fe640 1 -- 172.21.15.99:0/3638659582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8411db90 con 0x7f7c840a0bb0 2023-12-19T09:57:21.065 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c837fe640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0bb0 0x7f7c8411b7f0 crc :-1 s=READY pgs=12663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:21.065 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c6bfff640 1 -- 172.21.15.99:0/3638659582 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c740058a0 con 0x7f7c840a0bb0 2023-12-19T09:57:21.065 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8412f670 con 0x7f7c840a0bb0 2023-12-19T09:57:21.065 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c6bfff640 1 -- 172.21.15.99:0/3638659582 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f7c74005a00 con 0x7f7c840a0bb0 2023-12-19T09:57:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.064+0000 7f7c6bfff640 1 -- 172.21.15.99:0/3638659582 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f7c74005ca0 con 0x7f7c840a0bb0 2023-12-19T09:57:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.065+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8411f660 con 0x7f7c840a0bb0 2023-12-19T09:57:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.066+0000 7f7c6bfff640 1 -- 172.21.15.99:0/3638659582 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f7c740070b0 con 0x7f7c840a0bb0 2023-12-19T09:57:21.066 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.066+0000 7f7c6bfff640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f7c700377c0 0x7f7c70039cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.066+0000 7f7c6bfff640 1 -- 172.21.15.99:0/3638659582 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7f7c74046fd0 con 0x7f7c840a0bb0 2023-12-19T09:57:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.066+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84062350 con 0x7f7c840a0bb0 2023-12-19T09:57:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.066+0000 7f7c82ffd640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f7c700377c0 0x7f7c70039cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:21.067 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.067+0000 7f7c82ffd640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f7c700377c0 0x7f7c70039cd0 crc :-1 s=READY pgs=3645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:21.074 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.074+0000 7f7c6bfff640 1 -- 172.21.15.99:0/3638659582 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f7c7400f230 con 0x7f7c840a0bb0 2023-12-19T09:57:21.250 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.251+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c8411d190 con 0x7f7c840a0bb0 2023-12-19T09:57:21.252 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.252+0000 7f7c6bfff640 1 -- 172.21.15.99:0/3638659582 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v693) v1 ==== 74+0+12817 (crc 0 0 0) 0x7f7c7400d570 con 0x7f7c840a0bb0 2023-12-19T09:57:21.252 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:57:21.252 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":693,"fsid":"8e93e3b6-2270-4fce-ac6b-2175b078bbce","created":"2023-12-19T09:40:44.025359+0000","modified":"2023-12-19T09:57:19.549632+0000","last_up_change":"2023-12-19T09:40:50.288497+0000","last_in_change":"2023-12-19T09:40:46.130913+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":123,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T09:40:52.286068+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-19T09:40:54.281968+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"ceph_test_rados_api_asio","create_time":"2023-12-19T09:41:41.804764+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi099-84807-1","create_time":"2023-12-19T09:41:42.082744+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"774e1dc8-872f-44c8-9e3e-aabe7df13883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":686,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":1010486646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":1010486646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":1010486646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":1010486646}]},"public_addr":"172.21.15.99:6800/1010486646","cluster_addr":"172.21.15.99:6801/1010486646","heartbeat_back_addr":"172.21.15.99:6805/1010486646","heartbeat_front_addr":"172.21.15.99:6804/1010486646","state":["exists","up"]},{"osd":1,"uuid":"842562c8-a91c-40f8-9fd3-349029d8a22f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":686,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6803","nonce":2107593797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2107593797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6807","nonce":2107593797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2107593797}]},"public_addr":"172.21.15.99:6803/2107593797","cluster_addr":"172.21.15.99:6802/2107593797","heartbeat_back_addr":"172.21.15.99:6807/2107593797","heartbeat_front_addr":"172.21.15.99:6806/2107593797","state":["exists","up"]},{"osd":2,"uuid":"7e895fab-1cdf-4c49-80ca-f2b0afb4c81d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":685,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1424444103}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1424444103}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1424444103}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":1424444103}]},"public_addr":"172.21.15.178:6803/1424444103","cluster_addr":"172.21.15.178:6802/1424444103","heartbeat_back_addr":"172.21.15.178:6806/1424444103","heartbeat_front_addr":"172.21.15.178:6807/1424444103","state":["exists","up"]},{"osd":3,"uuid":"f686ffba-6c3b-455d-a204-4a79387f0382","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":684,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":248859203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":248859203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":248859203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":248859203}]},"public_addr":"172.21.15.178:6804/248859203","cluster_addr":"172.21.15.178:6805/248859203","heartbeat_back_addr":"172.21.15.178:6809/248859203","heartbeat_front_addr":"172.21.15.178:6808/248859203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":13,"snaps":[{"begin":1,"length":1},{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1}]},{"pool":16,"snaps":[{"begin":1,"length":1},{"begin":3,"length":1},{"begin":5,"length":1},{"begin":7,"length":1},{"begin":9,"length":2}]},{"pool":45,"snaps":[{"begin":2,"length":2},{"begin":6,"length":2},{"begin":11,"length":2}]},{"pool":50,"snaps":[{"begin":2,"length":2},{"begin":6,"length":2},{"begin":13,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T09:57:21.254 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f7c700377c0 msgr2=0x7f7c70039cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:21.254 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f7c700377c0 0x7f7c70039cd0 crc :-1 s=READY pgs=3645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0bb0 msgr2=0x7f7c8411b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0bb0 0x7f7c8411b7f0 crc :-1 s=READY pgs=12663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 shutdown_connections 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f7c700377c0 0x7f7c70039cd0 unknown :-1 s=CLOSED pgs=3645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 --2- 172.21.15.99:0/3638659582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c840a0bb0 0x7f7c8411b7f0 unknown :-1 s=CLOSED pgs=12663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.254+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 >> 172.21.15.99:0/3638659582 conn(0x7f7c8406c9a0 msgr2=0x7f7c840a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.255+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 shutdown_connections 2023-12-19T09:57:21.255 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:21.255+0000 7f7c89b1e640 1 -- 172.21.15.99:0/3638659582 wait complete. 2023-12-19T09:57:22.267 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T09:57:22.267 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T09:57:22.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.405+0000 7f4aa2c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.412 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.413+0000 7f4aa2c6d640 1 Processor -- start 2023-12-19T09:57:22.413 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.413+0000 7f4aa2c6d640 1 -- start start 2023-12-19T09:57:22.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.413+0000 7f4aa2c6d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a9c06fee0 0x7f4a9c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa2c6d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c072340 con 0x7f4a9c133170 2023-12-19T09:57:22.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa2c6d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c070830 con 0x7f4a9c06fee0 2023-12-19T09:57:22.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa0a09640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a9c06fee0 0x7f4a9c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa0a09640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a9c06fee0 0x7f4a9c0702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51462/0 (socket says 172.21.15.99:51462) 2023-12-19T09:57:22.415 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa0a09640 1 -- 172.21.15.99:0/508962099 learned_addr learned my addr 172.21.15.99:0/508962099 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4a93fff640 1 --1- 172.21.15.99:0/508962099 >> v1:172.21.15.99:6789/0 conn(0x7f4a9c133170 0x7f4a9c135590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50426/0 (socket says 172.21.15.99:50426) 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa0a09640 1 -- 172.21.15.99:0/508962099 >> v1:172.21.15.99:6789/0 conn(0x7f4a9c133170 legacy=0x7f4a9c135590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa0a09640 1 -- 172.21.15.99:0/508962099 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c071720 con 0x7f4a9c06fee0 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4aa0a09640 1 --2- 172.21.15.99:0/508962099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c0702f0 crc :-1 s=READY pgs=12665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a29497290872bdc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4a937fe640 1 -- 172.21.15.99:0/508962099 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a98009dd0 con 0x7f4a9c06fee0 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4a937fe640 1 -- 172.21.15.99:0/508962099 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4a9800e230 con 0x7f4a9c06fee0 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.414+0000 7f4a937fe640 1 -- 172.21.15.99:0/508962099 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a9800e4d0 con 0x7f4a9c06fee0 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/508962099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 msgr2=0x7f4a9c0702f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.416 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/508962099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c0702f0 crc :-1 s=READY pgs=12665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/508962099 shutdown_connections 2023-12-19T09:57:22.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/508962099 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c0702f0 unknown :-1 s=CLOSED pgs=12665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/508962099 >> 172.21.15.99:0/508962099 conn(0x7f4a9c09daf0 msgr2=0x7f4a9c09df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:22.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/508962099 shutdown_connections 2023-12-19T09:57:22.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/508962099 wait complete. 2023-12-19T09:57:22.417 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.415+0000 7f4aa2c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.419 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.417+0000 7f4aa2c6d640 1 Processor -- start 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.417+0000 7f4aa2c6d640 1 -- start start 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa2c6d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c130590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa2c6d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c12e290 con 0x7f4a9c06fee0 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa0a09640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c130590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa0a09640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c130590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51478/0 (socket says 172.21.15.99:51478) 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa0a09640 1 -- 172.21.15.99:0/2671259594 learned_addr learned my addr 172.21.15.99:0/2671259594 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa0a09640 1 -- 172.21.15.99:0/2671259594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c12c450 con 0x7f4a9c06fee0 2023-12-19T09:57:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa0a09640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c130590 crc :-1 s=READY pgs=12666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4a917fa640 1 -- 172.21.15.99:0/2671259594 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a98014410 con 0x7f4a9c06fee0 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4a917fa640 1 -- 172.21.15.99:0/2671259594 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f4a98014570 con 0x7f4a9c06fee0 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c12df60 con 0x7f4a9c06fee0 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4a917fa640 1 -- 172.21.15.99:0/2671259594 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f4a98014810 con 0x7f4a9c06fee0 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.418+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c12e620 con 0x7f4a9c06fee0 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.419+0000 7f4a917fa640 1 -- 172.21.15.99:0/2671259594 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f4a980149c0 con 0x7f4a9c06fee0 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.419+0000 7f4a917fa640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4a88037810 0x7f4a88039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.419+0000 7f4a917fa640 1 -- 172.21.15.99:0/2671259594 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7f4a98019040 con 0x7f4a9c06fee0 2023-12-19T09:57:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.420+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/2671259594 >> v2:172.21.15.99:6800/1010486646 conn(0x7f4a9c133170 0x7f4a9c130ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.420+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 --> v2:172.21.15.99:6800/1010486646 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a9c09d540 con 0x7f4a9c133170 2023-12-19T09:57:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.420+0000 7f4a93fff640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4a88037810 0x7f4a88039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.420+0000 7f4a93fff640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4a88037810 0x7f4a88039d20 crc :-1 s=READY pgs=3646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.421+0000 7f4aa120a640 1 --2- 172.21.15.99:0/2671259594 >> v2:172.21.15.99:6800/1010486646 conn(0x7f4a9c133170 0x7f4a9c130ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:57:22.423 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.423+0000 7f4aa120a640 1 --2- 172.21.15.99:0/2671259594 >> v2:172.21.15.99:6800/1010486646 conn(0x7f4a9c133170 0x7f4a9c130ad0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.424 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.424+0000 7f4a917fa640 1 -- 172.21.15.99:0/2671259594 <== osd.0 v2:172.21.15.99:6800/1010486646 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7f4a9400a820 con 0x7f4a9c133170 2023-12-19T09:57:22.427 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.428+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 --> v2:172.21.15.99:6800/1010486646 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a9c09e870 con 0x7f4a9c133170 2023-12-19T09:57:22.428 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4a917fa640 1 -- 172.21.15.99:0/2671259594 <== osd.0 v2:172.21.15.99:6800/1010486646 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+22 (crc 0 0 0) 0x7f4a9400ad10 con 0x7f4a9c133170 2023-12-19T09:57:22.428 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-12-19T09:57:22.429 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "" 2023-12-19T09:57:22.429 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-12-19T09:57:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 >> v2:172.21.15.99:6800/1010486646 conn(0x7f4a9c133170 msgr2=0x7f4a9c130ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/2671259594 >> v2:172.21.15.99:6800/1010486646 conn(0x7f4a9c133170 0x7f4a9c130ad0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4a88037810 msgr2=0x7f4a88039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4a88037810 0x7f4a88039d20 crc :-1 s=READY pgs=3646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 msgr2=0x7f4a9c130590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c130590 crc :-1 s=READY pgs=12666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 shutdown_connections 2023-12-19T09:57:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f4a88037810 0x7f4a88039d20 unknown :-1 s=CLOSED pgs=3646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/2671259594 >> v2:172.21.15.99:6800/1010486646 conn(0x7f4a9c133170 0x7f4a9c130ad0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 --2- 172.21.15.99:0/2671259594 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a9c06fee0 0x7f4a9c130590 unknown :-1 s=CLOSED pgs=12666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 >> 172.21.15.99:0/2671259594 conn(0x7f4a9c09daf0 msgr2=0x7f4a9c099490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 shutdown_connections 2023-12-19T09:57:22.431 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.429+0000 7f4aa2c6d640 1 -- 172.21.15.99:0/2671259594 wait complete. 2023-12-19T09:57:22.440 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T09:57:22.549 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.545+0000 7f5276617640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.549 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.550+0000 7f5276617640 1 Processor -- start 2023-12-19T09:57:22.550 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.550+0000 7f5276617640 1 -- start start 2023-12-19T09:57:22.551 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f5276617640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f52700a0bb0 0x7f5270132f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.551 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f5276617640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527009deb0 con 0x7f52700a0fc0 2023-12-19T09:57:22.551 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f5276617640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527009d2b0 con 0x7f52700a0bb0 2023-12-19T09:57:22.551 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526ffff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f52700a0bb0 0x7f5270132f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526f7fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f52700a0fc0 0x7f5270133450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50428/0 (socket says 172.21.15.99:50428) 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526f7fe640 1 -- 172.21.15.99:0/3163041295 learned_addr learned my addr 172.21.15.99:0/3163041295 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526ffff640 1 --2- 172.21.15.99:0/3163041295 >> v2:172.21.15.99:3300/0 conn(0x7f52700a0bb0 0x7f5270132f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51482/0 (socket says 172.21.15.99:51482) 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526ffff640 1 -- 172.21.15.99:0/3163041295 >> v1:172.21.15.99:6789/0 conn(0x7f52700a0fc0 legacy=0x7f5270133450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526ffff640 1 -- 172.21.15.99:0/3163041295 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52701302d0 con 0x7f52700a0bb0 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526ffff640 1 --2- 172.21.15.99:0/3163041295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f5270132f10 crc :-1 s=READY pgs=12668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a284c6b96c14d05e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526effd640 1 -- 172.21.15.99:0/3163041295 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5260009ce0 con 0x7f52700a0bb0 2023-12-19T09:57:22.552 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526effd640 1 -- 172.21.15.99:0/3163041295 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5260009e40 con 0x7f52700a0bb0 2023-12-19T09:57:22.553 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.551+0000 7f526effd640 1 -- 172.21.15.99:0/3163041295 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f526000e360 con 0x7f52700a0bb0 2023-12-19T09:57:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 1 -- 172.21.15.99:0/3163041295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 msgr2=0x7f5270132f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.555 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 1 --2- 172.21.15.99:0/3163041295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f5270132f10 crc :-1 s=READY pgs=12668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 1 -- 172.21.15.99:0/3163041295 shutdown_connections 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 1 --2- 172.21.15.99:0/3163041295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f5270132f10 unknown :-1 s=CLOSED pgs=12668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 1 -- 172.21.15.99:0/3163041295 >> 172.21.15.99:0/3163041295 conn(0x7f527006c9a0 msgr2=0x7f527006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 1 -- 172.21.15.99:0/3163041295 shutdown_connections 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 1 -- 172.21.15.99:0/3163041295 wait complete. 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.552+0000 7f5276617640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.553+0000 7f5276617640 1 Processor -- start 2023-12-19T09:57:22.556 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.553+0000 7f5276617640 1 -- start start 2023-12-19T09:57:22.557 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f5276617640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f527011b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.557 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f5276617640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527011d3a0 con 0x7f52700a0bb0 2023-12-19T09:57:22.557 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f526ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f527011b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.557 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f526ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f527011b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51494/0 (socket says 172.21.15.99:51494) 2023-12-19T09:57:22.557 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f526ffff640 1 -- 172.21.15.99:0/3297317021 learned_addr learned my addr 172.21.15.99:0/3297317021 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f526ffff640 1 -- 172.21.15.99:0/3297317021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527011f100 con 0x7f52700a0bb0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f526ffff640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f527011b7f0 crc :-1 s=READY pgs=12669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.554+0000 7f526cff9640 1 -- 172.21.15.99:0/3297317021 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5260014620 con 0x7f52700a0bb0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.555+0000 7f526cff9640 1 -- 172.21.15.99:0/3297317021 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f5260014780 con 0x7f52700a0bb0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.555+0000 7f526cff9640 1 -- 172.21.15.99:0/3297317021 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f5260014a20 con 0x7f52700a0bb0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.555+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527006a960 con 0x7f52700a0bb0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.555+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527011cfd0 con 0x7f52700a0bb0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.555+0000 7f526cff9640 1 -- 172.21.15.99:0/3297317021 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f5260014bd0 con 0x7f52700a0bb0 2023-12-19T09:57:22.558 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.556+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527011d890 con 0x7f52700a0bb0 2023-12-19T09:57:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.556+0000 7f526cff9640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f525c037810 0x7f525c039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.556+0000 7f526cff9640 1 -- 172.21.15.99:0/3297317021 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7f5260019040 con 0x7f52700a0bb0 2023-12-19T09:57:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.556+0000 7f526f7fe640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f525c037810 0x7f525c039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.559 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.557+0000 7f526f7fe640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f525c037810 0x7f525c039d20 crc :-1 s=READY pgs=3647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.560 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.560+0000 7f526cff9640 1 -- 172.21.15.99:0/3297317021 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f526000ec70 con 0x7f52700a0bb0 2023-12-19T09:57:22.730 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.731+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f527009f570 con 0x7f525c037810 2023-12-19T09:57:22.731 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.731+0000 7f526cff9640 1 -- 172.21.15.99:0/3297317021 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f5264001250 con 0x7f525c037810 2023-12-19T09:57:22.731 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T09:57:22.734 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f525c037810 msgr2=0x7f525c039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.734 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f525c037810 0x7f525c039d20 crc :-1 s=READY pgs=3647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 msgr2=0x7f527011b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f527011b7f0 crc :-1 s=READY pgs=12669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 shutdown_connections 2023-12-19T09:57:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f525c037810 0x7f525c039d20 unknown :-1 s=CLOSED pgs=3647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 --2- 172.21.15.99:0/3297317021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f52700a0bb0 0x7f527011b7f0 unknown :-1 s=CLOSED pgs=12669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 >> 172.21.15.99:0/3297317021 conn(0x7f527006c9a0 msgr2=0x7f52701bb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:22.735 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 shutdown_connections 2023-12-19T09:57:22.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.734+0000 7f5276617640 1 -- 172.21.15.99:0/3297317021 wait complete. 2023-12-19T09:57:22.746 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T09:57:22.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T09:57:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.850+0000 7fa1410f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.858+0000 7fa1410f7640 1 Processor -- start 2023-12-19T09:57:22.858 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.858+0000 7fa1410f7640 1 -- start start 2023-12-19T09:57:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa1410f7640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa13c1313c0 0x7fa13c098a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa1410f7640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c06e890 con 0x7fa13c1317d0 2023-12-19T09:57:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa1410f7640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c06f4a0 con 0x7fa13c1313c0 2023-12-19T09:57:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13ad9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa13c1313c0 0x7fa13c098a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13ad9d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa13c1313c0 0x7fa13c098a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51506/0 (socket says 172.21.15.99:51506) 2023-12-19T09:57:22.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13ad9d640 1 -- 172.21.15.99:0/2863336629 learned_addr learned my addr 172.21.15.99:0/2863336629 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13ad9d640 1 -- 172.21.15.99:0/2863336629 >> v1:172.21.15.99:6789/0 conn(0x7fa13c1317d0 legacy=0x7fa13c098f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13ad9d640 1 -- 172.21.15.99:0/2863336629 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c130c90 con 0x7fa13c1313c0 2023-12-19T09:57:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13ad9d640 1 --2- 172.21.15.99:0/2863336629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c098a20 crc :-1 s=READY pgs=12671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8677146dd14bb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13a59c640 1 -- 172.21.15.99:0/2863336629 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa12c009dd0 con 0x7fa13c1313c0 2023-12-19T09:57:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13a59c640 1 -- 172.21.15.99:0/2863336629 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa12c00e230 con 0x7fa13c1313c0 2023-12-19T09:57:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.859+0000 7fa13a59c640 1 -- 172.21.15.99:0/2863336629 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa12c00e4d0 con 0x7fa13c1313c0 2023-12-19T09:57:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 1 -- 172.21.15.99:0/2863336629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 msgr2=0x7fa13c098a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2863336629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c098a20 crc :-1 s=READY pgs=12671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 1 -- 172.21.15.99:0/2863336629 shutdown_connections 2023-12-19T09:57:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2863336629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c098a20 unknown :-1 s=CLOSED pgs=12671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 1 -- 172.21.15.99:0/2863336629 >> 172.21.15.99:0/2863336629 conn(0x7fa13c09e780 msgr2=0x7fa13c09eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 1 -- 172.21.15.99:0/2863336629 shutdown_connections 2023-12-19T09:57:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 1 -- 172.21.15.99:0/2863336629 wait complete. 2023-12-19T09:57:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.860+0000 7fa1410f7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.861+0000 7fa1410f7640 1 Processor -- start 2023-12-19T09:57:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.861+0000 7fa1410f7640 1 -- start start 2023-12-19T09:57:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.862+0000 7fa1410f7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c117f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.862+0000 7fa1410f7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c12aeb0 con 0x7fa13c1313c0 2023-12-19T09:57:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.862+0000 7fa13ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c117f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.862+0000 7fa13ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c117f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51518/0 (socket says 172.21.15.99:51518) 2023-12-19T09:57:22.872 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.862+0000 7fa13ad9d640 1 -- 172.21.15.99:0/2283940664 learned_addr learned my addr 172.21.15.99:0/2283940664 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.862+0000 7fa13ad9d640 1 -- 172.21.15.99:0/2283940664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c1194c0 con 0x7fa13c1313c0 2023-12-19T09:57:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.863+0000 7fa13ad9d640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c117f30 crc :-1 s=READY pgs=12672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.863+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa12c014410 con 0x7fa13c1313c0 2023-12-19T09:57:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.863+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa12c014570 con 0x7fa13c1313c0 2023-12-19T09:57:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.863+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa12c014810 con 0x7fa13c1313c0 2023-12-19T09:57:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.863+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c071930 con 0x7fa13c1313c0 2023-12-19T09:57:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.863+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c1190d0 con 0x7fa13c1313c0 2023-12-19T09:57:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fa12c0149c0 con 0x7fa13c1313c0 2023-12-19T09:57:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa13c099670 con 0x7fa13c1313c0 2023-12-19T09:57:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa1337fe640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa11c037810 0x7fa11c039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7fa12c019040 con 0x7fa13c1313c0 2023-12-19T09:57:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa1337fe640 1 --2- 172.21.15.99:0/2283940664 >> v2:172.21.15.99:6803/2107593797 conn(0x7fa11c03e2c0 0x7fa11c040750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 --> v2:172.21.15.99:6803/2107593797 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa11c040de0 con 0x7fa11c03e2c0 2023-12-19T09:57:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=693) v2 ==== 24+0+0 (crc 0 0 0) 0x7fa12c048cd0 con 0x7fa13c1313c0 2023-12-19T09:57:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa133fff640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa11c037810 0x7fa11c039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa133fff640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa11c037810 0x7fa11c039d20 crc :-1 s=READY pgs=3648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.876 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.864+0000 7fa13b59e640 1 --2- 172.21.15.99:0/2283940664 >> v2:172.21.15.99:6803/2107593797 conn(0x7fa11c03e2c0 0x7fa11c040750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:57:22.876 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.866+0000 7fa13b59e640 1 --2- 172.21.15.99:0/2283940664 >> v2:172.21.15.99:6803/2107593797 conn(0x7fa11c03e2c0 0x7fa11c040750 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.877 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.867+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== osd.1 v2:172.21.15.99:6803/2107593797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fa11c040de0 con 0x7fa11c03e2c0 2023-12-19T09:57:22.877 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.870+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 --> v2:172.21.15.99:6803/2107593797 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa13c075080 con 0x7fa11c03e2c0 2023-12-19T09:57:22.877 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.871+0000 7fa1337fe640 1 -- 172.21.15.99:0/2283940664 <== osd.1 v2:172.21.15.99:6803/2107593797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+22 (crc 0 0 0) 0x7fa13c075080 con 0x7fa11c03e2c0 2023-12-19T09:57:22.877 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-12-19T09:57:22.878 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "" 2023-12-19T09:57:22.878 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-12-19T09:57:22.879 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 >> v2:172.21.15.99:6803/2107593797 conn(0x7fa11c03e2c0 msgr2=0x7fa11c040750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2283940664 >> v2:172.21.15.99:6803/2107593797 conn(0x7fa11c03e2c0 0x7fa11c040750 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa11c037810 msgr2=0x7fa11c039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa11c037810 0x7fa11c039d20 crc :-1 s=READY pgs=3648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 msgr2=0x7fa13c117f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c117f30 crc :-1 s=READY pgs=12672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 shutdown_connections 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2283940664 >> v2:172.21.15.99:6803/2107593797 conn(0x7fa11c03e2c0 0x7fa11c040750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa11c037810 0x7fa11c039d20 unknown :-1 s=CLOSED pgs=3648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.880 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 --2- 172.21.15.99:0/2283940664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13c1313c0 0x7fa13c117f30 unknown :-1 s=CLOSED pgs=12672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 >> 172.21.15.99:0/2283940664 conn(0x7fa13c09e780 msgr2=0x7fa13c1b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 shutdown_connections 2023-12-19T09:57:22.881 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.872+0000 7fa1410f7640 1 -- 172.21.15.99:0/2283940664 wait complete. 2023-12-19T09:57:22.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T09:57:22.988 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.983+0000 7fe73999e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.990 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe73999e640 1 Processor -- start 2023-12-19T09:57:22.990 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe73999e640 1 -- start start 2023-12-19T09:57:22.990 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe73999e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe7340a0fc0 0x7fe734133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.990 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe73999e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73409deb0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.990 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe73999e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73409d2b0 con 0x7fe7340a0fc0 2023-12-19T09:57:22.990 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe732ffd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe7340a0bb0 0x7fe734132f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50444/0 (socket says 172.21.15.99:50444) 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe732ffd640 1 -- 172.21.15.99:0/378671706 learned_addr learned my addr 172.21.15.99:0/378671706 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.989+0000 7fe7327fc640 1 --2- 172.21.15.99:0/378671706 >> v2:172.21.15.99:3300/0 conn(0x7fe7340a0fc0 0x7fe734133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe731ffb640 1 -- 172.21.15.99:0/378671706 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061145630 0 0) 0x7fe73409deb0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe731ffb640 1 -- 172.21.15.99:0/378671706 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe71c0034f0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe7327fc640 1 -- 172.21.15.99:0/378671706 >> v1:172.21.15.99:6789/0 conn(0x7fe7340a0bb0 legacy=0x7fe734132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe7327fc640 1 -- 172.21.15.99:0/378671706 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7341302d0 con 0x7fe7340a0fc0 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe7327fc640 1 --2- 172.21.15.99:0/378671706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0fc0 0x7fe734133620 crc :-1 s=READY pgs=12674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fdb74632221e24 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe731ffb640 1 -- 172.21.15.99:0/378671706 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe728009ce0 con 0x7fe7340a0fc0 2023-12-19T09:57:22.992 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe731ffb640 1 -- 172.21.15.99:0/378671706 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe728009e40 con 0x7fe7340a0fc0 2023-12-19T09:57:22.992 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.990+0000 7fe731ffb640 1 -- 172.21.15.99:0/378671706 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe72800e360 con 0x7fe7340a0fc0 2023-12-19T09:57:22.994 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 1 -- 172.21.15.99:0/378671706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0fc0 msgr2=0x7fe734133620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:22.994 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 1 --2- 172.21.15.99:0/378671706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0fc0 0x7fe734133620 crc :-1 s=READY pgs=12674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 1 -- 172.21.15.99:0/378671706 shutdown_connections 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 1 --2- 172.21.15.99:0/378671706 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0fc0 0x7fe734133620 unknown :-1 s=CLOSED pgs=12674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 1 -- 172.21.15.99:0/378671706 >> 172.21.15.99:0/378671706 conn(0x7fe73406c9a0 msgr2=0x7fe73406cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 1 -- 172.21.15.99:0/378671706 shutdown_connections 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 1 -- 172.21.15.99:0/378671706 wait complete. 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.991+0000 7fe73999e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.992+0000 7fe73999e640 1 Processor -- start 2023-12-19T09:57:22.995 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.992+0000 7fe73999e640 1 -- start start 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe73999e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0bb0 0x7fe73411b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe73999e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73411e970 con 0x7fe7340a0bb0 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe732ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0bb0 0x7fe73411b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe732ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0bb0 0x7fe73411b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51538/0 (socket says 172.21.15.99:51538) 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe732ffd640 1 -- 172.21.15.99:0/1278619736 learned_addr learned my addr 172.21.15.99:0/1278619736 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe732ffd640 1 -- 172.21.15.99:0/1278619736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73411f380 con 0x7fe7340a0bb0 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe732ffd640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0bb0 0x7fe73411b7f0 crc :-1 s=READY pgs=12675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe71bfff640 1 -- 172.21.15.99:0/1278619736 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe7240070b0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe71bfff640 1 -- 172.21.15.99:0/1278619736 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fe724007210 con 0x7fe7340a0bb0 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73411e5d0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe71bfff640 1 -- 172.21.15.99:0/1278619736 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fe7240074b0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.993+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73411ddb0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.994+0000 7fe71bfff640 1 -- 172.21.15.99:0/1278619736 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fe724007660 con 0x7fe7340a0bb0 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.994+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73411e7c0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.994+0000 7fe71bfff640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe720037810 0x7fe720039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.994+0000 7fe71bfff640 1 -- 172.21.15.99:0/1278619736 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7fe724047ba0 con 0x7fe7340a0bb0 2023-12-19T09:57:22.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.995+0000 7fe7327fc640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe720037810 0x7fe720039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:22.998 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.995+0000 7fe7327fc640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe720037810 0x7fe720039d20 crc :-1 s=READY pgs=3649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:22.998 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:22.999+0000 7fe71bfff640 1 -- 172.21.15.99:0/1278619736 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fe7240092c0 con 0x7fe7340a0bb0 2023-12-19T09:57:23.168 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.168+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe73409f570 con 0x7fe720037810 2023-12-19T09:57:23.168 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.169+0000 7fe71bfff640 1 -- 172.21.15.99:0/1278619736 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fe728006dc0 con 0x7fe720037810 2023-12-19T09:57:23.169 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T09:57:23.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe720037810 msgr2=0x7fe720039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe720037810 0x7fe720039d20 crc :-1 s=READY pgs=3649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0bb0 msgr2=0x7fe73411b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0bb0 0x7fe73411b7f0 crc :-1 s=READY pgs=12675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 shutdown_connections 2023-12-19T09:57:23.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fe720037810 0x7fe720039d20 unknown :-1 s=CLOSED pgs=3649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 --2- 172.21.15.99:0/1278619736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7340a0bb0 0x7fe73411b7f0 unknown :-1 s=CLOSED pgs=12675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 >> 172.21.15.99:0/1278619736 conn(0x7fe73406c9a0 msgr2=0x7fe7340a1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 shutdown_connections 2023-12-19T09:57:23.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.171+0000 7fe73999e640 1 -- 172.21.15.99:0/1278619736 wait complete. 2023-12-19T09:57:23.184 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T09:57:23.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T09:57:23.295 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.288+0000 7fec04d1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7fec04d1e640 1 Processor -- start 2023-12-19T09:57:23.296 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7fec04d1e640 1 -- start start 2023-12-19T09:57:23.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7fec04d1e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec000a0fc0 0x7fec001336b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7fec04d1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0009c730 con 0x7fec000a0bb0 2023-12-19T09:57:23.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7fec04d1e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec000a13d0 con 0x7fec000a0fc0 2023-12-19T09:57:23.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7febf7fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fec000a0fc0 0x7fec001336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7febfe59c640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fec000a0bb0 0x7fec00132fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50452/0 (socket says 172.21.15.99:50452) 2023-12-19T09:57:23.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.297+0000 7febfe59c640 1 -- 172.21.15.99:0/1370521648 learned_addr learned my addr 172.21.15.99:0/1370521648 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:23.298 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.298+0000 7febf7fff640 1 -- 172.21.15.99:0/1370521648 >> v1:172.21.15.99:6789/0 conn(0x7fec000a0bb0 legacy=0x7fec00132fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.299 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.298+0000 7febf7fff640 1 -- 172.21.15.99:0/1370521648 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec001309b0 con 0x7fec000a0fc0 2023-12-19T09:57:23.299 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.298+0000 7febf7fff640 1 --2- 172.21.15.99:0/1370521648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0fc0 0x7fec001336b0 crc :-1 s=READY pgs=12677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9595ea27f42a8c8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.299 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.298+0000 7febfdd9b640 1 -- 172.21.15.99:0/1370521648 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7febe8009ce0 con 0x7fec000a0fc0 2023-12-19T09:57:23.299 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.298+0000 7febfdd9b640 1 -- 172.21.15.99:0/1370521648 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7febe8009e40 con 0x7fec000a0fc0 2023-12-19T09:57:23.299 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.298+0000 7febfdd9b640 1 -- 172.21.15.99:0/1370521648 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7febe800e360 con 0x7fec000a0fc0 2023-12-19T09:57:23.301 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 1 -- 172.21.15.99:0/1370521648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0fc0 msgr2=0x7fec001336b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.301 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 1 --2- 172.21.15.99:0/1370521648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0fc0 0x7fec001336b0 crc :-1 s=READY pgs=12677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.301 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 1 -- 172.21.15.99:0/1370521648 shutdown_connections 2023-12-19T09:57:23.301 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 1 --2- 172.21.15.99:0/1370521648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0fc0 0x7fec001336b0 unknown :-1 s=CLOSED pgs=12677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.301 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 1 -- 172.21.15.99:0/1370521648 >> 172.21.15.99:0/1370521648 conn(0x7fec0006c9a0 msgr2=0x7fec0006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 1 -- 172.21.15.99:0/1370521648 shutdown_connections 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 1 -- 172.21.15.99:0/1370521648 wait complete. 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.299+0000 7fec04d1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.300+0000 7fec04d1e640 1 Processor -- start 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.300+0000 7fec04d1e640 1 -- start start 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7fec04d1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0bb0 0x7fec001c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7fec04d1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0012d620 con 0x7fec000a0bb0 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febfe59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0bb0 0x7fec001c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.302 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febfe59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0bb0 0x7fec001c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51562/0 (socket says 172.21.15.99:51562) 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febfe59c640 1 -- 172.21.15.99:0/3461443041 learned_addr learned my addr 172.21.15.99:0/3461443041 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febfe59c640 1 -- 172.21.15.99:0/3461443041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec00120ec0 con 0x7fec000a0bb0 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febfe59c640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0bb0 0x7fec001c8480 crc :-1 s=READY pgs=12678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7febf00059d0 con 0x7fec000a0bb0 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7febf0005b30 con 0x7fec000a0bb0 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7febf0005dd0 con 0x7fec000a0bb0 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec00120b60 con 0x7fec000a0bb0 2023-12-19T09:57:23.303 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.301+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec001206c0 con 0x7fec000a0bb0 2023-12-19T09:57:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.302+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fec0009db40 con 0x7fec000a0bb0 2023-12-19T09:57:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.302+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7febf00070b0 con 0x7fec000a0bb0 2023-12-19T09:57:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.302+0000 7febf6ffd640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7febe0037810 0x7febe0039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.302+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7febf0046fa0 con 0x7fec000a0bb0 2023-12-19T09:57:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.303+0000 7febf6ffd640 1 --2- 172.21.15.99:0/3461443041 >> v2:172.21.15.178:6803/1424444103 conn(0x7febe003e2c0 0x7febe0040750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.303+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 --> v2:172.21.15.178:6803/1424444103 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febe0040de0 con 0x7febe003e2c0 2023-12-19T09:57:23.305 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.303+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=693) v2 ==== 24+0+0 (crc 0 0 0) 0x7febf0049490 con 0x7fec000a0bb0 2023-12-19T09:57:23.306 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.303+0000 7febf7fff640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7febe0037810 0x7febe0039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.306 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.303+0000 7febf7fff640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7febe0037810 0x7febe0039d20 crc :-1 s=READY pgs=3650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.306 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.303+0000 7febfed9d640 1 --2- 172.21.15.99:0/3461443041 >> v2:172.21.15.178:6803/1424444103 conn(0x7febe003e2c0 0x7febe0040750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:57:23.306 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.306+0000 7febfed9d640 1 --2- 172.21.15.99:0/3461443041 >> v2:172.21.15.178:6803/1424444103 conn(0x7febe003e2c0 0x7febe0040750 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.306 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.307+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== osd.2 v2:172.21.15.178:6803/1424444103 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7febe0040de0 con 0x7febe003e2c0 2023-12-19T09:57:23.309 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.310+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 --> v2:172.21.15.178:6803/1424444103 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fec0012faa0 con 0x7febe003e2c0 2023-12-19T09:57:23.311 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7febf6ffd640 1 -- 172.21.15.99:0/3461443041 <== osd.2 v2:172.21.15.178:6803/1424444103 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+22 (crc 0 0 0) 0x7febf800a820 con 0x7febe003e2c0 2023-12-19T09:57:23.311 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-12-19T09:57:23.311 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "" 2023-12-19T09:57:23.311 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-12-19T09:57:23.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 >> v2:172.21.15.178:6803/1424444103 conn(0x7febe003e2c0 msgr2=0x7febe0040750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 --2- 172.21.15.99:0/3461443041 >> v2:172.21.15.178:6803/1424444103 conn(0x7febe003e2c0 0x7febe0040750 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7febe0037810 msgr2=0x7febe0039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.312 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7febe0037810 0x7febe0039d20 crc :-1 s=READY pgs=3650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0bb0 msgr2=0x7fec001c8480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0bb0 0x7fec001c8480 crc :-1 s=READY pgs=12678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 shutdown_connections 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 --2- 172.21.15.99:0/3461443041 >> v2:172.21.15.178:6803/1424444103 conn(0x7febe003e2c0 0x7febe0040750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7febe0037810 0x7febe0039d20 unknown :-1 s=CLOSED pgs=3650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 --2- 172.21.15.99:0/3461443041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fec000a0bb0 0x7fec001c8480 unknown :-1 s=CLOSED pgs=12678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.311+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 >> 172.21.15.99:0/3461443041 conn(0x7fec0006c9a0 msgr2=0x7fec000a3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.312+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 shutdown_connections 2023-12-19T09:57:23.314 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.312+0000 7fec04d1e640 1 -- 172.21.15.99:0/3461443041 wait complete. 2023-12-19T09:57:23.321 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T09:57:23.429 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.425+0000 7fce8539e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.430+0000 7fce8539e640 1 Processor -- start 2023-12-19T09:57:23.430 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.430+0000 7fce8539e640 1 -- start start 2023-12-19T09:57:23.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce8539e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce8012e000 0x7fce80135e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce8539e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8006e4d0 con 0x7fce8006ea20 2023-12-19T09:57:23.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce8539e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8006f260 con 0x7fce8012e000 2023-12-19T09:57:23.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7e7fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce8012e000 0x7fce80135e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.432 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7e7fc640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce8012e000 0x7fce80135e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51564/0 (socket says 172.21.15.99:51564) 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7effd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fce8006ea20 0x7fce8012d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50460/0 (socket says 172.21.15.99:50460) 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7e7fc640 1 -- 172.21.15.99:0/421798351 learned_addr learned my addr 172.21.15.99:0/421798351 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7e7fc640 1 -- 172.21.15.99:0/421798351 >> v1:172.21.15.99:6789/0 conn(0x7fce8006ea20 legacy=0x7fce8012d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7e7fc640 1 -- 172.21.15.99:0/421798351 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8006ee30 con 0x7fce8012e000 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7dffb640 1 -- 172.21.15.99:0/421798351 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448358088 0 0) 0x7fce8006e4d0 con 0x7fce8006ea20 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7e7fc640 1 --2- 172.21.15.99:0/421798351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8012e000 0x7fce80135e60 crc :-1 s=READY pgs=12680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0f412e54c8f23 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7dffb640 1 -- 172.21.15.99:0/421798351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce68009dd0 con 0x7fce8012e000 2023-12-19T09:57:23.433 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7dffb640 1 -- 172.21.15.99:0/421798351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fce6800e230 con 0x7fce8012e000 2023-12-19T09:57:23.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.431+0000 7fce7dffb640 1 -- 172.21.15.99:0/421798351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce6800e4d0 con 0x7fce8012e000 2023-12-19T09:57:23.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 1 -- 172.21.15.99:0/421798351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8012e000 msgr2=0x7fce80135e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 1 --2- 172.21.15.99:0/421798351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8012e000 0x7fce80135e60 crc :-1 s=READY pgs=12680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 1 -- 172.21.15.99:0/421798351 shutdown_connections 2023-12-19T09:57:23.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 1 --2- 172.21.15.99:0/421798351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8012e000 0x7fce80135e60 unknown :-1 s=CLOSED pgs=12680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 1 -- 172.21.15.99:0/421798351 >> 172.21.15.99:0/421798351 conn(0x7fce8009e470 msgr2=0x7fce8009e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.434 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 1 -- 172.21.15.99:0/421798351 shutdown_connections 2023-12-19T09:57:23.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 1 -- 172.21.15.99:0/421798351 wait complete. 2023-12-19T09:57:23.435 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.432+0000 7fce8539e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.433+0000 7fce8539e640 1 Processor -- start 2023-12-19T09:57:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.433+0000 7fce8539e640 1 -- start start 2023-12-19T09:57:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.434+0000 7fce8539e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006ea20 0x7fce80133a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.434+0000 7fce8539e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80119bc0 con 0x7fce8006ea20 2023-12-19T09:57:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.434+0000 7fce7effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006ea20 0x7fce80133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.434+0000 7fce7effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006ea20 0x7fce80133a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51578/0 (socket says 172.21.15.99:51578) 2023-12-19T09:57:23.437 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.434+0000 7fce7effd640 1 -- 172.21.15.99:0/3595985524 learned_addr learned my addr 172.21.15.99:0/3595985524 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.434+0000 7fce7effd640 1 -- 172.21.15.99:0/3595985524 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80118720 con 0x7fce8006ea20 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.434+0000 7fce7effd640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006ea20 0x7fce80133a20 crc :-1 s=READY pgs=12681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.435+0000 7fce777fe640 1 -- 172.21.15.99:0/3595985524 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce78004af0 con 0x7fce8006ea20 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.435+0000 7fce777fe640 1 -- 172.21.15.99:0/3595985524 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fce78004c50 con 0x7fce8006ea20 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.435+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce80134c40 con 0x7fce8006ea20 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.435+0000 7fce777fe640 1 -- 172.21.15.99:0/3595985524 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fce78007120 con 0x7fce8006ea20 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.435+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce80118480 con 0x7fce8006ea20 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.436+0000 7fce777fe640 1 -- 172.21.15.99:0/3595985524 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fce780072d0 con 0x7fce8006ea20 2023-12-19T09:57:23.438 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.436+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce801355c0 con 0x7fce8006ea20 2023-12-19T09:57:23.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.436+0000 7fce777fe640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fce60037810 0x7fce60039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.436+0000 7fce777fe640 1 -- 172.21.15.99:0/3595985524 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7fce780471d0 con 0x7fce8006ea20 2023-12-19T09:57:23.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.436+0000 7fce7e7fc640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fce60037810 0x7fce60039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.439 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.437+0000 7fce7e7fc640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fce60037810 0x7fce60039d20 crc :-1 s=READY pgs=3651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.441 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.441+0000 7fce777fe640 1 -- 172.21.15.99:0/3595985524 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fce7800a940 con 0x7fce8006ea20 2023-12-19T09:57:23.610 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.611+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fce801319a0 con 0x7fce60037810 2023-12-19T09:57:23.611 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.611+0000 7fce777fe640 1 -- 172.21.15.99:0/3595985524 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7fce801319a0 con 0x7fce60037810 2023-12-19T09:57:23.611 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T09:57:23.613 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fce60037810 msgr2=0x7fce60039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fce60037810 0x7fce60039d20 crc :-1 s=READY pgs=3651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006ea20 msgr2=0x7fce80133a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006ea20 0x7fce80133a20 crc :-1 s=READY pgs=12681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 shutdown_connections 2023-12-19T09:57:23.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fce60037810 0x7fce60039d20 unknown :-1 s=CLOSED pgs=3651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 --2- 172.21.15.99:0/3595985524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006ea20 0x7fce80133a20 unknown :-1 s=CLOSED pgs=12681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.614 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 >> 172.21.15.99:0/3595985524 conn(0x7fce8009e470 msgr2=0x7fce801308f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.615 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 shutdown_connections 2023-12-19T09:57:23.615 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.614+0000 7fce8539e640 1 -- 172.21.15.99:0/3595985524 wait complete. 2023-12-19T09:57:23.624 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T09:57:23.625 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T09:57:23.734 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.727+0000 7fa98706d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.734 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.735+0000 7fa98706d640 1 Processor -- start 2023-12-19T09:57:23.734 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.735+0000 7fa98706d640 1 -- start start 2023-12-19T09:57:23.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.735+0000 7fa98706d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa98009a2b0 0x7fa98009a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.735+0000 7fa98706d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa980072780 con 0x7fa980132160 2023-12-19T09:57:23.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.735+0000 7fa98706d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98006e2d0 con 0x7fa98009a2b0 2023-12-19T09:57:23.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa984e09640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa98009a2b0 0x7fa98009a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.736 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa97ffff640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa980132160 0x7fa980134580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50474/0 (socket says 172.21.15.99:50474) 2023-12-19T09:57:23.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa97ffff640 1 -- 172.21.15.99:0/3128697716 learned_addr learned my addr 172.21.15.99:0/3128697716 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:23.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa984e09640 1 -- 172.21.15.99:0/3128697716 >> v1:172.21.15.99:6789/0 conn(0x7fa980132160 legacy=0x7fa980134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa984e09640 1 -- 172.21.15.99:0/3128697716 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98009ac00 con 0x7fa98009a2b0 2023-12-19T09:57:23.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa97f7fe640 1 -- 172.21.15.99:0/3128697716 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424877635 0 0) 0x7fa980072780 con 0x7fa980132160 2023-12-19T09:57:23.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa984e09640 1 --2- 172.21.15.99:0/3128697716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98009a6c0 crc :-1 s=READY pgs=12683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c38e642a6610d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.737 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa97f7fe640 1 -- 172.21.15.99:0/3128697716 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa974010440 con 0x7fa98009a2b0 2023-12-19T09:57:23.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa97f7fe640 1 -- 172.21.15.99:0/3128697716 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa9740105a0 con 0x7fa98009a2b0 2023-12-19T09:57:23.738 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.736+0000 7fa97f7fe640 1 -- 172.21.15.99:0/3128697716 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa974010840 con 0x7fa98009a2b0 2023-12-19T09:57:23.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 1 -- 172.21.15.99:0/3128697716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 msgr2=0x7fa98009a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 1 --2- 172.21.15.99:0/3128697716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98009a6c0 crc :-1 s=READY pgs=12683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 1 -- 172.21.15.99:0/3128697716 shutdown_connections 2023-12-19T09:57:23.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 1 --2- 172.21.15.99:0/3128697716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98009a6c0 unknown :-1 s=CLOSED pgs=12683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 1 -- 172.21.15.99:0/3128697716 >> 172.21.15.99:0/3128697716 conn(0x7fa98009daf0 msgr2=0x7fa98009df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.741 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 1 -- 172.21.15.99:0/3128697716 shutdown_connections 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 1 -- 172.21.15.99:0/3128697716 wait complete. 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.737+0000 7fa98706d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.738+0000 7fa98706d640 1 Processor -- start 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.738+0000 7fa98706d640 1 -- start start 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa98706d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98012d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa98706d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98012fb00 con 0x7fa98009a2b0 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa984e09640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98012d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa984e09640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98012d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51596/0 (socket says 172.21.15.99:51596) 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa984e09640 1 -- 172.21.15.99:0/2561929401 learned_addr learned my addr 172.21.15.99:0/2561929401 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa984e09640 1 -- 172.21.15.99:0/2561929401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98012f930 con 0x7fa98009a2b0 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa984e09640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98012d0b0 crc :-1 s=READY pgs=12684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa97400fa40 con 0x7fa98009a2b0 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fa97400fba0 con 0x7fa98009a2b0 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98012fcf0 con 0x7fa98009a2b0 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fa97400fe40 con 0x7fa98009a2b0 2023-12-19T09:57:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.739+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa980131ef0 con 0x7fa98009a2b0 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.740+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa98009b310 con 0x7fa98009a2b0 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.740+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fa97400e360 con 0x7fa98009a2b0 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.740+0000 7fa97d7fa640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa964037840 0x7fa964039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.740+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7fa97404ae70 con 0x7fa98009a2b0 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.740+0000 7fa97d7fa640 1 --2- 172.21.15.99:0/2561929401 >> v2:172.21.15.178:6804/248859203 conn(0x7fa96403e2f0 0x7fa964040780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.740+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 --> v2:172.21.15.178:6804/248859203 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa964040e10 con 0x7fa96403e2f0 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.740+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=693) v2 ==== 24+0+0 (crc 0 0 0) 0x7fa97404d360 con 0x7fa98009a2b0 2023-12-19T09:57:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.741+0000 7fa97ffff640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa964037840 0x7fa964039d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.741+0000 7fa98560a640 1 --2- 172.21.15.99:0/2561929401 >> v2:172.21.15.178:6804/248859203 conn(0x7fa96403e2f0 0x7fa964040780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-12-19T09:57:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.741+0000 7fa97ffff640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa964037840 0x7fa964039d50 crc :-1 s=READY pgs=3652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.744+0000 7fa98560a640 1 --2- 172.21.15.99:0/2561929401 >> v2:172.21.15.178:6804/248859203 conn(0x7fa96403e2f0 0x7fa964040780 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.745+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== osd.3 v2:172.21.15.178:6804/248859203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+4964 (crc 0 0 0) 0x7fa964040e10 con 0x7fa96403e2f0 2023-12-19T09:57:23.748 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.748+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 --> v2:172.21.15.178:6804/248859203 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa98009e870 con 0x7fa96403e2f0 2023-12-19T09:57:23.749 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa97d7fa640 1 -- 172.21.15.99:0/2561929401 <== osd.3 v2:172.21.15.178:6804/248859203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+22 (crc 0 0 0) 0x7fa97800a820 con 0x7fa96403e2f0 2023-12-19T09:57:23.750 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2023-12-19T09:57:23.750 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "" 2023-12-19T09:57:23.750 INFO:teuthology.orchestra.run.smithi099.stdout:} 2023-12-19T09:57:23.751 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 >> v2:172.21.15.178:6804/248859203 conn(0x7fa96403e2f0 msgr2=0x7fa964040780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.751 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 --2- 172.21.15.99:0/2561929401 >> v2:172.21.15.178:6804/248859203 conn(0x7fa96403e2f0 0x7fa964040780 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.751 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa964037840 msgr2=0x7fa964039d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.751 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa964037840 0x7fa964039d50 crc :-1 s=READY pgs=3652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.751 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 msgr2=0x7fa98012d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98012d0b0 crc :-1 s=READY pgs=12684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 shutdown_connections 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 --2- 172.21.15.99:0/2561929401 >> v2:172.21.15.178:6804/248859203 conn(0x7fa96403e2f0 0x7fa964040780 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fa964037840 0x7fa964039d50 unknown :-1 s=CLOSED pgs=3652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 --2- 172.21.15.99:0/2561929401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa98009a2b0 0x7fa98012d0b0 unknown :-1 s=CLOSED pgs=12684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 >> 172.21.15.99:0/2561929401 conn(0x7fa98009daf0 msgr2=0x7fa9801260b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 shutdown_connections 2023-12-19T09:57:23.752 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.750+0000 7fa98706d640 1 -- 172.21.15.99:0/2561929401 wait complete. 2023-12-19T09:57:23.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T09:57:23.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.863+0000 7f324e606640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.867 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.868+0000 7f324e606640 1 Processor -- start 2023-12-19T09:57:23.868 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.868+0000 7f324e606640 1 -- start start 2023-12-19T09:57:23.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f324e606640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3248097960 0x7f324812f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f324e606640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3248098960 con 0x7f3248097d70 2023-12-19T09:57:23.869 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f324e606640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324809a2a0 con 0x7f3248097960 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3247fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3248097960 0x7f324812f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f32477fe640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3248097d70 0x7f324812f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50478/0 (socket says 172.21.15.99:50478) 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3247fff640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3248097960 0x7f324812f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51604/0 (socket says 172.21.15.99:51604) 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f32477fe640 1 -- 172.21.15.99:0/3315502385 learned_addr learned my addr 172.21.15.99:0/3315502385 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3247fff640 1 -- 172.21.15.99:0/3315502385 >> v1:172.21.15.99:6789/0 conn(0x7f3248097d70 legacy=0x7f324812f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3247fff640 1 -- 172.21.15.99:0/3315502385 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248072800 con 0x7f3248097960 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3247fff640 1 --2- 172.21.15.99:0/3315502385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324812f240 crc :-1 s=READY pgs=12686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eeaead866167683 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3246ffd640 1 -- 172.21.15.99:0/3315502385 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f323800d450 con 0x7f3248097960 2023-12-19T09:57:23.870 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3246ffd640 1 -- 172.21.15.99:0/3315502385 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f323800d5b0 con 0x7f3248097960 2023-12-19T09:57:23.871 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.869+0000 7f3246ffd640 1 -- 172.21.15.99:0/3315502385 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f323800d850 con 0x7f3248097960 2023-12-19T09:57:23.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 1 -- 172.21.15.99:0/3315502385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 msgr2=0x7f324812f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:23.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 1 --2- 172.21.15.99:0/3315502385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324812f240 crc :-1 s=READY pgs=12686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 1 -- 172.21.15.99:0/3315502385 shutdown_connections 2023-12-19T09:57:23.873 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 1 --2- 172.21.15.99:0/3315502385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324812f240 unknown :-1 s=CLOSED pgs=12686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 1 -- 172.21.15.99:0/3315502385 >> 172.21.15.99:0/3315502385 conn(0x7f324809dff0 msgr2=0x7f324809e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 1 -- 172.21.15.99:0/3315502385 shutdown_connections 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 1 -- 172.21.15.99:0/3315502385 wait complete. 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.870+0000 7f324e606640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.871+0000 7f324e606640 1 Processor -- start 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.871+0000 7f324e606640 1 -- start start 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.872+0000 7f324e606640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324806ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.872+0000 7f324e606640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3248127ea0 con 0x7f3248097960 2023-12-19T09:57:23.874 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.872+0000 7f3247fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324806ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.872+0000 7f3247fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324806ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51608/0 (socket says 172.21.15.99:51608) 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.872+0000 7f3247fff640 1 -- 172.21.15.99:0/3932401103 learned_addr learned my addr 172.21.15.99:0/3932401103 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.872+0000 7f3247fff640 1 -- 172.21.15.99:0/3932401103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248071110 con 0x7f3248097960 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.873+0000 7f3247fff640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324806ff80 crc :-1 s=READY pgs=12687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.873+0000 7f3244ff9640 1 -- 172.21.15.99:0/3932401103 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f323800c9f0 con 0x7f3248097960 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.873+0000 7f3244ff9640 1 -- 172.21.15.99:0/3932401103 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7f323800cb50 con 0x7f3248097960 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.873+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3248071a10 con 0x7f3248097960 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.873+0000 7f3244ff9640 1 -- 172.21.15.99:0/3932401103 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7f323800cdf0 con 0x7f3248097960 2023-12-19T09:57:23.875 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.873+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32481268e0 con 0x7f3248097960 2023-12-19T09:57:23.876 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.873+0000 7f3244ff9640 1 -- 172.21.15.99:0/3932401103 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7f3238017430 con 0x7f3248097960 2023-12-19T09:57:23.876 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.874+0000 7f3244ff9640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3234037810 0x7f3234039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:23.876 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.874+0000 7f3244ff9640 1 -- 172.21.15.99:0/3932401103 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7f3238012040 con 0x7f3248097960 2023-12-19T09:57:23.877 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.874+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3248127ca0 con 0x7f3248097960 2023-12-19T09:57:23.877 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.874+0000 7f32477fe640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3234037810 0x7f3234039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:23.877 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.874+0000 7f32477fe640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3234037810 0x7f3234039d20 crc :-1 s=READY pgs=3653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:23.878 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:23.879+0000 7f3244ff9640 1 -- 172.21.15.99:0/3932401103 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7f3238013e30 con 0x7f3248097960 2023-12-19T09:57:24.044 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.044+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f324809af20 con 0x7f3234037810 2023-12-19T09:57:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.045+0000 7f3244ff9640 1 -- 172.21.15.99:0/3932401103 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (crc 0 0 0) 0x7f323c001200 con 0x7f3234037810 2023-12-19T09:57:24.045 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T09:57:24.047 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3234037810 msgr2=0x7f3234039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:24.047 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3234037810 0x7f3234039d20 crc :-1 s=READY pgs=3653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.047 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 msgr2=0x7f324806ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:24.047 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324806ff80 crc :-1 s=READY pgs=12687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.047 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 shutdown_connections 2023-12-19T09:57:24.047 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7f3234037810 0x7f3234039d20 unknown :-1 s=CLOSED pgs=3653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.047 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 --2- 172.21.15.99:0/3932401103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3248097960 0x7f324806ff80 unknown :-1 s=CLOSED pgs=12687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.048 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 >> 172.21.15.99:0/3932401103 conn(0x7f324809dff0 msgr2=0x7f324809f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:24.048 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 shutdown_connections 2023-12-19T09:57:24.048 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.047+0000 7f324e606640 1 -- 172.21.15.99:0/3932401103 wait complete. 2023-12-19T09:57:24.058 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T09:57:24.162 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.159+0000 7ffb37f15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:24.168 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.163+0000 7ffb37f15640 1 Processor -- start 2023-12-19T09:57:24.168 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.163+0000 7ffb37f15640 1 -- start start 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb37f15640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb30097960 0x7ffb3012f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb37f15640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb30098960 con 0x7ffb30097d70 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb37f15640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3009a2a0 con 0x7ffb30097960 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb35cb1640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb30097960 0x7ffb3012f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb354b0640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffb30097d70 0x7ffb3012f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50486/0 (socket says 172.21.15.99:50486) 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb35cb1640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb30097960 0x7ffb3012f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51614/0 (socket says 172.21.15.99:51614) 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb354b0640 1 -- 172.21.15.99:0/3226696226 learned_addr learned my addr 172.21.15.99:0/3226696226 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb35cb1640 1 -- 172.21.15.99:0/3226696226 >> v1:172.21.15.99:6789/0 conn(0x7ffb30097d70 legacy=0x7ffb3012f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:24.169 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.164+0000 7ffb35cb1640 1 -- 172.21.15.99:0/3226696226 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb30072800 con 0x7ffb30097960 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb35cb1640 1 --2- 172.21.15.99:0/3226696226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb3012f240 crc :-1 s=READY pgs=12689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee29e16e4681ab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb34caf640 1 -- 172.21.15.99:0/3226696226 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb2c00ac70 con 0x7ffb30097960 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb34caf640 1 -- 172.21.15.99:0/3226696226 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffb2c00add0 con 0x7ffb30097960 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb34caf640 1 -- 172.21.15.99:0/3226696226 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb2c00f470 con 0x7ffb30097960 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb37f15640 1 -- 172.21.15.99:0/3226696226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 msgr2=0x7ffb3012f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb37f15640 1 --2- 172.21.15.99:0/3226696226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb3012f240 crc :-1 s=READY pgs=12689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb37f15640 1 -- 172.21.15.99:0/3226696226 shutdown_connections 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb37f15640 1 --2- 172.21.15.99:0/3226696226 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb3012f240 unknown :-1 s=CLOSED pgs=12689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.170 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb37f15640 1 -- 172.21.15.99:0/3226696226 >> 172.21.15.99:0/3226696226 conn(0x7ffb3009dff0 msgr2=0x7ffb3009e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb37f15640 1 -- 172.21.15.99:0/3226696226 shutdown_connections 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.165+0000 7ffb37f15640 1 -- 172.21.15.99:0/3226696226 wait complete. 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.166+0000 7ffb37f15640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.166+0000 7ffb37f15640 1 Processor -- start 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.167+0000 7ffb37f15640 1 -- start start 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.167+0000 7ffb37f15640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb30126040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.167+0000 7ffb37f15640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb30129130 con 0x7ffb30097960 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.167+0000 7ffb35cb1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb30126040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:24.171 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.167+0000 7ffb35cb1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb30126040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51616/0 (socket says 172.21.15.99:51616) 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.167+0000 7ffb35cb1640 1 -- 172.21.15.99:0/344819746 learned_addr learned my addr 172.21.15.99:0/344819746 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.167+0000 7ffb35cb1640 1 -- 172.21.15.99:0/344819746 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3012a010 con 0x7ffb30097960 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.168+0000 7ffb35cb1640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb30126040 crc :-1 s=READY pgs=12690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.168+0000 7ffb267fc640 1 -- 172.21.15.99:0/344819746 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb2c00fe10 con 0x7ffb30097960 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.168+0000 7ffb267fc640 1 -- 172.21.15.99:0/344819746 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffb2c012430 con 0x7ffb30097960 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.168+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb30128400 con 0x7ffb30097960 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.168+0000 7ffb267fc640 1 -- 172.21.15.99:0/344819746 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb2c0126d0 con 0x7ffb30097960 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.168+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb30129b90 con 0x7ffb30097960 2023-12-19T09:57:24.172 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.169+0000 7ffb267fc640 1 -- 172.21.15.99:0/344819746 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7ffb2c012880 con 0x7ffb30097960 2023-12-19T09:57:24.173 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.169+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb30062350 con 0x7ffb30097960 2023-12-19T09:57:24.173 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.169+0000 7ffb267fc640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb14037810 0x7ffb14039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:24.173 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.169+0000 7ffb267fc640 1 -- 172.21.15.99:0/344819746 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(693..693 src has 1..693) v4 ==== 3741+0+0 (crc 0 0 0) 0x7ffb2c018040 con 0x7ffb30097960 2023-12-19T09:57:24.173 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.169+0000 7ffb354b0640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb14037810 0x7ffb14039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:24.174 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.170+0000 7ffb354b0640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb14037810 0x7ffb14039d20 crc :-1 s=READY pgs=3654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:24.174 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.173+0000 7ffb267fc640 1 -- 172.21.15.99:0/344819746 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7ffb2c00cad0 con 0x7ffb30097960 2023-12-19T09:57:24.337 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.338+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb30128b60 con 0x7ffb14037810 2023-12-19T09:57:24.342 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.342+0000 7ffb267fc640 1 -- 172.21.15.99:0/344819746 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+184177 (crc 0 0 0) 0x7ffb200012a0 con 0x7ffb14037810 2023-12-19T09:57:24.344 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:57:24.345 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2023-12-19T09:57:24.346 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb14037810 msgr2=0x7ffb14039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:24.346 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb14037810 0x7ffb14039d20 crc :-1 s=READY pgs=3654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 msgr2=0x7ffb30126040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb30126040 crc :-1 s=READY pgs=12690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 shutdown_connections 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb14037810 0x7ffb14039d20 unknown :-1 s=CLOSED pgs=3654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 --2- 172.21.15.99:0/344819746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb30097960 0x7ffb30126040 unknown :-1 s=CLOSED pgs=12690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 >> 172.21.15.99:0/344819746 conn(0x7ffb3009dff0 msgr2=0x7ffb3009f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 shutdown_connections 2023-12-19T09:57:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:24.345+0000 7ffb37f15640 1 -- 172.21.15.99:0/344819746 wait complete. 2023-12-19T09:57:24.356 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1183,"stamp":"2023-12-19T09:57:24.279166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591397,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":152,"num_write_kb":1909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":360072,"kb_used_data":30184,"kb_used_omap":0,"kb_used_meta":329856,"kb_avail":419070328,"statfs":{"total":429496729600,"available":429128015872,"internally_reserved":0,"allocated":30908416,"data_stored":19018304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":337772544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17682,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-373,"num_write_kb":-373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.997029"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.698349+0000","last_change":"2023-12-19T09:41:43.996729+0000","last_active":"2023-12-19T09:57:21.698349+0000","last_peered":"2023-12-19T09:57:21.698349+0000","last_clean":"2023-12-19T09:57:21.698349+0000","last_became_active":"2023-12-19T09:41:43.988867+0000","last_became_peered":"2023-12-19T09:41:43.988867+0000","last_unstale":"2023-12-19T09:57:21.698349+0000","last_undegraded":"2023-12-19T09:57:21.698349+0000","last_fullsized":"2023-12-19T09:57:21.698349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1206,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.995765+0000","last_change":"2023-12-19T09:41:49.091716+0000","last_active":"2023-12-19T09:57:20.995765+0000","last_peered":"2023-12-19T09:57:20.995765+0000","last_clean":"2023-12-19T09:57:20.995765+0000","last_became_active":"2023-12-19T09:41:49.078919+0000","last_became_peered":"2023-12-19T09:41:49.078919+0000","last_unstale":"2023-12-19T09:57:20.995765+0000","last_undegraded":"2023-12-19T09:57:20.995765+0000","last_fullsized":"2023-12-19T09:57:20.995765+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.267234+0000","last_change":"2023-12-19T09:41:44.097849+0000","last_active":"2023-12-19T09:57:20.267234+0000","last_peered":"2023-12-19T09:57:20.267234+0000","last_clean":"2023-12-19T09:57:20.267234+0000","last_became_active":"2023-12-19T09:41:44.070813+0000","last_became_peered":"2023-12-19T09:41:44.070813+0000","last_unstale":"2023-12-19T09:57:20.267234+0000","last_undegraded":"2023-12-19T09:57:20.267234+0000","last_fullsized":"2023-12-19T09:57:20.267234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1077,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.677784+0000","last_change":"2023-12-19T09:41:47.646204+0000","last_active":"2023-12-19T09:57:21.677784+0000","last_peered":"2023-12-19T09:57:21.677784+0000","last_clean":"2023-12-19T09:57:21.677784+0000","last_became_active":"2023-12-19T09:41:47.638438+0000","last_became_peered":"2023-12-19T09:41:47.638438+0000","last_unstale":"2023-12-19T09:57:21.677784+0000","last_undegraded":"2023-12-19T09:57:21.677784+0000","last_fullsized":"2023-12-19T09:57:21.677784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.422891+0000","last_change":"2023-12-19T09:41:44.414780+0000","last_active":"2023-12-19T09:57:20.422891+0000","last_peered":"2023-12-19T09:57:20.422891+0000","last_clean":"2023-12-19T09:57:20.422891+0000","last_became_active":"2023-12-19T09:41:44.399400+0000","last_became_peered":"2023-12-19T09:41:44.399400+0000","last_unstale":"2023-12-19T09:57:20.422891+0000","last_undegraded":"2023-12-19T09:57:20.422891+0000","last_fullsized":"2023-12-19T09:57:20.422891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1206,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.171125+0000","last_change":"2023-12-19T09:41:48.952590+0000","last_active":"2023-12-19T09:57:21.171125+0000","last_peered":"2023-12-19T09:57:21.171125+0000","last_clean":"2023-12-19T09:57:21.171125+0000","last_became_active":"2023-12-19T09:41:48.947301+0000","last_became_peered":"2023-12-19T09:41:48.947301+0000","last_unstale":"2023-12-19T09:57:21.171125+0000","last_undegraded":"2023-12-19T09:57:21.171125+0000","last_fullsized":"2023-12-19T09:57:21.171125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.615257+0000","last_change":"2023-12-19T09:41:44.707713+0000","last_active":"2023-12-19T09:57:21.615257+0000","last_peered":"2023-12-19T09:57:21.615257+0000","last_clean":"2023-12-19T09:57:21.615257+0000","last_became_active":"2023-12-19T09:41:44.695211+0000","last_became_peered":"2023-12-19T09:41:44.695211+0000","last_unstale":"2023-12-19T09:57:21.615257+0000","last_undegraded":"2023-12-19T09:57:21.615257+0000","last_fullsized":"2023-12-19T09:57:21.615257+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1206,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.012234+0000","last_change":"2023-12-19T09:41:48.985139+0000","last_active":"2023-12-19T09:57:21.012234+0000","last_peered":"2023-12-19T09:57:21.012234+0000","last_clean":"2023-12-19T09:57:21.012234+0000","last_became_active":"2023-12-19T09:41:48.981358+0000","last_became_peered":"2023-12-19T09:41:48.981358+0000","last_unstale":"2023-12-19T09:57:21.012234+0000","last_undegraded":"2023-12-19T09:57:21.012234+0000","last_fullsized":"2023-12-19T09:57:21.012234+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1214,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.670542+0000","last_change":"2023-12-19T09:41:44.014471+0000","last_active":"2023-12-19T09:57:20.670542+0000","last_peered":"2023-12-19T09:57:20.670542+0000","last_clean":"2023-12-19T09:57:20.670542+0000","last_became_active":"2023-12-19T09:41:44.010134+0000","last_became_peered":"2023-12-19T09:41:44.010134+0000","last_unstale":"2023-12-19T09:57:20.670542+0000","last_undegraded":"2023-12-19T09:57:20.670542+0000","last_fullsized":"2023-12-19T09:57:20.670542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.a","version":"48'3","reported_seq":1207,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:19.883736+0000","last_change":"2023-12-19T09:41:50.049917+0000","last_active":"2023-12-19T09:57:19.883736+0000","last_peered":"2023-12-19T09:57:19.883736+0000","last_clean":"2023-12-19T09:57:19.883736+0000","last_became_active":"2023-12-19T09:41:50.042450+0000","last_became_peered":"2023-12-19T09:41:50.042450+0000","last_unstale":"2023-12-19T09:57:19.883736+0000","last_undegraded":"2023-12-19T09:57:19.883736+0000","last_fullsized":"2023-12-19T09:57:19.883736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.689171+0000","last_change":"2023-12-19T09:41:44.728818+0000","last_active":"2023-12-19T09:57:21.689171+0000","last_peered":"2023-12-19T09:57:21.689171+0000","last_clean":"2023-12-19T09:57:21.689171+0000","last_became_active":"2023-12-19T09:41:44.723909+0000","last_became_peered":"2023-12-19T09:41:44.723909+0000","last_unstale":"2023-12-19T09:57:21.689171+0000","last_undegraded":"2023-12-19T09:57:21.689171+0000","last_fullsized":"2023-12-19T09:57:21.689171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1202,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.196391+0000","last_change":"2023-12-19T09:41:47.838325+0000","last_active":"2023-12-19T09:57:20.196391+0000","last_peered":"2023-12-19T09:57:20.196391+0000","last_clean":"2023-12-19T09:57:20.196391+0000","last_became_active":"2023-12-19T09:41:47.832642+0000","last_became_peered":"2023-12-19T09:41:47.832642+0000","last_unstale":"2023-12-19T09:57:20.196391+0000","last_undegraded":"2023-12-19T09:57:20.196391+0000","last_fullsized":"2023-12-19T09:57:20.196391+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.135424+0000","last_change":"2023-12-19T09:41:44.592810+0000","last_active":"2023-12-19T09:57:22.135424+0000","last_peered":"2023-12-19T09:57:22.135424+0000","last_clean":"2023-12-19T09:57:22.135424+0000","last_became_active":"2023-12-19T09:41:44.585031+0000","last_became_peered":"2023-12-19T09:41:44.585031+0000","last_unstale":"2023-12-19T09:57:22.135424+0000","last_undegraded":"2023-12-19T09:57:22.135424+0000","last_fullsized":"2023-12-19T09:57:22.135424+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1077,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.555648+0000","last_change":"2023-12-19T09:41:47.669623+0000","last_active":"2023-12-19T09:57:21.555648+0000","last_peered":"2023-12-19T09:57:21.555648+0000","last_clean":"2023-12-19T09:57:21.555648+0000","last_became_active":"2023-12-19T09:41:47.651334+0000","last_became_peered":"2023-12-19T09:41:47.651334+0000","last_unstale":"2023-12-19T09:57:21.555648+0000","last_undegraded":"2023-12-19T09:57:21.555648+0000","last_fullsized":"2023-12-19T09:57:21.555648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.463725+0000","last_change":"2023-12-19T09:41:43.967186+0000","last_active":"2023-12-19T09:57:21.463725+0000","last_peered":"2023-12-19T09:57:21.463725+0000","last_clean":"2023-12-19T09:57:21.463725+0000","last_became_active":"2023-12-19T09:41:43.956781+0000","last_became_peered":"2023-12-19T09:41:43.956781+0000","last_unstale":"2023-12-19T09:57:21.463725+0000","last_undegraded":"2023-12-19T09:57:21.463725+0000","last_fullsized":"2023-12-19T09:57:21.463725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1207,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.911209+0000","last_change":"2023-12-19T09:41:50.824272+0000","last_active":"2023-12-19T09:57:20.911209+0000","last_peered":"2023-12-19T09:57:20.911209+0000","last_clean":"2023-12-19T09:57:20.911209+0000","last_became_active":"2023-12-19T09:41:50.819734+0000","last_became_peered":"2023-12-19T09:41:50.819734+0000","last_unstale":"2023-12-19T09:57:20.911209+0000","last_undegraded":"2023-12-19T09:57:20.911209+0000","last_fullsized":"2023-12-19T09:57:20.911209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1214,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.158296+0000","last_change":"2023-12-19T09:41:43.948061+0000","last_active":"2023-12-19T09:57:21.158296+0000","last_peered":"2023-12-19T09:57:21.158296+0000","last_clean":"2023-12-19T09:57:21.158296+0000","last_became_active":"2023-12-19T09:41:43.945414+0000","last_became_peered":"2023-12-19T09:41:43.945414+0000","last_unstale":"2023-12-19T09:57:21.158296+0000","last_undegraded":"2023-12-19T09:57:21.158296+0000","last_fullsized":"2023-12-19T09:57:21.158296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"30'3","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.099546+0000","last_change":"2023-12-19T09:41:48.128963+0000","last_active":"2023-12-19T09:57:20.099546+0000","last_peered":"2023-12-19T09:57:20.099546+0000","last_clean":"2023-12-19T09:57:20.099546+0000","last_became_active":"2023-12-19T09:41:48.126255+0000","last_became_peered":"2023-12-19T09:41:48.126255+0000","last_unstale":"2023-12-19T09:57:20.099546+0000","last_undegraded":"2023-12-19T09:57:20.099546+0000","last_fullsized":"2023-12-19T09:57:20.099546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.023648+0000","last_change":"2023-12-19T09:41:44.807942+0000","last_active":"2023-12-19T09:57:21.023648+0000","last_peered":"2023-12-19T09:57:21.023648+0000","last_clean":"2023-12-19T09:57:21.023648+0000","last_became_active":"2023-12-19T09:41:44.792603+0000","last_became_peered":"2023-12-19T09:41:44.792603+0000","last_unstale":"2023-12-19T09:57:21.023648+0000","last_undegraded":"2023-12-19T09:57:21.023648+0000","last_fullsized":"2023-12-19T09:57:21.023648+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1207,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.315817+0000","last_change":"2023-12-19T09:41:50.700445+0000","last_active":"2023-12-19T09:57:21.315817+0000","last_peered":"2023-12-19T09:57:21.315817+0000","last_clean":"2023-12-19T09:57:21.315817+0000","last_became_active":"2023-12-19T09:41:50.697862+0000","last_became_peered":"2023-12-19T09:41:50.697862+0000","last_unstale":"2023-12-19T09:57:21.315817+0000","last_undegraded":"2023-12-19T09:57:21.315817+0000","last_fullsized":"2023-12-19T09:57:21.315817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.183598+0000","last_change":"2023-12-19T09:41:43.864107+0000","last_active":"2023-12-19T09:57:22.183598+0000","last_peered":"2023-12-19T09:57:22.183598+0000","last_clean":"2023-12-19T09:57:22.183598+0000","last_became_active":"2023-12-19T09:41:43.861579+0000","last_became_peered":"2023-12-19T09:41:43.861579+0000","last_unstale":"2023-12-19T09:57:22.183598+0000","last_undegraded":"2023-12-19T09:57:22.183598+0000","last_fullsized":"2023-12-19T09:57:22.183598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1188,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.143865+0000","last_change":"2023-12-19T09:41:46.851420+0000","last_active":"2023-12-19T09:57:22.143865+0000","last_peered":"2023-12-19T09:57:22.143865+0000","last_clean":"2023-12-19T09:57:22.143865+0000","last_became_active":"2023-12-19T09:41:46.841291+0000","last_became_peered":"2023-12-19T09:41:46.841291+0000","last_unstale":"2023-12-19T09:57:22.143865+0000","last_undegraded":"2023-12-19T09:57:22.143865+0000","last_fullsized":"2023-12-19T09:57:22.143865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.085857+0000","last_change":"2023-12-19T09:41:44.833180+0000","last_active":"2023-12-19T09:57:22.085857+0000","last_peered":"2023-12-19T09:57:22.085857+0000","last_clean":"2023-12-19T09:57:22.085857+0000","last_became_active":"2023-12-19T09:41:44.829928+0000","last_became_peered":"2023-12-19T09:41:44.829928+0000","last_unstale":"2023-12-19T09:57:22.085857+0000","last_undegraded":"2023-12-19T09:57:22.085857+0000","last_fullsized":"2023-12-19T09:57:22.085857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1077,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.483545+0000","last_change":"2023-12-19T09:41:47.003324+0000","last_active":"2023-12-19T09:57:21.483545+0000","last_peered":"2023-12-19T09:57:21.483545+0000","last_clean":"2023-12-19T09:57:21.483545+0000","last_became_active":"2023-12-19T09:41:46.996512+0000","last_became_peered":"2023-12-19T09:41:46.996512+0000","last_unstale":"2023-12-19T09:57:21.483545+0000","last_undegraded":"2023-12-19T09:57:21.483545+0000","last_fullsized":"2023-12-19T09:57:21.483545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.087557+0000","last_change":"2023-12-19T09:41:44.771796+0000","last_active":"2023-12-19T09:57:21.087557+0000","last_peered":"2023-12-19T09:57:21.087557+0000","last_clean":"2023-12-19T09:57:21.087557+0000","last_became_active":"2023-12-19T09:41:44.765249+0000","last_became_peered":"2023-12-19T09:41:44.765249+0000","last_unstale":"2023-12-19T09:57:21.087557+0000","last_undegraded":"2023-12-19T09:57:21.087557+0000","last_fullsized":"2023-12-19T09:57:21.087557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1214,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.200845+0000","last_change":"2023-12-19T09:40:55.377872+0000","last_active":"2023-12-19T09:57:20.200845+0000","last_peered":"2023-12-19T09:57:20.200845+0000","last_clean":"2023-12-19T09:57:20.200845+0000","last_became_active":"2023-12-19T09:40:55.374430+0000","last_became_peered":"2023-12-19T09:40:55.374430+0000","last_unstale":"2023-12-19T09:57:20.200845+0000","last_undegraded":"2023-12-19T09:57:20.200845+0000","last_fullsized":"2023-12-19T09:57:20.200845+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1206,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.861129+0000","last_change":"2023-12-19T09:41:49.534320+0000","last_active":"2023-12-19T09:57:20.861129+0000","last_peered":"2023-12-19T09:57:20.861129+0000","last_clean":"2023-12-19T09:57:20.861129+0000","last_became_active":"2023-12-19T09:41:49.152035+0000","last_became_peered":"2023-12-19T09:41:49.152035+0000","last_unstale":"2023-12-19T09:57:20.861129+0000","last_undegraded":"2023-12-19T09:57:20.861129+0000","last_fullsized":"2023-12-19T09:57:20.861129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.870496+0000","last_change":"2023-12-19T09:41:44.539061+0000","last_active":"2023-12-19T09:57:20.870496+0000","last_peered":"2023-12-19T09:57:20.870496+0000","last_clean":"2023-12-19T09:57:20.870496+0000","last_became_active":"2023-12-19T09:41:44.523963+0000","last_became_peered":"2023-12-19T09:41:44.523963+0000","last_unstale":"2023-12-19T09:57:20.870496+0000","last_undegraded":"2023-12-19T09:57:20.870496+0000","last_fullsized":"2023-12-19T09:57:20.870496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1200,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.463612+0000","last_change":"2023-12-19T09:40:55.373709+0000","last_active":"2023-12-19T09:57:21.463612+0000","last_peered":"2023-12-19T09:57:21.463612+0000","last_clean":"2023-12-19T09:57:21.463612+0000","last_became_active":"2023-12-19T09:40:55.370833+0000","last_became_peered":"2023-12-19T09:40:55.370833+0000","last_unstale":"2023-12-19T09:57:21.463612+0000","last_undegraded":"2023-12-19T09:57:21.463612+0000","last_fullsized":"2023-12-19T09:57:21.463612+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1206,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.189793+0000","last_change":"2023-12-19T09:41:49.775064+0000","last_active":"2023-12-19T09:57:21.189793+0000","last_peered":"2023-12-19T09:57:21.189793+0000","last_clean":"2023-12-19T09:57:21.189793+0000","last_became_active":"2023-12-19T09:41:49.756848+0000","last_became_peered":"2023-12-19T09:41:49.756848+0000","last_unstale":"2023-12-19T09:57:21.189793+0000","last_undegraded":"2023-12-19T09:57:21.189793+0000","last_fullsized":"2023-12-19T09:57:21.189793+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.113369+0000","last_change":"2023-12-19T09:41:43.867265+0000","last_active":"2023-12-19T09:57:21.113369+0000","last_peered":"2023-12-19T09:57:21.113369+0000","last_clean":"2023-12-19T09:57:21.113369+0000","last_became_active":"2023-12-19T09:41:43.863691+0000","last_became_peered":"2023-12-19T09:41:43.863691+0000","last_unstale":"2023-12-19T09:57:21.113369+0000","last_undegraded":"2023-12-19T09:57:21.113369+0000","last_fullsized":"2023-12-19T09:57:21.113369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1086,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.561147+0000","last_change":"2023-12-19T09:40:55.385057+0000","last_active":"2023-12-19T09:57:21.561147+0000","last_peered":"2023-12-19T09:57:21.561147+0000","last_clean":"2023-12-19T09:57:21.561147+0000","last_became_active":"2023-12-19T09:40:55.376880+0000","last_became_peered":"2023-12-19T09:40:55.376880+0000","last_unstale":"2023-12-19T09:57:21.561147+0000","last_undegraded":"2023-12-19T09:57:21.561147+0000","last_fullsized":"2023-12-19T09:57:21.561147+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1205,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.912987+0000","last_change":"2023-12-19T09:41:51.637214+0000","last_active":"2023-12-19T09:57:20.912987+0000","last_peered":"2023-12-19T09:57:20.912987+0000","last_clean":"2023-12-19T09:57:20.912987+0000","last_became_active":"2023-12-19T09:41:51.634526+0000","last_became_peered":"2023-12-19T09:41:51.634526+0000","last_unstale":"2023-12-19T09:57:20.912987+0000","last_undegraded":"2023-12-19T09:57:20.912987+0000","last_fullsized":"2023-12-19T09:57:20.912987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"25'7","reported_seq":1227,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.153230+0000","last_change":"2023-12-19T09:41:44.543364+0000","last_active":"2023-12-19T09:57:21.153230+0000","last_peered":"2023-12-19T09:57:21.153230+0000","last_clean":"2023-12-19T09:57:21.153230+0000","last_became_active":"2023-12-19T09:41:44.536492+0000","last_became_peered":"2023-12-19T09:41:44.536492+0000","last_unstale":"2023-12-19T09:57:21.153230+0000","last_undegraded":"2023-12-19T09:57:21.153230+0000","last_fullsized":"2023-12-19T09:57:21.153230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1200,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.194769+0000","last_change":"2023-12-19T09:40:55.375889+0000","last_active":"2023-12-19T09:57:22.194769+0000","last_peered":"2023-12-19T09:57:22.194769+0000","last_clean":"2023-12-19T09:57:22.194769+0000","last_became_active":"2023-12-19T09:40:55.367503+0000","last_became_peered":"2023-12-19T09:40:55.367503+0000","last_unstale":"2023-12-19T09:57:22.194769+0000","last_undegraded":"2023-12-19T09:57:22.194769+0000","last_fullsized":"2023-12-19T09:57:22.194769+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.14","version":"40'3","reported_seq":1207,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.412707+0000","last_change":"2023-12-19T09:41:48.888516+0000","last_active":"2023-12-19T09:57:20.412707+0000","last_peered":"2023-12-19T09:57:20.412707+0000","last_clean":"2023-12-19T09:57:20.412707+0000","last_became_active":"2023-12-19T09:41:48.880264+0000","last_became_peered":"2023-12-19T09:41:48.880264+0000","last_unstale":"2023-12-19T09:57:20.412707+0000","last_undegraded":"2023-12-19T09:57:20.412707+0000","last_fullsized":"2023-12-19T09:57:20.412707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.331710+0000","last_change":"2023-12-19T09:41:44.092861+0000","last_active":"2023-12-19T09:57:20.331710+0000","last_peered":"2023-12-19T09:57:20.331710+0000","last_clean":"2023-12-19T09:57:20.331710+0000","last_became_active":"2023-12-19T09:41:44.067765+0000","last_became_peered":"2023-12-19T09:41:44.067765+0000","last_unstale":"2023-12-19T09:57:20.331710+0000","last_undegraded":"2023-12-19T09:57:20.331710+0000","last_fullsized":"2023-12-19T09:57:20.331710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1220,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.146367+0000","last_change":"2023-12-19T09:40:55.369239+0000","last_active":"2023-12-19T09:57:21.146367+0000","last_peered":"2023-12-19T09:57:21.146367+0000","last_clean":"2023-12-19T09:57:21.146367+0000","last_became_active":"2023-12-19T09:40:55.366264+0000","last_became_peered":"2023-12-19T09:40:55.366264+0000","last_unstale":"2023-12-19T09:57:21.146367+0000","last_undegraded":"2023-12-19T09:57:21.146367+0000","last_fullsized":"2023-12-19T09:57:21.146367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1188,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.589312+0000","last_change":"2023-12-19T09:41:46.849208+0000","last_active":"2023-12-19T09:57:21.589312+0000","last_peered":"2023-12-19T09:57:21.589312+0000","last_clean":"2023-12-19T09:57:21.589312+0000","last_became_active":"2023-12-19T09:41:46.846639+0000","last_became_peered":"2023-12-19T09:41:46.846639+0000","last_unstale":"2023-12-19T09:57:21.589312+0000","last_undegraded":"2023-12-19T09:57:21.589312+0000","last_fullsized":"2023-12-19T09:57:21.589312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.031645+0000","last_change":"2023-12-19T09:41:43.967652+0000","last_active":"2023-12-19T09:57:22.031645+0000","last_peered":"2023-12-19T09:57:22.031645+0000","last_clean":"2023-12-19T09:57:22.031645+0000","last_became_active":"2023-12-19T09:41:43.965003+0000","last_became_peered":"2023-12-19T09:41:43.965003+0000","last_unstale":"2023-12-19T09:57:22.031645+0000","last_undegraded":"2023-12-19T09:57:22.031645+0000","last_fullsized":"2023-12-19T09:57:22.031645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1214,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.158275+0000","last_change":"2023-12-19T09:40:55.390358+0000","last_active":"2023-12-19T09:57:20.158275+0000","last_peered":"2023-12-19T09:57:20.158275+0000","last_clean":"2023-12-19T09:57:20.158275+0000","last_became_active":"2023-12-19T09:40:55.387550+0000","last_became_peered":"2023-12-19T09:40:55.387550+0000","last_unstale":"2023-12-19T09:57:20.158275+0000","last_undegraded":"2023-12-19T09:57:20.158275+0000","last_fullsized":"2023-12-19T09:57:20.158275+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1201,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.124169+0000","last_change":"2023-12-19T09:41:48.731885+0000","last_active":"2023-12-19T09:57:20.124169+0000","last_peered":"2023-12-19T09:57:20.124169+0000","last_clean":"2023-12-19T09:57:20.124169+0000","last_became_active":"2023-12-19T09:41:48.724265+0000","last_became_peered":"2023-12-19T09:41:48.724265+0000","last_unstale":"2023-12-19T09:57:20.124169+0000","last_undegraded":"2023-12-19T09:57:20.124169+0000","last_fullsized":"2023-12-19T09:57:20.124169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.089520+0000","last_change":"2023-12-19T09:41:43.899191+0000","last_active":"2023-12-19T09:57:20.089520+0000","last_peered":"2023-12-19T09:57:20.089520+0000","last_clean":"2023-12-19T09:57:20.089520+0000","last_became_active":"2023-12-19T09:41:43.895270+0000","last_became_peered":"2023-12-19T09:41:43.895270+0000","last_unstale":"2023-12-19T09:57:20.089520+0000","last_undegraded":"2023-12-19T09:57:20.089520+0000","last_fullsized":"2023-12-19T09:57:20.089520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1220,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.115401+0000","last_change":"2023-12-19T09:40:55.370124+0000","last_active":"2023-12-19T09:57:21.115401+0000","last_peered":"2023-12-19T09:57:21.115401+0000","last_clean":"2023-12-19T09:57:21.115401+0000","last_became_active":"2023-12-19T09:40:55.366632+0000","last_became_peered":"2023-12-19T09:40:55.366632+0000","last_unstale":"2023-12-19T09:57:21.115401+0000","last_undegraded":"2023-12-19T09:57:21.115401+0000","last_fullsized":"2023-12-19T09:57:21.115401+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1206,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.114120+0000","last_change":"2023-12-19T09:41:48.960658+0000","last_active":"2023-12-19T09:57:21.114120+0000","last_peered":"2023-12-19T09:57:21.114120+0000","last_clean":"2023-12-19T09:57:21.114120+0000","last_became_active":"2023-12-19T09:41:48.957786+0000","last_became_peered":"2023-12-19T09:41:48.957786+0000","last_unstale":"2023-12-19T09:57:21.114120+0000","last_undegraded":"2023-12-19T09:57:21.114120+0000","last_fullsized":"2023-12-19T09:57:21.114120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.698763+0000","last_change":"2023-12-19T09:41:44.646026+0000","last_active":"2023-12-19T09:57:21.698763+0000","last_peered":"2023-12-19T09:57:21.698763+0000","last_clean":"2023-12-19T09:57:21.698763+0000","last_became_active":"2023-12-19T09:41:44.640388+0000","last_became_peered":"2023-12-19T09:41:44.640388+0000","last_unstale":"2023-12-19T09:57:21.698763+0000","last_undegraded":"2023-12-19T09:57:21.698763+0000","last_fullsized":"2023-12-19T09:57:21.698763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1214,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.106529+0000","last_change":"2023-12-19T09:40:55.377818+0000","last_active":"2023-12-19T09:57:20.106529+0000","last_peered":"2023-12-19T09:57:20.106529+0000","last_clean":"2023-12-19T09:57:20.106529+0000","last_became_active":"2023-12-19T09:40:55.374987+0000","last_became_peered":"2023-12-19T09:40:55.374987+0000","last_unstale":"2023-12-19T09:57:20.106529+0000","last_undegraded":"2023-12-19T09:57:20.106529+0000","last_fullsized":"2023-12-19T09:57:20.106529+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:54.304643+0000","last_clean_scrub_stamp":"2023-12-19T09:40:54.304643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":1217,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.892030+0000","last_change":"2023-12-19T09:40:53.332271+0000","last_active":"2023-12-19T09:57:21.892030+0000","last_peered":"2023-12-19T09:57:21.892030+0000","last_clean":"2023-12-19T09:57:21.892030+0000","last_became_active":"2023-12-19T09:40:53.328758+0000","last_became_peered":"2023-12-19T09:40:53.328758+0000","last_unstale":"2023-12-19T09:57:21.892030+0000","last_undegraded":"2023-12-19T09:57:21.892030+0000","last_fullsized":"2023-12-19T09:57:21.892030+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:40:52.293719+0000","last_clean_scrub_stamp":"2023-12-19T09:40:52.293719+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"36'3","reported_seq":1209,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.173526+0000","last_change":"2023-12-19T09:41:49.052920+0000","last_active":"2023-12-19T09:57:21.173526+0000","last_peered":"2023-12-19T09:57:21.173526+0000","last_clean":"2023-12-19T09:57:21.173526+0000","last_became_active":"2023-12-19T09:41:49.049321+0000","last_became_peered":"2023-12-19T09:41:49.049321+0000","last_unstale":"2023-12-19T09:57:21.173526+0000","last_undegraded":"2023-12-19T09:57:21.173526+0000","last_fullsized":"2023-12-19T09:57:21.173526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.716300+0000","last_change":"2023-12-19T09:41:44.628513+0000","last_active":"2023-12-19T09:57:21.716300+0000","last_peered":"2023-12-19T09:57:21.716300+0000","last_clean":"2023-12-19T09:57:21.716300+0000","last_became_active":"2023-12-19T09:41:44.625833+0000","last_became_peered":"2023-12-19T09:41:44.625833+0000","last_unstale":"2023-12-19T09:57:21.716300+0000","last_undegraded":"2023-12-19T09:57:21.716300+0000","last_fullsized":"2023-12-19T09:57:21.716300+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1205,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.301548+0000","last_change":"2023-12-19T09:41:49.909088+0000","last_active":"2023-12-19T09:57:21.301548+0000","last_peered":"2023-12-19T09:57:21.301548+0000","last_clean":"2023-12-19T09:57:21.301548+0000","last_became_active":"2023-12-19T09:41:49.906227+0000","last_became_peered":"2023-12-19T09:41:49.906227+0000","last_unstale":"2023-12-19T09:57:21.301548+0000","last_undegraded":"2023-12-19T09:57:21.301548+0000","last_fullsized":"2023-12-19T09:57:21.301548+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.264009+0000","last_change":"2023-12-19T09:41:43.791102+0000","last_active":"2023-12-19T09:57:22.264009+0000","last_peered":"2023-12-19T09:57:22.264009+0000","last_clean":"2023-12-19T09:57:22.264009+0000","last_became_active":"2023-12-19T09:41:43.788014+0000","last_became_peered":"2023-12-19T09:41:43.788014+0000","last_unstale":"2023-12-19T09:57:22.264009+0000","last_undegraded":"2023-12-19T09:57:22.264009+0000","last_fullsized":"2023-12-19T09:57:22.264009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.18","version":"57'1","reported_seq":1078,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.758557+0000","last_change":"2023-12-19T09:41:47.850812+0000","last_active":"2023-12-19T09:57:20.758557+0000","last_peered":"2023-12-19T09:57:20.758557+0000","last_clean":"2023-12-19T09:57:20.758557+0000","last_became_active":"2023-12-19T09:41:47.839786+0000","last_became_peered":"2023-12-19T09:41:47.839786+0000","last_unstale":"2023-12-19T09:57:20.758557+0000","last_undegraded":"2023-12-19T09:57:20.758557+0000","last_fullsized":"2023-12-19T09:57:20.758557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.007464+0000","last_change":"2023-12-19T09:41:44.510414+0000","last_active":"2023-12-19T09:57:20.007464+0000","last_peered":"2023-12-19T09:57:20.007464+0000","last_clean":"2023-12-19T09:57:20.007464+0000","last_became_active":"2023-12-19T09:41:44.502218+0000","last_became_peered":"2023-12-19T09:41:44.502218+0000","last_unstale":"2023-12-19T09:57:20.007464+0000","last_undegraded":"2023-12-19T09:57:20.007464+0000","last_fullsized":"2023-12-19T09:57:20.007464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1200,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.130969+0000","last_change":"2023-12-19T09:41:50.117367+0000","last_active":"2023-12-19T09:57:20.130969+0000","last_peered":"2023-12-19T09:57:20.130969+0000","last_clean":"2023-12-19T09:57:20.130969+0000","last_became_active":"2023-12-19T09:41:50.100260+0000","last_became_peered":"2023-12-19T09:41:50.100260+0000","last_unstale":"2023-12-19T09:57:20.130969+0000","last_undegraded":"2023-12-19T09:57:20.130969+0000","last_fullsized":"2023-12-19T09:57:20.130969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:22.111578+0000","last_change":"2023-12-19T09:41:44.694402+0000","last_active":"2023-12-19T09:57:22.111578+0000","last_peered":"2023-12-19T09:57:22.111578+0000","last_clean":"2023-12-19T09:57:22.111578+0000","last_became_active":"2023-12-19T09:41:44.689340+0000","last_became_peered":"2023-12-19T09:41:44.689340+0000","last_unstale":"2023-12-19T09:57:22.111578+0000","last_undegraded":"2023-12-19T09:57:22.111578+0000","last_fullsized":"2023-12-19T09:57:22.111578+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1a","version":"24'3","reported_seq":1082,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.777763+0000","last_change":"2023-12-19T09:41:47.760578+0000","last_active":"2023-12-19T09:57:21.777763+0000","last_peered":"2023-12-19T09:57:21.777763+0000","last_clean":"2023-12-19T09:57:21.777763+0000","last_became_active":"2023-12-19T09:41:47.751422+0000","last_became_peered":"2023-12-19T09:41:47.751422+0000","last_unstale":"2023-12-19T09:57:21.777763+0000","last_undegraded":"2023-12-19T09:57:21.777763+0000","last_fullsized":"2023-12-19T09:57:21.777763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:19.627577+0000","last_change":"2023-12-19T09:41:44.652693+0000","last_active":"2023-12-19T09:57:19.627577+0000","last_peered":"2023-12-19T09:57:19.627577+0000","last_clean":"2023-12-19T09:57:19.627577+0000","last_became_active":"2023-12-19T09:41:44.641823+0000","last_became_peered":"2023-12-19T09:41:44.641823+0000","last_unstale":"2023-12-19T09:57:19.627577+0000","last_undegraded":"2023-12-19T09:57:19.627577+0000","last_fullsized":"2023-12-19T09:57:19.627577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1076,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.688737+0000","last_change":"2023-12-19T09:41:47.918436+0000","last_active":"2023-12-19T09:57:21.688737+0000","last_peered":"2023-12-19T09:57:21.688737+0000","last_clean":"2023-12-19T09:57:21.688737+0000","last_became_active":"2023-12-19T09:41:47.915328+0000","last_became_peered":"2023-12-19T09:41:47.915328+0000","last_unstale":"2023-12-19T09:57:21.688737+0000","last_undegraded":"2023-12-19T09:57:21.688737+0000","last_fullsized":"2023-12-19T09:57:21.688737+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.989589+0000","last_change":"2023-12-19T09:41:44.622479+0000","last_active":"2023-12-19T09:57:21.989589+0000","last_peered":"2023-12-19T09:57:21.989589+0000","last_clean":"2023-12-19T09:57:21.989589+0000","last_became_active":"2023-12-19T09:41:44.611913+0000","last_became_peered":"2023-12-19T09:41:44.611913+0000","last_unstale":"2023-12-19T09:57:21.989589+0000","last_undegraded":"2023-12-19T09:57:21.989589+0000","last_fullsized":"2023-12-19T09:57:21.989589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1200,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:19.766881+0000","last_change":"2023-12-19T09:41:48.997784+0000","last_active":"2023-12-19T09:57:19.766881+0000","last_peered":"2023-12-19T09:57:19.766881+0000","last_clean":"2023-12-19T09:57:19.766881+0000","last_became_active":"2023-12-19T09:41:48.992519+0000","last_became_peered":"2023-12-19T09:41:48.992519+0000","last_unstale":"2023-12-19T09:57:19.766881+0000","last_undegraded":"2023-12-19T09:57:19.766881+0000","last_fullsized":"2023-12-19T09:57:19.766881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.923581+0000","last_change":"2023-12-19T09:41:44.528794+0000","last_active":"2023-12-19T09:57:21.923581+0000","last_peered":"2023-12-19T09:57:21.923581+0000","last_clean":"2023-12-19T09:57:21.923581+0000","last_became_active":"2023-12-19T09:41:44.520591+0000","last_became_peered":"2023-12-19T09:41:44.520591+0000","last_unstale":"2023-12-19T09:57:21.923581+0000","last_undegraded":"2023-12-19T09:57:21.923581+0000","last_fullsized":"2023-12-19T09:57:21.923581+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"45'3","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.587636+0000","last_change":"2023-12-19T09:41:47.021642+0000","last_active":"2023-12-19T09:57:21.587636+0000","last_peered":"2023-12-19T09:57:21.587636+0000","last_clean":"2023-12-19T09:57:21.587636+0000","last_became_active":"2023-12-19T09:41:47.010899+0000","last_became_peered":"2023-12-19T09:41:47.010899+0000","last_unstale":"2023-12-19T09:57:21.587636+0000","last_undegraded":"2023-12-19T09:57:21.587636+0000","last_fullsized":"2023-12-19T09:57:21.587636+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1080,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.858592+0000","last_change":"2023-12-19T09:41:44.704700+0000","last_active":"2023-12-19T09:57:20.858592+0000","last_peered":"2023-12-19T09:57:20.858592+0000","last_clean":"2023-12-19T09:57:20.858592+0000","last_became_active":"2023-12-19T09:41:44.689193+0000","last_became_peered":"2023-12-19T09:41:44.689193+0000","last_unstale":"2023-12-19T09:57:20.858592+0000","last_undegraded":"2023-12-19T09:57:20.858592+0000","last_fullsized":"2023-12-19T09:57:20.858592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1200,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:19.826423+0000","last_change":"2023-12-19T09:41:50.654472+0000","last_active":"2023-12-19T09:57:19.826423+0000","last_peered":"2023-12-19T09:57:19.826423+0000","last_clean":"2023-12-19T09:57:19.826423+0000","last_became_active":"2023-12-19T09:41:50.645171+0000","last_became_peered":"2023-12-19T09:41:50.645171+0000","last_unstale":"2023-12-19T09:57:19.826423+0000","last_undegraded":"2023-12-19T09:57:19.826423+0000","last_fullsized":"2023-12-19T09:57:19.826423+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.156508+0000","last_change":"2023-12-19T09:41:44.648689+0000","last_active":"2023-12-19T09:57:20.156508+0000","last_peered":"2023-12-19T09:57:20.156508+0000","last_clean":"2023-12-19T09:57:20.156508+0000","last_became_active":"2023-12-19T09:41:44.635214+0000","last_became_peered":"2023-12-19T09:41:44.635214+0000","last_unstale":"2023-12-19T09:57:20.156508+0000","last_undegraded":"2023-12-19T09:57:20.156508+0000","last_fullsized":"2023-12-19T09:57:20.156508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1","version":"32'3","reported_seq":1081,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.757796+0000","last_change":"2023-12-19T09:41:47.793198+0000","last_active":"2023-12-19T09:57:20.757796+0000","last_peered":"2023-12-19T09:57:20.757796+0000","last_clean":"2023-12-19T09:57:20.757796+0000","last_became_active":"2023-12-19T09:41:47.781592+0000","last_became_peered":"2023-12-19T09:41:47.781592+0000","last_unstale":"2023-12-19T09:57:20.757796+0000","last_undegraded":"2023-12-19T09:57:20.757796+0000","last_fullsized":"2023-12-19T09:57:20.757796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1214,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.908072+0000","last_change":"2023-12-19T09:41:43.991485+0000","last_active":"2023-12-19T09:57:20.908072+0000","last_peered":"2023-12-19T09:57:20.908072+0000","last_clean":"2023-12-19T09:57:20.908072+0000","last_became_active":"2023-12-19T09:41:43.985931+0000","last_became_peered":"2023-12-19T09:41:43.985931+0000","last_unstale":"2023-12-19T09:57:20.908072+0000","last_undegraded":"2023-12-19T09:57:20.908072+0000","last_fullsized":"2023-12-19T09:57:20.908072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1189,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.950245+0000","last_change":"2023-12-19T09:41:46.831650+0000","last_active":"2023-12-19T09:57:21.950245+0000","last_peered":"2023-12-19T09:57:21.950245+0000","last_clean":"2023-12-19T09:57:21.950245+0000","last_became_active":"2023-12-19T09:41:46.825353+0000","last_became_peered":"2023-12-19T09:41:46.825353+0000","last_unstale":"2023-12-19T09:57:21.950245+0000","last_undegraded":"2023-12-19T09:57:21.950245+0000","last_fullsized":"2023-12-19T09:57:21.950245+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1194,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.235138+0000","last_change":"2023-12-19T09:41:44.065242+0000","last_active":"2023-12-19T09:57:21.235138+0000","last_peered":"2023-12-19T09:57:21.235138+0000","last_clean":"2023-12-19T09:57:21.235138+0000","last_became_active":"2023-12-19T09:41:44.062711+0000","last_became_peered":"2023-12-19T09:41:44.062711+0000","last_unstale":"2023-12-19T09:57:21.235138+0000","last_undegraded":"2023-12-19T09:57:21.235138+0000","last_fullsized":"2023-12-19T09:57:21.235138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1188,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.589327+0000","last_change":"2023-12-19T09:41:46.880242+0000","last_active":"2023-12-19T09:57:21.589327+0000","last_peered":"2023-12-19T09:57:21.589327+0000","last_clean":"2023-12-19T09:57:21.589327+0000","last_became_active":"2023-12-19T09:41:46.877617+0000","last_became_peered":"2023-12-19T09:41:46.877617+0000","last_unstale":"2023-12-19T09:57:21.589327+0000","last_undegraded":"2023-12-19T09:57:21.589327+0000","last_fullsized":"2023-12-19T09:57:21.589327+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1208,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:20.174864+0000","last_change":"2023-12-19T09:41:44.513456+0000","last_active":"2023-12-19T09:57:20.174864+0000","last_peered":"2023-12-19T09:57:20.174864+0000","last_clean":"2023-12-19T09:57:20.174864+0000","last_became_active":"2023-12-19T09:41:44.493716+0000","last_became_peered":"2023-12-19T09:41:44.493716+0000","last_unstale":"2023-12-19T09:57:20.174864+0000","last_undegraded":"2023-12-19T09:57:20.174864+0000","last_fullsized":"2023-12-19T09:57:20.174864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:42.045886+0000","last_clean_scrub_stamp":"2023-12-19T09:41:42.045886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1078,"reported_epoch":693,"state":"active+clean","last_fresh":"2023-12-19T09:57:21.944488+0000","last_change":"2023-12-19T09:41:47.979679+0000","last_active":"2023-12-19T09:57:21.944488+0000","last_peered":"2023-12-19T09:57:21.944488+0000","last_clean":"2023-12-19T09:57:21.944488+0000","last_became_active":"2023-12-19T09:41:47.964957+0000","last_became_peered":"2023-12-19T09:41:47.964957+0000","last_unstale":"2023-12-19T09:57:21.944488+0000","last_undegraded":"2023-12-19T09:57:21.944488+0000","last_fullsized":"2023-12-19T09:57:21.944488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:41:43.062395+0000","last_clean_scrub_stamp":"2023-12-19T09:41:43.062395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1024,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706594,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":123636,"kb_used_data":7852,"kb_used_omap":0,"kb_used_meta":115776,"kb_avail":104733964,"statfs":{"total":107374182400,"available":107247579136,"internally_reserved":0,"allocated":8040448,"data_stored":5054058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":118554624},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654706596,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":60568,"kb_used_data":7248,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104797032,"statfs":{"total":107374182400,"available":107312160768,"internally_reserved":0,"allocated":7421952,"data_stored":4459106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654706590,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":114564,"kb_used_data":7100,"kb_used_omap":0,"kb_used_meta":107456,"kb_avail":104743036,"statfs":{"total":107374182400,"available":107256868864,"internally_reserved":0,"allocated":7270400,"data_stored":4461809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110034944},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654706589,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":61304,"kb_used_data":7984,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104796296,"statfs":{"total":107374182400,"available":107311407104,"internally_reserved":0,"allocated":8175616,"data_stored":5043331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-19T09:57:24.362 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.362 INFO:tasks.ceph:pgid 18.e last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.362 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.362 INFO:tasks.ceph:pgid 18.f last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.362 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.362 INFO:tasks.ceph:pgid 18.c last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.363 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.363 INFO:tasks.ceph:pgid 18.d last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.363 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.363 INFO:tasks.ceph:pgid 18.a last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.363 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.363 INFO:tasks.ceph:pgid 18.b last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.364 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.364 INFO:tasks.ceph:pgid 18.8 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.364 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.364 INFO:tasks.ceph:pgid 18.9 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.364 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.365 INFO:tasks.ceph:pgid 18.6 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.365 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.365 INFO:tasks.ceph:pgid 18.7 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.365 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.366 INFO:tasks.ceph:pgid 18.4 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.366 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.370 INFO:tasks.ceph:pgid 18.5 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.370 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.370 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.371 INFO:tasks.ceph:pgid 18.17 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.371 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.371 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.371 INFO:tasks.ceph:pgid 18.16 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.372 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.372 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.372 INFO:tasks.ceph:pgid 18.15 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.372 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.372 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.372 INFO:tasks.ceph:pgid 18.14 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.372 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.373 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.373 INFO:tasks.ceph:pgid 18.12 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.373 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.373 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.373 INFO:tasks.ceph:pgid 18.11 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.373 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.374 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.374 INFO:tasks.ceph:pgid 18.10 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.374 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.374 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-19T09:40:54.304643+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=54, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.374 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T09:40:52.293719+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=40, tm_sec=52, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.374 INFO:tasks.ceph:pgid 18.13 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.375 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.375 INFO:tasks.ceph:pgid 18.19 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.375 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.375 INFO:tasks.ceph:pgid 18.18 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.375 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.375 INFO:tasks.ceph:pgid 18.1b last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.376 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.376 INFO:tasks.ceph:pgid 18.1a last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.376 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.376 INFO:tasks.ceph:pgid 18.1d last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.376 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.376 INFO:tasks.ceph:pgid 18.1c last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.376 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.377 INFO:tasks.ceph:pgid 18.1f last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.377 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.377 INFO:tasks.ceph:pgid 18.1e last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.377 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.377 INFO:tasks.ceph:pgid 18.1 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.377 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.378 INFO:tasks.ceph:pgid 18.0 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.378 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.378 INFO:tasks.ceph:pgid 18.3 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.378 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-19T09:41:42.045886+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=42, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.378 INFO:tasks.ceph:pgid 18.2 last_scrub_stamp 2023-12-19T09:41:43.062395+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=41, tm_sec=43, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=9, tm_min=57, tm_sec=21, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T09:57:24.378 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T09:57:44.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T09:57:44.508 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.505+0000 7ffb21b1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:44.509 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.509+0000 7ffb21b1e640 1 Processor -- start 2023-12-19T09:57:44.509 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.509+0000 7ffb21b1e640 1 -- start start 2023-12-19T09:57:44.511 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb21b1e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb1c06fa50 0x7ffb1c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:44.511 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb21b1e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c071b40 con 0x7ffb1c0703a0 2023-12-19T09:57:44.511 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb21b1e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1c070d50 con 0x7ffb1c06fa50 2023-12-19T09:57:44.511 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1b7fe640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb1c06fa50 0x7ffb1c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:44.511 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1affd640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffb1c0703a0 0x7ffb1c135110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35058/0 (socket says 172.21.15.99:35058) 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1affd640 1 -- 172.21.15.99:0/3111636532 learned_addr learned my addr 172.21.15.99:0/3111636532 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1b7fe640 1 -- 172.21.15.99:0/3111636532 >> v1:172.21.15.99:6789/0 conn(0x7ffb1c0703a0 legacy=0x7ffb1c135110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1b7fe640 1 -- 172.21.15.99:0/3111636532 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c071830 con 0x7ffb1c06fa50 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1a7fc640 1 -- 172.21.15.99:0/3111636532 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397490506 0 0) 0x7ffb1c071b40 con 0x7ffb1c0703a0 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1b7fe640 1 --2- 172.21.15.99:0/3111636532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c06fe60 crc :-1 s=READY pgs=12692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea32f329c5487e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1a7fc640 1 -- 172.21.15.99:0/3111636532 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb0c009ce0 con 0x7ffb1c06fa50 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1a7fc640 1 -- 172.21.15.99:0/3111636532 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffb0c009e40 con 0x7ffb1c06fa50 2023-12-19T09:57:44.512 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.510+0000 7ffb1a7fc640 1 -- 172.21.15.99:0/3111636532 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb0c00e360 con 0x7ffb1c06fa50 2023-12-19T09:57:44.513 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 1 -- 172.21.15.99:0/3111636532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 msgr2=0x7ffb1c06fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.513 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 1 --2- 172.21.15.99:0/3111636532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c06fe60 crc :-1 s=READY pgs=12692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.513 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 1 -- 172.21.15.99:0/3111636532 shutdown_connections 2023-12-19T09:57:44.513 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 1 --2- 172.21.15.99:0/3111636532 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c06fe60 unknown :-1 s=CLOSED pgs=12692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.513 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 1 -- 172.21.15.99:0/3111636532 >> 172.21.15.99:0/3111636532 conn(0x7ffb1c09dff0 msgr2=0x7ffb1c09e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:44.513 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 1 -- 172.21.15.99:0/3111636532 shutdown_connections 2023-12-19T09:57:44.513 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 1 -- 172.21.15.99:0/3111636532 wait complete. 2023-12-19T09:57:44.514 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.511+0000 7ffb21b1e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:44.515 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.512+0000 7ffb21b1e640 1 Processor -- start 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.512+0000 7ffb21b1e640 1 -- start start 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.513+0000 7ffb21b1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c12cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.513+0000 7ffb21b1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c12e840 con 0x7ffb1c06fa50 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.513+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c12cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.513+0000 7ffb1b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c12cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53266/0 (socket says 172.21.15.99:53266) 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.513+0000 7ffb1b7fe640 1 -- 172.21.15.99:0/8669986 learned_addr learned my addr 172.21.15.99:0/8669986 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.514+0000 7ffb1b7fe640 1 -- 172.21.15.99:0/8669986 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c1303a0 con 0x7ffb1c06fa50 2023-12-19T09:57:44.516 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.514+0000 7ffb1b7fe640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c12cdf0 crc :-1 s=READY pgs=12693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.514+0000 7ffb03fff640 1 -- 172.21.15.99:0/8669986 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb0c014620 con 0x7ffb1c06fa50 2023-12-19T09:57:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.514+0000 7ffb03fff640 1 -- 172.21.15.99:0/8669986 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7ffb0c014780 con 0x7ffb1c06fa50 2023-12-19T09:57:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.514+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c130e10 con 0x7ffb1c06fa50 2023-12-19T09:57:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.514+0000 7ffb03fff640 1 -- 172.21.15.99:0/8669986 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7ffb0c014a20 con 0x7ffb1c06fa50 2023-12-19T09:57:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.514+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c12f6b0 con 0x7ffb1c06fa50 2023-12-19T09:57:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.515+0000 7ffb03fff640 1 -- 172.21.15.99:0/8669986 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7ffb0c014bd0 con 0x7ffb1c06fa50 2023-12-19T09:57:44.517 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.515+0000 7ffb03fff640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb08037810 0x7ffb08039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:44.518 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.515+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c12f960 con 0x7ffb1c06fa50 2023-12-19T09:57:44.518 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.515+0000 7ffb03fff640 1 -- 172.21.15.99:0/8669986 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(694..694 src has 1..694) v4 ==== 3741+0+0 (crc 0 0 0) 0x7ffb0c019040 con 0x7ffb1c06fa50 2023-12-19T09:57:44.518 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.515+0000 7ffb1affd640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb08037810 0x7ffb08039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:44.518 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.516+0000 7ffb1affd640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb08037810 0x7ffb08039d20 crc :-1 s=READY pgs=3655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:44.519 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.520+0000 7ffb03fff640 1 -- 172.21.15.99:0/8669986 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7ffb1c12f960 con 0x7ffb1c06fa50 2023-12-19T09:57:44.684 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.685+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 --> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb1c0a08c0 con 0x7ffb08037810 2023-12-19T09:57:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.690+0000 7ffb03fff640 1 -- 172.21.15.99:0/8669986 <== mgr.4099 v2:172.21.15.178:6800/1252704696 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+184183 (crc 0 0 0) 0x7ffb1c0a08c0 con 0x7ffb08037810 2023-12-19T09:57:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: 2023-12-19T09:57:44.692 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2023-12-19T09:57:44.693 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb08037810 msgr2=0x7ffb08039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.694 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb08037810 0x7ffb08039d20 crc :-1 s=READY pgs=3655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.694 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 msgr2=0x7ffb1c12cdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.694 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c12cdf0 crc :-1 s=READY pgs=12693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.694 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 shutdown_connections 2023-12-19T09:57:44.694 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7ffb08037810 0x7ffb08039d20 unknown :-1 s=CLOSED pgs=3655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.694 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 --2- 172.21.15.99:0/8669986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb1c06fa50 0x7ffb1c12cdf0 unknown :-1 s=CLOSED pgs=12693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.695 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 >> 172.21.15.99:0/8669986 conn(0x7ffb1c09dff0 msgr2=0x7ffb1c134190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:44.695 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 shutdown_connections 2023-12-19T09:57:44.695 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.692+0000 7ffb21b1e640 1 -- 172.21.15.99:0/8669986 wait complete. 2023-12-19T09:57:44.702 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1194,"stamp":"2023-12-19T09:57:44.503598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591397,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":152,"num_write_kb":1909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":146,"acting":146,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":360088,"kb_used_data":30200,"kb_used_omap":0,"kb_used_meta":329856,"kb_avail":419070312,"statfs":{"total":429496729600,"available":429127999488,"internally_reserved":0,"allocated":30924800,"data_stored":19033092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":337772544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003114"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.959915+0000","last_change":"2023-12-19T09:41:43.996729+0000","last_active":"2023-12-19T09:57:24.959915+0000","last_peered":"2023-12-19T09:57:24.959915+0000","last_clean":"2023-12-19T09:57:24.959915+0000","last_became_active":"2023-12-19T09:41:43.988867+0000","last_became_peered":"2023-12-19T09:41:43.988867+0000","last_unstale":"2023-12-19T09:57:24.959915+0000","last_undegraded":"2023-12-19T09:57:24.959915+0000","last_fullsized":"2023-12-19T09:57:24.959915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.619918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.619918+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.619918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1209,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.229740+0000","last_change":"2023-12-19T09:41:49.091716+0000","last_active":"2023-12-19T09:57:25.229740+0000","last_peered":"2023-12-19T09:57:25.229740+0000","last_clean":"2023-12-19T09:57:25.229740+0000","last_became_active":"2023-12-19T09:41:49.078919+0000","last_became_peered":"2023-12-19T09:41:49.078919+0000","last_unstale":"2023-12-19T09:57:25.229740+0000","last_undegraded":"2023-12-19T09:57:25.229740+0000","last_fullsized":"2023-12-19T09:57:25.229740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.738670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.738670+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.738670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.443951+0000","last_change":"2023-12-19T09:41:44.097849+0000","last_active":"2023-12-19T09:57:26.443951+0000","last_peered":"2023-12-19T09:57:26.443951+0000","last_clean":"2023-12-19T09:57:26.443951+0000","last_became_active":"2023-12-19T09:41:44.070813+0000","last_became_peered":"2023-12-19T09:41:44.070813+0000","last_unstale":"2023-12-19T09:57:26.443951+0000","last_undegraded":"2023-12-19T09:57:26.443951+0000","last_fullsized":"2023-12-19T09:57:26.443951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.176720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.176720+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.176720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1080,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.461641+0000","last_change":"2023-12-19T09:41:47.646204+0000","last_active":"2023-12-19T09:57:25.461641+0000","last_peered":"2023-12-19T09:57:25.461641+0000","last_clean":"2023-12-19T09:57:25.461641+0000","last_became_active":"2023-12-19T09:41:47.638438+0000","last_became_peered":"2023-12-19T09:41:47.638438+0000","last_unstale":"2023-12-19T09:57:25.461641+0000","last_undegraded":"2023-12-19T09:57:25.461641+0000","last_fullsized":"2023-12-19T09:57:25.461641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.059071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.059071+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.059071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.259688+0000","last_change":"2023-12-19T09:41:44.414780+0000","last_active":"2023-12-19T09:57:26.259688+0000","last_peered":"2023-12-19T09:57:26.259688+0000","last_clean":"2023-12-19T09:57:26.259688+0000","last_became_active":"2023-12-19T09:41:44.399400+0000","last_became_peered":"2023-12-19T09:41:44.399400+0000","last_unstale":"2023-12-19T09:57:26.259688+0000","last_undegraded":"2023-12-19T09:57:26.259688+0000","last_fullsized":"2023-12-19T09:57:26.259688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.176622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.176622+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.176622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1209,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.915027+0000","last_change":"2023-12-19T09:41:48.952590+0000","last_active":"2023-12-19T09:57:25.915027+0000","last_peered":"2023-12-19T09:57:25.915027+0000","last_clean":"2023-12-19T09:57:25.915027+0000","last_became_active":"2023-12-19T09:41:48.947301+0000","last_became_peered":"2023-12-19T09:41:48.947301+0000","last_unstale":"2023-12-19T09:57:25.915027+0000","last_undegraded":"2023-12-19T09:57:25.915027+0000","last_fullsized":"2023-12-19T09:57:25.915027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.738786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.738786+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.738786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.840028+0000","last_change":"2023-12-19T09:41:44.707713+0000","last_active":"2023-12-19T09:57:25.840028+0000","last_peered":"2023-12-19T09:57:25.840028+0000","last_clean":"2023-12-19T09:57:25.840028+0000","last_became_active":"2023-12-19T09:41:44.695211+0000","last_became_peered":"2023-12-19T09:41:44.695211+0000","last_unstale":"2023-12-19T09:57:25.840028+0000","last_undegraded":"2023-12-19T09:57:25.840028+0000","last_fullsized":"2023-12-19T09:57:25.840028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.054433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.054433+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.054433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1209,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.835931+0000","last_change":"2023-12-19T09:41:48.985139+0000","last_active":"2023-12-19T09:57:25.835931+0000","last_peered":"2023-12-19T09:57:25.835931+0000","last_clean":"2023-12-19T09:57:25.835931+0000","last_became_active":"2023-12-19T09:41:48.981358+0000","last_became_peered":"2023-12-19T09:41:48.981358+0000","last_unstale":"2023-12-19T09:57:25.835931+0000","last_undegraded":"2023-12-19T09:57:25.835931+0000","last_fullsized":"2023-12-19T09:57:25.835931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.738571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.738571+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.738571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1217,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.685763+0000","last_change":"2023-12-19T09:41:44.014471+0000","last_active":"2023-12-19T09:57:25.685763+0000","last_peered":"2023-12-19T09:57:25.685763+0000","last_clean":"2023-12-19T09:57:25.685763+0000","last_became_active":"2023-12-19T09:41:44.010134+0000","last_became_peered":"2023-12-19T09:41:44.010134+0000","last_unstale":"2023-12-19T09:57:25.685763+0000","last_undegraded":"2023-12-19T09:57:25.685763+0000","last_fullsized":"2023-12-19T09:57:25.685763+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.736435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.736435+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.736435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.a","version":"48'3","reported_seq":1210,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.340973+0000","last_change":"2023-12-19T09:41:50.049917+0000","last_active":"2023-12-19T09:57:26.340973+0000","last_peered":"2023-12-19T09:57:26.340973+0000","last_clean":"2023-12-19T09:57:26.340973+0000","last_became_active":"2023-12-19T09:41:50.042450+0000","last_became_peered":"2023-12-19T09:41:50.042450+0000","last_unstale":"2023-12-19T09:57:26.340973+0000","last_undegraded":"2023-12-19T09:57:26.340973+0000","last_fullsized":"2023-12-19T09:57:26.340973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'3","last_scrub_stamp":"2023-12-19T09:57:23.177640+0000","last_deep_scrub":"48'3","last_deep_scrub_stamp":"2023-12-19T09:57:23.177640+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.177640+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.451435+0000","last_change":"2023-12-19T09:41:44.728818+0000","last_active":"2023-12-19T09:57:25.451435+0000","last_peered":"2023-12-19T09:57:25.451435+0000","last_clean":"2023-12-19T09:57:25.451435+0000","last_became_active":"2023-12-19T09:41:44.723909+0000","last_became_peered":"2023-12-19T09:41:44.723909+0000","last_unstale":"2023-12-19T09:57:25.451435+0000","last_undegraded":"2023-12-19T09:57:25.451435+0000","last_fullsized":"2023-12-19T09:57:25.451435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.056001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.056001+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.056001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1205,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.220941+0000","last_change":"2023-12-19T09:41:47.838325+0000","last_active":"2023-12-19T09:57:26.220941+0000","last_peered":"2023-12-19T09:57:26.220941+0000","last_clean":"2023-12-19T09:57:26.220941+0000","last_became_active":"2023-12-19T09:41:47.832642+0000","last_became_peered":"2023-12-19T09:41:47.832642+0000","last_unstale":"2023-12-19T09:57:26.220941+0000","last_undegraded":"2023-12-19T09:57:26.220941+0000","last_fullsized":"2023-12-19T09:57:26.220941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.179466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.179466+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.179466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.202747+0000","last_change":"2023-12-19T09:41:44.592810+0000","last_active":"2023-12-19T09:57:25.202747+0000","last_peered":"2023-12-19T09:57:25.202747+0000","last_clean":"2023-12-19T09:57:25.202747+0000","last_became_active":"2023-12-19T09:41:44.585031+0000","last_became_peered":"2023-12-19T09:41:44.585031+0000","last_unstale":"2023-12-19T09:57:25.202747+0000","last_undegraded":"2023-12-19T09:57:25.202747+0000","last_fullsized":"2023-12-19T09:57:25.202747+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.056357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.056357+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.056357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1080,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.820031+0000","last_change":"2023-12-19T09:41:47.669623+0000","last_active":"2023-12-19T09:57:25.820031+0000","last_peered":"2023-12-19T09:57:25.820031+0000","last_clean":"2023-12-19T09:57:25.820031+0000","last_became_active":"2023-12-19T09:41:47.651334+0000","last_became_peered":"2023-12-19T09:41:47.651334+0000","last_unstale":"2023-12-19T09:57:25.820031+0000","last_undegraded":"2023-12-19T09:57:25.820031+0000","last_fullsized":"2023-12-19T09:57:25.820031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.058809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.058809+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.058809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.070934+0000","last_change":"2023-12-19T09:41:43.967186+0000","last_active":"2023-12-19T09:57:25.070934+0000","last_peered":"2023-12-19T09:57:25.070934+0000","last_clean":"2023-12-19T09:57:25.070934+0000","last_became_active":"2023-12-19T09:41:43.956781+0000","last_became_peered":"2023-12-19T09:41:43.956781+0000","last_unstale":"2023-12-19T09:57:25.070934+0000","last_undegraded":"2023-12-19T09:57:25.070934+0000","last_fullsized":"2023-12-19T09:57:25.070934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.621077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.621077+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.621077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1210,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.783264+0000","last_change":"2023-12-19T09:41:50.824272+0000","last_active":"2023-12-19T09:57:25.783264+0000","last_peered":"2023-12-19T09:57:25.783264+0000","last_clean":"2023-12-19T09:57:25.783264+0000","last_became_active":"2023-12-19T09:41:50.819734+0000","last_became_peered":"2023-12-19T09:41:50.819734+0000","last_unstale":"2023-12-19T09:57:25.783264+0000","last_undegraded":"2023-12-19T09:57:25.783264+0000","last_fullsized":"2023-12-19T09:57:25.783264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.737498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.737498+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.737498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1217,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.687176+0000","last_change":"2023-12-19T09:41:43.948061+0000","last_active":"2023-12-19T09:57:25.687176+0000","last_peered":"2023-12-19T09:57:25.687176+0000","last_clean":"2023-12-19T09:57:25.687176+0000","last_became_active":"2023-12-19T09:41:43.945414+0000","last_became_peered":"2023-12-19T09:41:43.945414+0000","last_unstale":"2023-12-19T09:57:25.687176+0000","last_undegraded":"2023-12-19T09:57:25.687176+0000","last_fullsized":"2023-12-19T09:57:25.687176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.737065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.737065+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.737065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"30'3","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.717003+0000","last_change":"2023-12-19T09:41:48.128963+0000","last_active":"2023-12-19T09:57:26.717003+0000","last_peered":"2023-12-19T09:57:26.717003+0000","last_clean":"2023-12-19T09:57:26.717003+0000","last_became_active":"2023-12-19T09:41:48.126255+0000","last_became_peered":"2023-12-19T09:41:48.126255+0000","last_unstale":"2023-12-19T09:57:26.717003+0000","last_undegraded":"2023-12-19T09:57:26.717003+0000","last_fullsized":"2023-12-19T09:57:26.717003+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2023-12-19T09:57:23.178330+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2023-12-19T09:57:23.178330+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.178330+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.726780+0000","last_change":"2023-12-19T09:41:44.807942+0000","last_active":"2023-12-19T09:57:25.726780+0000","last_peered":"2023-12-19T09:57:25.726780+0000","last_clean":"2023-12-19T09:57:25.726780+0000","last_became_active":"2023-12-19T09:41:44.792603+0000","last_became_peered":"2023-12-19T09:41:44.792603+0000","last_unstale":"2023-12-19T09:57:25.726780+0000","last_undegraded":"2023-12-19T09:57:25.726780+0000","last_fullsized":"2023-12-19T09:57:25.726780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.054404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.054404+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.054404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1210,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.968591+0000","last_change":"2023-12-19T09:41:50.700445+0000","last_active":"2023-12-19T09:57:25.968591+0000","last_peered":"2023-12-19T09:57:25.968591+0000","last_clean":"2023-12-19T09:57:25.968591+0000","last_became_active":"2023-12-19T09:41:50.697862+0000","last_became_peered":"2023-12-19T09:41:50.697862+0000","last_unstale":"2023-12-19T09:57:25.968591+0000","last_undegraded":"2023-12-19T09:57:25.968591+0000","last_fullsized":"2023-12-19T09:57:25.968591+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.737379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.737379+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.737379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.667773+0000","last_change":"2023-12-19T09:41:43.864107+0000","last_active":"2023-12-19T09:57:24.667773+0000","last_peered":"2023-12-19T09:57:24.667773+0000","last_clean":"2023-12-19T09:57:24.667773+0000","last_became_active":"2023-12-19T09:41:43.861579+0000","last_became_peered":"2023-12-19T09:41:43.861579+0000","last_unstale":"2023-12-19T09:57:24.667773+0000","last_undegraded":"2023-12-19T09:57:24.667773+0000","last_fullsized":"2023-12-19T09:57:24.667773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.620140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.620140+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.620140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1191,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.013711+0000","last_change":"2023-12-19T09:41:46.851420+0000","last_active":"2023-12-19T09:57:25.013711+0000","last_peered":"2023-12-19T09:57:25.013711+0000","last_clean":"2023-12-19T09:57:25.013711+0000","last_became_active":"2023-12-19T09:41:46.841291+0000","last_became_peered":"2023-12-19T09:41:46.841291+0000","last_unstale":"2023-12-19T09:57:25.013711+0000","last_undegraded":"2023-12-19T09:57:25.013711+0000","last_fullsized":"2023-12-19T09:57:25.013711+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.623152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.623152+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.623152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.760791+0000","last_change":"2023-12-19T09:41:44.833180+0000","last_active":"2023-12-19T09:57:25.760791+0000","last_peered":"2023-12-19T09:57:25.760791+0000","last_clean":"2023-12-19T09:57:25.760791+0000","last_became_active":"2023-12-19T09:41:44.829928+0000","last_became_peered":"2023-12-19T09:41:44.829928+0000","last_unstale":"2023-12-19T09:57:25.760791+0000","last_undegraded":"2023-12-19T09:57:25.760791+0000","last_fullsized":"2023-12-19T09:57:25.760791+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.053771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.053771+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.053771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1080,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.872243+0000","last_change":"2023-12-19T09:41:47.003324+0000","last_active":"2023-12-19T09:57:25.872243+0000","last_peered":"2023-12-19T09:57:25.872243+0000","last_clean":"2023-12-19T09:57:25.872243+0000","last_became_active":"2023-12-19T09:41:46.996512+0000","last_became_peered":"2023-12-19T09:41:46.996512+0000","last_unstale":"2023-12-19T09:57:25.872243+0000","last_undegraded":"2023-12-19T09:57:25.872243+0000","last_fullsized":"2023-12-19T09:57:25.872243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.057968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.057968+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.057968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.584112+0000","last_change":"2023-12-19T09:41:44.771796+0000","last_active":"2023-12-19T09:57:25.584112+0000","last_peered":"2023-12-19T09:57:25.584112+0000","last_clean":"2023-12-19T09:57:25.584112+0000","last_became_active":"2023-12-19T09:41:44.765249+0000","last_became_peered":"2023-12-19T09:41:44.765249+0000","last_unstale":"2023-12-19T09:57:25.584112+0000","last_undegraded":"2023-12-19T09:57:25.584112+0000","last_fullsized":"2023-12-19T09:57:25.584112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.050745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.050745+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.050745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1217,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.403441+0000","last_change":"2023-12-19T09:40:55.377872+0000","last_active":"2023-12-19T09:57:26.403441+0000","last_peered":"2023-12-19T09:57:26.403441+0000","last_clean":"2023-12-19T09:57:26.403441+0000","last_became_active":"2023-12-19T09:40:55.374430+0000","last_became_peered":"2023-12-19T09:40:55.374430+0000","last_unstale":"2023-12-19T09:57:26.403441+0000","last_undegraded":"2023-12-19T09:57:26.403441+0000","last_fullsized":"2023-12-19T09:57:26.403441+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.172882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.172882+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.172882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1209,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.766425+0000","last_change":"2023-12-19T09:41:49.534320+0000","last_active":"2023-12-19T09:57:25.766425+0000","last_peered":"2023-12-19T09:57:25.766425+0000","last_clean":"2023-12-19T09:57:25.766425+0000","last_became_active":"2023-12-19T09:41:49.152035+0000","last_became_peered":"2023-12-19T09:41:49.152035+0000","last_unstale":"2023-12-19T09:57:25.766425+0000","last_undegraded":"2023-12-19T09:57:25.766425+0000","last_fullsized":"2023-12-19T09:57:25.766425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.740624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.740624+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.740624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.886793+0000","last_change":"2023-12-19T09:41:44.539061+0000","last_active":"2023-12-19T09:57:25.886793+0000","last_peered":"2023-12-19T09:57:25.886793+0000","last_clean":"2023-12-19T09:57:25.886793+0000","last_became_active":"2023-12-19T09:41:44.523963+0000","last_became_peered":"2023-12-19T09:41:44.523963+0000","last_unstale":"2023-12-19T09:57:25.886793+0000","last_undegraded":"2023-12-19T09:57:25.886793+0000","last_fullsized":"2023-12-19T09:57:25.886793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.051213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.051213+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.051213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1203,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.432233+0000","last_change":"2023-12-19T09:40:55.373709+0000","last_active":"2023-12-19T09:57:24.432233+0000","last_peered":"2023-12-19T09:57:24.432233+0000","last_clean":"2023-12-19T09:57:24.432233+0000","last_became_active":"2023-12-19T09:40:55.370833+0000","last_became_peered":"2023-12-19T09:40:55.370833+0000","last_unstale":"2023-12-19T09:57:24.432233+0000","last_undegraded":"2023-12-19T09:57:24.432233+0000","last_fullsized":"2023-12-19T09:57:24.432233+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.615622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.615622+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.615622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1209,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.784754+0000","last_change":"2023-12-19T09:41:49.775064+0000","last_active":"2023-12-19T09:57:25.784754+0000","last_peered":"2023-12-19T09:57:25.784754+0000","last_clean":"2023-12-19T09:57:25.784754+0000","last_became_active":"2023-12-19T09:41:49.756848+0000","last_became_peered":"2023-12-19T09:41:49.756848+0000","last_unstale":"2023-12-19T09:57:25.784754+0000","last_undegraded":"2023-12-19T09:57:25.784754+0000","last_fullsized":"2023-12-19T09:57:25.784754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.739937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.739937+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.739937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.697845+0000","last_change":"2023-12-19T09:41:43.867265+0000","last_active":"2023-12-19T09:57:24.697845+0000","last_peered":"2023-12-19T09:57:24.697845+0000","last_clean":"2023-12-19T09:57:24.697845+0000","last_became_active":"2023-12-19T09:41:43.863691+0000","last_became_peered":"2023-12-19T09:41:43.863691+0000","last_unstale":"2023-12-19T09:57:24.697845+0000","last_undegraded":"2023-12-19T09:57:24.697845+0000","last_fullsized":"2023-12-19T09:57:24.697845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.616574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.616574+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.616574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1089,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.300243+0000","last_change":"2023-12-19T09:40:55.385057+0000","last_active":"2023-12-19T09:57:25.300243+0000","last_peered":"2023-12-19T09:57:25.300243+0000","last_clean":"2023-12-19T09:57:25.300243+0000","last_became_active":"2023-12-19T09:40:55.376880+0000","last_became_peered":"2023-12-19T09:40:55.376880+0000","last_unstale":"2023-12-19T09:57:25.300243+0000","last_undegraded":"2023-12-19T09:57:25.300243+0000","last_fullsized":"2023-12-19T09:57:25.300243+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.049259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.049259+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.049259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1208,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.769057+0000","last_change":"2023-12-19T09:41:51.637214+0000","last_active":"2023-12-19T09:57:25.769057+0000","last_peered":"2023-12-19T09:57:25.769057+0000","last_clean":"2023-12-19T09:57:25.769057+0000","last_became_active":"2023-12-19T09:41:51.634526+0000","last_became_peered":"2023-12-19T09:41:51.634526+0000","last_unstale":"2023-12-19T09:57:25.769057+0000","last_undegraded":"2023-12-19T09:57:25.769057+0000","last_fullsized":"2023-12-19T09:57:25.769057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.739720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.739720+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.739720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"25'7","reported_seq":1230,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.431585+0000","last_change":"2023-12-19T09:41:44.543364+0000","last_active":"2023-12-19T09:57:25.431585+0000","last_peered":"2023-12-19T09:57:25.431585+0000","last_clean":"2023-12-19T09:57:25.431585+0000","last_became_active":"2023-12-19T09:41:44.536492+0000","last_became_peered":"2023-12-19T09:41:44.536492+0000","last_unstale":"2023-12-19T09:57:25.431585+0000","last_undegraded":"2023-12-19T09:57:25.431585+0000","last_fullsized":"2023-12-19T09:57:25.431585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2023-12-19T09:57:22.736293+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2023-12-19T09:57:22.736293+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.736293+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1203,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.739918+0000","last_change":"2023-12-19T09:40:55.375889+0000","last_active":"2023-12-19T09:57:24.739918+0000","last_peered":"2023-12-19T09:57:24.739918+0000","last_clean":"2023-12-19T09:57:24.739918+0000","last_became_active":"2023-12-19T09:40:55.367503+0000","last_became_peered":"2023-12-19T09:40:55.367503+0000","last_unstale":"2023-12-19T09:57:24.739918+0000","last_undegraded":"2023-12-19T09:57:24.739918+0000","last_fullsized":"2023-12-19T09:57:24.739918+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.614575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.614575+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.614575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.14","version":"40'3","reported_seq":1210,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.468483+0000","last_change":"2023-12-19T09:41:48.888516+0000","last_active":"2023-12-19T09:57:26.468483+0000","last_peered":"2023-12-19T09:57:26.468483+0000","last_clean":"2023-12-19T09:57:26.468483+0000","last_became_active":"2023-12-19T09:41:48.880264+0000","last_became_peered":"2023-12-19T09:41:48.880264+0000","last_unstale":"2023-12-19T09:57:26.468483+0000","last_undegraded":"2023-12-19T09:57:26.468483+0000","last_fullsized":"2023-12-19T09:57:26.468483+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'3","last_scrub_stamp":"2023-12-19T09:57:23.179376+0000","last_deep_scrub":"40'3","last_deep_scrub_stamp":"2023-12-19T09:57:23.179376+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.179376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.750776+0000","last_change":"2023-12-19T09:41:44.092861+0000","last_active":"2023-12-19T09:57:26.750776+0000","last_peered":"2023-12-19T09:57:26.750776+0000","last_clean":"2023-12-19T09:57:26.750776+0000","last_became_active":"2023-12-19T09:41:44.067765+0000","last_became_peered":"2023-12-19T09:41:44.067765+0000","last_unstale":"2023-12-19T09:57:26.750776+0000","last_undegraded":"2023-12-19T09:57:26.750776+0000","last_fullsized":"2023-12-19T09:57:26.750776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.173918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.173918+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.173918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1223,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.732765+0000","last_change":"2023-12-19T09:40:55.369239+0000","last_active":"2023-12-19T09:57:25.732765+0000","last_peered":"2023-12-19T09:57:25.732765+0000","last_clean":"2023-12-19T09:57:25.732765+0000","last_became_active":"2023-12-19T09:40:55.366264+0000","last_became_peered":"2023-12-19T09:40:55.366264+0000","last_unstale":"2023-12-19T09:57:25.732765+0000","last_undegraded":"2023-12-19T09:57:25.732765+0000","last_fullsized":"2023-12-19T09:57:25.732765+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.735191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.735191+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.735191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1191,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.953364+0000","last_change":"2023-12-19T09:41:46.849208+0000","last_active":"2023-12-19T09:57:24.953364+0000","last_peered":"2023-12-19T09:57:24.953364+0000","last_clean":"2023-12-19T09:57:24.953364+0000","last_became_active":"2023-12-19T09:41:46.846639+0000","last_became_peered":"2023-12-19T09:41:46.846639+0000","last_unstale":"2023-12-19T09:57:24.953364+0000","last_undegraded":"2023-12-19T09:57:24.953364+0000","last_fullsized":"2023-12-19T09:57:24.953364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.623307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.623307+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.623307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.039835+0000","last_change":"2023-12-19T09:41:43.967652+0000","last_active":"2023-12-19T09:57:25.039835+0000","last_peered":"2023-12-19T09:57:25.039835+0000","last_clean":"2023-12-19T09:57:25.039835+0000","last_became_active":"2023-12-19T09:41:43.965003+0000","last_became_peered":"2023-12-19T09:41:43.965003+0000","last_unstale":"2023-12-19T09:57:25.039835+0000","last_undegraded":"2023-12-19T09:57:25.039835+0000","last_fullsized":"2023-12-19T09:57:25.039835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.616568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.616568+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.616568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1217,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.493144+0000","last_change":"2023-12-19T09:40:55.390358+0000","last_active":"2023-12-19T09:57:26.493144+0000","last_peered":"2023-12-19T09:57:26.493144+0000","last_clean":"2023-12-19T09:57:26.493144+0000","last_became_active":"2023-12-19T09:40:55.387550+0000","last_became_peered":"2023-12-19T09:40:55.387550+0000","last_unstale":"2023-12-19T09:57:26.493144+0000","last_undegraded":"2023-12-19T09:57:26.493144+0000","last_fullsized":"2023-12-19T09:57:26.493144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.172005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.172005+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.172005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1204,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.519915+0000","last_change":"2023-12-19T09:41:48.731885+0000","last_active":"2023-12-19T09:57:26.519915+0000","last_peered":"2023-12-19T09:57:26.519915+0000","last_clean":"2023-12-19T09:57:26.519915+0000","last_became_active":"2023-12-19T09:41:48.724265+0000","last_became_peered":"2023-12-19T09:41:48.724265+0000","last_unstale":"2023-12-19T09:57:26.519915+0000","last_undegraded":"2023-12-19T09:57:26.519915+0000","last_fullsized":"2023-12-19T09:57:26.519915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.178457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.178457+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.178457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.606446+0000","last_change":"2023-12-19T09:41:43.899191+0000","last_active":"2023-12-19T09:57:26.606446+0000","last_peered":"2023-12-19T09:57:26.606446+0000","last_clean":"2023-12-19T09:57:26.606446+0000","last_became_active":"2023-12-19T09:41:43.895270+0000","last_became_peered":"2023-12-19T09:41:43.895270+0000","last_unstale":"2023-12-19T09:57:26.606446+0000","last_undegraded":"2023-12-19T09:57:26.606446+0000","last_fullsized":"2023-12-19T09:57:26.606446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.174014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.174014+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.174014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1223,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.374740+0000","last_change":"2023-12-19T09:40:55.370124+0000","last_active":"2023-12-19T09:57:25.374740+0000","last_peered":"2023-12-19T09:57:25.374740+0000","last_clean":"2023-12-19T09:57:25.374740+0000","last_became_active":"2023-12-19T09:40:55.366632+0000","last_became_peered":"2023-12-19T09:40:55.366632+0000","last_unstale":"2023-12-19T09:57:25.374740+0000","last_undegraded":"2023-12-19T09:57:25.374740+0000","last_fullsized":"2023-12-19T09:57:25.374740+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.735182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.735182+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.735182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1209,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.946355+0000","last_change":"2023-12-19T09:41:48.960658+0000","last_active":"2023-12-19T09:57:25.946355+0000","last_peered":"2023-12-19T09:57:25.946355+0000","last_clean":"2023-12-19T09:57:25.946355+0000","last_became_active":"2023-12-19T09:41:48.957786+0000","last_became_peered":"2023-12-19T09:41:48.957786+0000","last_unstale":"2023-12-19T09:57:25.946355+0000","last_undegraded":"2023-12-19T09:57:25.946355+0000","last_fullsized":"2023-12-19T09:57:25.946355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.739455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.739455+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.739455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.441306+0000","last_change":"2023-12-19T09:41:44.646026+0000","last_active":"2023-12-19T09:57:25.441306+0000","last_peered":"2023-12-19T09:57:25.441306+0000","last_clean":"2023-12-19T09:57:25.441306+0000","last_became_active":"2023-12-19T09:41:44.640388+0000","last_became_peered":"2023-12-19T09:41:44.640388+0000","last_unstale":"2023-12-19T09:57:25.441306+0000","last_undegraded":"2023-12-19T09:57:25.441306+0000","last_fullsized":"2023-12-19T09:57:25.441306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.051230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.051230+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.051230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1217,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.224502+0000","last_change":"2023-12-19T09:40:55.377818+0000","last_active":"2023-12-19T09:57:26.224502+0000","last_peered":"2023-12-19T09:57:26.224502+0000","last_clean":"2023-12-19T09:57:26.224502+0000","last_became_active":"2023-12-19T09:40:55.374987+0000","last_became_peered":"2023-12-19T09:40:55.374987+0000","last_unstale":"2023-12-19T09:57:26.224502+0000","last_undegraded":"2023-12-19T09:57:26.224502+0000","last_fullsized":"2023-12-19T09:57:26.224502+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.172089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.172089+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.172089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":1220,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.558057+0000","last_change":"2023-12-19T09:40:53.332271+0000","last_active":"2023-12-19T09:57:25.558057+0000","last_peered":"2023-12-19T09:57:25.558057+0000","last_clean":"2023-12-19T09:57:25.558057+0000","last_became_active":"2023-12-19T09:40:53.328758+0000","last_became_peered":"2023-12-19T09:40:53.328758+0000","last_unstale":"2023-12-19T09:57:25.558057+0000","last_undegraded":"2023-12-19T09:57:25.558057+0000","last_fullsized":"2023-12-19T09:57:25.558057+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'97","last_scrub_stamp":"2023-12-19T09:57:24.049259+0000","last_deep_scrub":"11'97","last_deep_scrub_stamp":"2023-12-19T09:57:24.049259+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.049259+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"36'3","reported_seq":1212,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.703320+0000","last_change":"2023-12-19T09:41:49.052920+0000","last_active":"2023-12-19T09:57:25.703320+0000","last_peered":"2023-12-19T09:57:25.703320+0000","last_clean":"2023-12-19T09:57:25.703320+0000","last_became_active":"2023-12-19T09:41:49.049321+0000","last_became_peered":"2023-12-19T09:41:49.049321+0000","last_unstale":"2023-12-19T09:57:25.703320+0000","last_undegraded":"2023-12-19T09:57:25.703320+0000","last_fullsized":"2023-12-19T09:57:25.703320+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2023-12-19T09:57:22.740291+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2023-12-19T09:57:22.740291+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.740291+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.784233+0000","last_change":"2023-12-19T09:41:44.628513+0000","last_active":"2023-12-19T09:57:24.784233+0000","last_peered":"2023-12-19T09:57:24.784233+0000","last_clean":"2023-12-19T09:57:24.784233+0000","last_became_active":"2023-12-19T09:41:44.625833+0000","last_became_peered":"2023-12-19T09:41:44.625833+0000","last_unstale":"2023-12-19T09:57:24.784233+0000","last_undegraded":"2023-12-19T09:57:24.784233+0000","last_fullsized":"2023-12-19T09:57:24.784233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.618883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.618883+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.618883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1208,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.564907+0000","last_change":"2023-12-19T09:41:49.909088+0000","last_active":"2023-12-19T09:57:25.564907+0000","last_peered":"2023-12-19T09:57:25.564907+0000","last_clean":"2023-12-19T09:57:25.564907+0000","last_became_active":"2023-12-19T09:41:49.906227+0000","last_became_peered":"2023-12-19T09:41:49.906227+0000","last_unstale":"2023-12-19T09:57:25.564907+0000","last_undegraded":"2023-12-19T09:57:25.564907+0000","last_fullsized":"2023-12-19T09:57:25.564907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.740508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.740508+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.740508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.080561+0000","last_change":"2023-12-19T09:41:43.791102+0000","last_active":"2023-12-19T09:57:25.080561+0000","last_peered":"2023-12-19T09:57:25.080561+0000","last_clean":"2023-12-19T09:57:25.080561+0000","last_became_active":"2023-12-19T09:41:43.788014+0000","last_became_peered":"2023-12-19T09:41:43.788014+0000","last_unstale":"2023-12-19T09:57:25.080561+0000","last_undegraded":"2023-12-19T09:57:25.080561+0000","last_fullsized":"2023-12-19T09:57:25.080561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.619327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.619327+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.619327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.18","version":"57'1","reported_seq":1081,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.333350+0000","last_change":"2023-12-19T09:41:47.850812+0000","last_active":"2023-12-19T09:57:25.333350+0000","last_peered":"2023-12-19T09:57:25.333350+0000","last_clean":"2023-12-19T09:57:25.333350+0000","last_became_active":"2023-12-19T09:41:47.839786+0000","last_became_peered":"2023-12-19T09:41:47.839786+0000","last_unstale":"2023-12-19T09:57:25.333350+0000","last_undegraded":"2023-12-19T09:57:25.333350+0000","last_fullsized":"2023-12-19T09:57:25.333350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"57'1","last_scrub_stamp":"2023-12-19T09:57:24.059927+0000","last_deep_scrub":"57'1","last_deep_scrub_stamp":"2023-12-19T09:57:24.059927+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.059927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.560954+0000","last_change":"2023-12-19T09:41:44.510414+0000","last_active":"2023-12-19T09:57:26.560954+0000","last_peered":"2023-12-19T09:57:26.560954+0000","last_clean":"2023-12-19T09:57:26.560954+0000","last_became_active":"2023-12-19T09:41:44.502218+0000","last_became_peered":"2023-12-19T09:41:44.502218+0000","last_unstale":"2023-12-19T09:57:26.560954+0000","last_undegraded":"2023-12-19T09:57:26.560954+0000","last_fullsized":"2023-12-19T09:57:26.560954+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.174848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.174848+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.174848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1203,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.643933+0000","last_change":"2023-12-19T09:41:50.117367+0000","last_active":"2023-12-19T09:57:26.643933+0000","last_peered":"2023-12-19T09:57:26.643933+0000","last_clean":"2023-12-19T09:57:26.643933+0000","last_became_active":"2023-12-19T09:41:50.100260+0000","last_became_peered":"2023-12-19T09:41:50.100260+0000","last_unstale":"2023-12-19T09:57:26.643933+0000","last_undegraded":"2023-12-19T09:57:26.643933+0000","last_fullsized":"2023-12-19T09:57:26.643933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.177933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.177933+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.177933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.820240+0000","last_change":"2023-12-19T09:41:44.694402+0000","last_active":"2023-12-19T09:57:25.820240+0000","last_peered":"2023-12-19T09:57:25.820240+0000","last_clean":"2023-12-19T09:57:25.820240+0000","last_became_active":"2023-12-19T09:41:44.689340+0000","last_became_peered":"2023-12-19T09:41:44.689340+0000","last_unstale":"2023-12-19T09:57:25.820240+0000","last_undegraded":"2023-12-19T09:57:25.820240+0000","last_fullsized":"2023-12-19T09:57:25.820240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.053102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.053102+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.053102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1a","version":"24'3","reported_seq":1085,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.519066+0000","last_change":"2023-12-19T09:41:47.760578+0000","last_active":"2023-12-19T09:57:25.519066+0000","last_peered":"2023-12-19T09:57:25.519066+0000","last_clean":"2023-12-19T09:57:25.519066+0000","last_became_active":"2023-12-19T09:41:47.751422+0000","last_became_peered":"2023-12-19T09:41:47.751422+0000","last_unstale":"2023-12-19T09:57:25.519066+0000","last_undegraded":"2023-12-19T09:57:25.519066+0000","last_fullsized":"2023-12-19T09:57:25.519066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2023-12-19T09:57:24.059878+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2023-12-19T09:57:24.059878+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.059878+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.769508+0000","last_change":"2023-12-19T09:41:44.652693+0000","last_active":"2023-12-19T09:57:26.769508+0000","last_peered":"2023-12-19T09:57:26.769508+0000","last_clean":"2023-12-19T09:57:26.769508+0000","last_became_active":"2023-12-19T09:41:44.641823+0000","last_became_peered":"2023-12-19T09:41:44.641823+0000","last_unstale":"2023-12-19T09:57:26.769508+0000","last_undegraded":"2023-12-19T09:57:26.769508+0000","last_fullsized":"2023-12-19T09:57:26.769508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.174095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.174095+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.174095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1079,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.756420+0000","last_change":"2023-12-19T09:41:47.918436+0000","last_active":"2023-12-19T09:57:25.756420+0000","last_peered":"2023-12-19T09:57:25.756420+0000","last_clean":"2023-12-19T09:57:25.756420+0000","last_became_active":"2023-12-19T09:41:47.915328+0000","last_became_peered":"2023-12-19T09:41:47.915328+0000","last_unstale":"2023-12-19T09:57:25.756420+0000","last_undegraded":"2023-12-19T09:57:25.756420+0000","last_fullsized":"2023-12-19T09:57:25.756420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.060806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.060806+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.060806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.370917+0000","last_change":"2023-12-19T09:41:44.622479+0000","last_active":"2023-12-19T09:57:24.370917+0000","last_peered":"2023-12-19T09:57:24.370917+0000","last_clean":"2023-12-19T09:57:24.370917+0000","last_became_active":"2023-12-19T09:41:44.611913+0000","last_became_peered":"2023-12-19T09:41:44.611913+0000","last_unstale":"2023-12-19T09:57:24.370917+0000","last_undegraded":"2023-12-19T09:57:24.370917+0000","last_fullsized":"2023-12-19T09:57:24.370917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.617316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.617316+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.617316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1203,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.635749+0000","last_change":"2023-12-19T09:41:48.997784+0000","last_active":"2023-12-19T09:57:26.635749+0000","last_peered":"2023-12-19T09:57:26.635749+0000","last_clean":"2023-12-19T09:57:26.635749+0000","last_became_active":"2023-12-19T09:41:48.992519+0000","last_became_peered":"2023-12-19T09:41:48.992519+0000","last_unstale":"2023-12-19T09:57:26.635749+0000","last_undegraded":"2023-12-19T09:57:26.635749+0000","last_fullsized":"2023-12-19T09:57:26.635749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.180137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.180137+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.180137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.767082+0000","last_change":"2023-12-19T09:41:44.528794+0000","last_active":"2023-12-19T09:57:25.767082+0000","last_peered":"2023-12-19T09:57:25.767082+0000","last_clean":"2023-12-19T09:57:25.767082+0000","last_became_active":"2023-12-19T09:41:44.520591+0000","last_became_peered":"2023-12-19T09:41:44.520591+0000","last_unstale":"2023-12-19T09:57:25.767082+0000","last_undegraded":"2023-12-19T09:57:25.767082+0000","last_fullsized":"2023-12-19T09:57:25.767082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.052932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.052932+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.052932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"45'3","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.940412+0000","last_change":"2023-12-19T09:41:47.021642+0000","last_active":"2023-12-19T09:57:24.940412+0000","last_peered":"2023-12-19T09:57:24.940412+0000","last_clean":"2023-12-19T09:57:24.940412+0000","last_became_active":"2023-12-19T09:41:47.010899+0000","last_became_peered":"2023-12-19T09:41:47.010899+0000","last_unstale":"2023-12-19T09:57:24.940412+0000","last_undegraded":"2023-12-19T09:57:24.940412+0000","last_fullsized":"2023-12-19T09:57:24.940412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'3","last_scrub_stamp":"2023-12-19T09:57:23.624053+0000","last_deep_scrub":"45'3","last_deep_scrub_stamp":"2023-12-19T09:57:23.624053+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.624053+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1083,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.308157+0000","last_change":"2023-12-19T09:41:44.704700+0000","last_active":"2023-12-19T09:57:25.308157+0000","last_peered":"2023-12-19T09:57:25.308157+0000","last_clean":"2023-12-19T09:57:25.308157+0000","last_became_active":"2023-12-19T09:41:44.689193+0000","last_became_peered":"2023-12-19T09:41:44.689193+0000","last_unstale":"2023-12-19T09:57:25.308157+0000","last_undegraded":"2023-12-19T09:57:25.308157+0000","last_fullsized":"2023-12-19T09:57:25.308157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.052575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.052575+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.052575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1203,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.804469+0000","last_change":"2023-12-19T09:41:50.654472+0000","last_active":"2023-12-19T09:57:26.804469+0000","last_peered":"2023-12-19T09:57:26.804469+0000","last_clean":"2023-12-19T09:57:26.804469+0000","last_became_active":"2023-12-19T09:41:50.645171+0000","last_became_peered":"2023-12-19T09:41:50.645171+0000","last_unstale":"2023-12-19T09:57:26.804469+0000","last_undegraded":"2023-12-19T09:57:26.804469+0000","last_fullsized":"2023-12-19T09:57:26.804469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.180750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.180750+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.180750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.655143+0000","last_change":"2023-12-19T09:41:44.648689+0000","last_active":"2023-12-19T09:57:26.655143+0000","last_peered":"2023-12-19T09:57:26.655143+0000","last_clean":"2023-12-19T09:57:26.655143+0000","last_became_active":"2023-12-19T09:41:44.635214+0000","last_became_peered":"2023-12-19T09:41:44.635214+0000","last_unstale":"2023-12-19T09:57:26.655143+0000","last_undegraded":"2023-12-19T09:57:26.655143+0000","last_fullsized":"2023-12-19T09:57:26.655143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.175737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.175737+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.175737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1","version":"32'3","reported_seq":1084,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.387299+0000","last_change":"2023-12-19T09:41:47.793198+0000","last_active":"2023-12-19T09:57:25.387299+0000","last_peered":"2023-12-19T09:57:25.387299+0000","last_clean":"2023-12-19T09:57:25.387299+0000","last_became_active":"2023-12-19T09:41:47.781592+0000","last_became_peered":"2023-12-19T09:41:47.781592+0000","last_unstale":"2023-12-19T09:57:25.387299+0000","last_undegraded":"2023-12-19T09:57:25.387299+0000","last_fullsized":"2023-12-19T09:57:25.387299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2023-12-19T09:57:24.057152+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2023-12-19T09:57:24.057152+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.057152+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1217,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.744004+0000","last_change":"2023-12-19T09:41:43.991485+0000","last_active":"2023-12-19T09:57:25.744004+0000","last_peered":"2023-12-19T09:57:25.744004+0000","last_clean":"2023-12-19T09:57:25.744004+0000","last_became_active":"2023-12-19T09:41:43.985931+0000","last_became_peered":"2023-12-19T09:41:43.985931+0000","last_unstale":"2023-12-19T09:57:25.744004+0000","last_undegraded":"2023-12-19T09:57:25.744004+0000","last_fullsized":"2023-12-19T09:57:25.744004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:22.736267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:22.736267+0000","last_clean_scrub_stamp":"2023-12-19T09:57:22.736267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1192,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.910796+0000","last_change":"2023-12-19T09:41:46.831650+0000","last_active":"2023-12-19T09:57:24.910796+0000","last_peered":"2023-12-19T09:57:24.910796+0000","last_clean":"2023-12-19T09:57:24.910796+0000","last_became_active":"2023-12-19T09:41:46.825353+0000","last_became_peered":"2023-12-19T09:41:46.825353+0000","last_unstale":"2023-12-19T09:57:24.910796+0000","last_undegraded":"2023-12-19T09:57:24.910796+0000","last_fullsized":"2023-12-19T09:57:24.910796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.621857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.621857+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.621857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1197,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.889071+0000","last_change":"2023-12-19T09:41:44.065242+0000","last_active":"2023-12-19T09:57:24.889071+0000","last_peered":"2023-12-19T09:57:24.889071+0000","last_clean":"2023-12-19T09:57:24.889071+0000","last_became_active":"2023-12-19T09:41:44.062711+0000","last_became_peered":"2023-12-19T09:41:44.062711+0000","last_unstale":"2023-12-19T09:57:24.889071+0000","last_undegraded":"2023-12-19T09:57:24.889071+0000","last_fullsized":"2023-12-19T09:57:24.889071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.619863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.619863+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.619863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1191,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:24.914222+0000","last_change":"2023-12-19T09:41:46.880242+0000","last_active":"2023-12-19T09:57:24.914222+0000","last_peered":"2023-12-19T09:57:24.914222+0000","last_clean":"2023-12-19T09:57:24.914222+0000","last_became_active":"2023-12-19T09:41:46.877617+0000","last_became_peered":"2023-12-19T09:41:46.877617+0000","last_unstale":"2023-12-19T09:57:24.914222+0000","last_undegraded":"2023-12-19T09:57:24.914222+0000","last_fullsized":"2023-12-19T09:57:24.914222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.623090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.623090+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.623090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1211,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:26.592429+0000","last_change":"2023-12-19T09:41:44.513456+0000","last_active":"2023-12-19T09:57:26.592429+0000","last_peered":"2023-12-19T09:57:26.592429+0000","last_clean":"2023-12-19T09:57:26.592429+0000","last_became_active":"2023-12-19T09:41:44.493716+0000","last_became_peered":"2023-12-19T09:41:44.493716+0000","last_unstale":"2023-12-19T09:57:26.592429+0000","last_undegraded":"2023-12-19T09:57:26.592429+0000","last_fullsized":"2023-12-19T09:57:26.592429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:23.176677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:23.176677+0000","last_clean_scrub_stamp":"2023-12-19T09:57:23.176677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1081,"reported_epoch":694,"state":"active+clean","last_fresh":"2023-12-19T09:57:25.477171+0000","last_change":"2023-12-19T09:41:47.979679+0000","last_active":"2023-12-19T09:57:25.477171+0000","last_peered":"2023-12-19T09:57:25.477171+0000","last_clean":"2023-12-19T09:57:25.477171+0000","last_became_active":"2023-12-19T09:41:47.964957+0000","last_became_peered":"2023-12-19T09:41:47.964957+0000","last_unstale":"2023-12-19T09:57:25.477171+0000","last_undegraded":"2023-12-19T09:57:25.477171+0000","last_fullsized":"2023-12-19T09:57:25.477171+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T09:57:24.057913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T09:57:24.057913+0000","last_clean_scrub_stamp":"2023-12-19T09:57:24.057913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":1024,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706614,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":123640,"kb_used_data":7856,"kb_used_omap":0,"kb_used_meta":115776,"kb_avail":104733960,"statfs":{"total":107374182400,"available":107247575040,"internally_reserved":0,"allocated":8044544,"data_stored":5057755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":118554624},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":9,"seq":38654706616,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":60572,"kb_used_data":7252,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104797028,"statfs":{"total":107374182400,"available":107312156672,"internally_reserved":0,"allocated":7426048,"data_stored":4462803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654706610,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":114568,"kb_used_data":7104,"kb_used_omap":0,"kb_used_meta":107456,"kb_avail":104743032,"statfs":{"total":107374182400,"available":107256864768,"internally_reserved":0,"allocated":7274496,"data_stored":4465506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110034944},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654706609,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":61308,"kb_used_data":7988,"kb_used_omap":0,"kb_used_meta":53312,"kb_avail":104796292,"statfs":{"total":107374182400,"available":107311403008,"internally_reserved":0,"allocated":8179712,"data_stored":5047028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54591488},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} 2023-12-19T09:57:44.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T09:57:44.812 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.806+0000 7fdf2839e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:44.813 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.813+0000 7fdf2839e640 1 Processor -- start 2023-12-19T09:57:44.813 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.813+0000 7fdf2839e640 1 -- start start 2023-12-19T09:57:44.815 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.814+0000 7fdf2839e640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdf200a0fc0 0x7fdf20133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:44.815 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.814+0000 7fdf2839e640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2009deb0 con 0x7fdf200a0bb0 2023-12-19T09:57:44.815 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.814+0000 7fdf2839e640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2009d2b0 con 0x7fdf200a0fc0 2023-12-19T09:57:44.815 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.814+0000 7fdf25939640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdf200a0fc0 0x7fdf20133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:44.815 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.814+0000 7fdf2613a640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdf200a0bb0 0x7fdf20132f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:35070/0 (socket says 172.21.15.99:35070) 2023-12-19T09:57:44.815 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.814+0000 7fdf2613a640 1 -- 172.21.15.99:0/277154186 learned_addr learned my addr 172.21.15.99:0/277154186 (peer_addr_for_me v1:172.21.15.99:0/0) 2023-12-19T09:57:44.815 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.815+0000 7fdf25939640 1 -- 172.21.15.99:0/277154186 >> v1:172.21.15.99:6789/0 conn(0x7fdf200a0bb0 legacy=0x7fdf20132f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.815+0000 7fdf25939640 1 -- 172.21.15.99:0/277154186 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf201302d0 con 0x7fdf200a0fc0 2023-12-19T09:57:44.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.815+0000 7fdf25138640 1 -- 172.21.15.99:0/277154186 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845212292 0 0) 0x7fdf2009deb0 con 0x7fdf200a0bb0 2023-12-19T09:57:44.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.815+0000 7fdf25939640 1 --2- 172.21.15.99:0/277154186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0fc0 0x7fdf20133620 crc :-1 s=READY pgs=12695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1067ccc7dbf7b63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:44.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.815+0000 7fdf25138640 1 -- 172.21.15.99:0/277154186 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdf10009ce0 con 0x7fdf200a0fc0 2023-12-19T09:57:44.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.815+0000 7fdf25138640 1 -- 172.21.15.99:0/277154186 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fdf10009e40 con 0x7fdf200a0fc0 2023-12-19T09:57:44.816 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.815+0000 7fdf25138640 1 -- 172.21.15.99:0/277154186 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdf1000e360 con 0x7fdf200a0fc0 2023-12-19T09:57:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 1 -- 172.21.15.99:0/277154186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0fc0 msgr2=0x7fdf20133620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 1 --2- 172.21.15.99:0/277154186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0fc0 0x7fdf20133620 crc :-1 s=READY pgs=12695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 1 -- 172.21.15.99:0/277154186 shutdown_connections 2023-12-19T09:57:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 1 --2- 172.21.15.99:0/277154186 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0fc0 0x7fdf20133620 unknown :-1 s=CLOSED pgs=12695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 1 -- 172.21.15.99:0/277154186 >> 172.21.15.99:0/277154186 conn(0x7fdf2006c9a0 msgr2=0x7fdf2006cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 1 -- 172.21.15.99:0/277154186 shutdown_connections 2023-12-19T09:57:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 1 -- 172.21.15.99:0/277154186 wait complete. 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.816+0000 7fdf2839e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.817+0000 7fdf2839e640 1 Processor -- start 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.817+0000 7fdf2839e640 1 -- start start 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2839e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0bb0 0x7fdf2011e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2839e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201205a0 con 0x7fdf200a0bb0 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2613a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0bb0 0x7fdf2011e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2613a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0bb0 0x7fdf2011e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53290/0 (socket says 172.21.15.99:53290) 2023-12-19T09:57:44.820 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2613a640 1 -- 172.21.15.99:0/3122825521 learned_addr learned my addr 172.21.15.99:0/3122825521 (peer_addr_for_me v2:172.21.15.99:0/0) 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2613a640 1 -- 172.21.15.99:0/3122825521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf201229b0 con 0x7fdf200a0bb0 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2613a640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0bb0 0x7fdf2011e940 crc :-1 s=READY pgs=12696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdf1c004af0 con 0x7fdf200a0bb0 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x7fdf1c004c50 con 0x7fdf200a0bb0 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf20121d10 con 0x7fdf200a0bb0 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (crc 0 0 0) 0x7fdf1c007120 con 0x7fdf200a0bb0 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.818+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf20120e10 con 0x7fdf200a0bb0 2023-12-19T09:57:44.821 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.819+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 44857+0+0 (crc 0 0 0) 0x7fdf1c0072d0 con 0x7fdf200a0bb0 2023-12-19T09:57:44.822 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.819+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf20062350 con 0x7fdf200a0bb0 2023-12-19T09:57:44.822 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.819+0000 7fdf16ffd640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fdf04037810 0x7fdf04039d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T09:57:44.822 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.819+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(694..694 src has 1..694) v4 ==== 3741+0+0 (crc 0 0 0) 0x7fdf1c0471c0 con 0x7fdf200a0bb0 2023-12-19T09:57:44.822 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.820+0000 7fdf25939640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fdf04037810 0x7fdf04039d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T09:57:44.822 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.820+0000 7fdf25939640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fdf04037810 0x7fdf04039d20 crc :-1 s=READY pgs=3656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T09:57:44.823 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.824+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179842 (crc 0 0 0) 0x7fdf1c00a940 con 0x7fdf200a0bb0 2023-12-19T09:57:44.991 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.991+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fdf20066f90 con 0x7fdf200a0bb0 2023-12-19T09:57:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.994+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (crc 0 0 0) 0x7fdf1c00a530 con 0x7fdf200a0bb0 2023-12-19T09:57:44.994 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.995+0000 7fdf16ffd640 1 -- 172.21.15.99:0/3122825521 <== mon.0 v2:172.21.15.99:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (crc 0 0 0) 0x7fdf1c00a940 con 0x7fdf200a0bb0 2023-12-19T09:57:44.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fdf04037810 msgr2=0x7fdf04039d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.996 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fdf04037810 0x7fdf04039d20 crc :-1 s=READY pgs=3656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0bb0 msgr2=0x7fdf2011e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0bb0 0x7fdf2011e940 crc :-1 s=READY pgs=12696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 shutdown_connections 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.178:6800/1252704696,v1:172.21.15.178:6801/1252704696] conn(0x7fdf04037810 0x7fdf04039d20 unknown :-1 s=CLOSED pgs=3656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 --2- 172.21.15.99:0/3122825521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf200a0bb0 0x7fdf2011e940 unknown :-1 s=CLOSED pgs=12696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 >> 172.21.15.99:0/3122825521 conn(0x7fdf2006c9a0 msgr2=0x7fdf20132f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 shutdown_connections 2023-12-19T09:57:44.997 INFO:teuthology.orchestra.run.smithi099.stderr:2023-12-19T09:57:44.996+0000 7fdf2839e640 1 -- 172.21.15.99:0/3122825521 wait complete. 2023-12-19T09:57:45.007 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T09:57:45.007 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T09:57:45.007 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T09:57:45.007 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T09:57:45.103 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T09:57:45.103 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T09:57:45.103 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T09:57:50.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-19T09:57:51.205 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T09:57:51.205 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T09:57:51.205 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T09:57:51.306 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T09:57:51.306 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T09:57:51.306 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T09:57:55.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-19T09:57:55.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-19T09:57:57.408 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T09:57:57.408 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T09:57:57.408 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T09:57:57.408 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T09:57:57.441 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T09:57:57.441 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T09:57:57.442 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T09:57:57.442 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T09:57:57.460 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T09:57:57.461 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T09:57:57.461 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2023-12-19T09:57:57.690 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-19T09:57:57.690 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T09:57:57.842 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2023-12-19T09:57:57.842 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T09:57:57.930 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi178.front.sepia.ceph.com 2023-12-19T09:57:57.931 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T09:57:58.043 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi178.front.sepia.ceph.com 2023-12-19T09:57:58.043 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T09:57:58.114 INFO:tasks.ceph:Archiving mon data... 2023-12-19T09:57:58.116 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/data/mon.a.tgz 2023-12-19T09:57:58.116 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-12-19T09:57:58.136 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.vb6oj44SGs 2023-12-19T09:57:58.136 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vb6oj44SGs 2023-12-19T09:57:58.325 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.vb6oj44SGs 2023-12-19T09:57:58.413 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.vb6oj44SGs is 449KB 2023-12-19T09:57:58.491 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.vb6oj44SGs 2023-12-19T09:57:58.506 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T09:57:58.507 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T09:57:58.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T09:57:58.627 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-19T09:57:58.644 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-19T09:57:58.644 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T09:57:58.646 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/remote/smithi099/crash 2023-12-19T09:57:58.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T09:57:58.694 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/remote/smithi178/crash 2023-12-19T09:57:58.695 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T09:57:58.742 INFO:tasks.ceph:Compressing logs... 2023-12-19T09:57:58.742 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-19T09:57:58.745 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-19T09:57:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149769.log 2023-12-19T09:57:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-19T09:57:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84823.log 2023-12-19T09:57:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149769.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148787.log 2023-12-19T09:57:58.776 INFO:teuthology.orchestra.run.smithi099.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.149769.log.gz 2023-12-19T09:57:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85100.log 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84692.log 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84875.log 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.148787.log.gz 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83517.log 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.85100.log.gz 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148950.log 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.84823.log.gz 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84692.log.gz 2023-12-19T09:57:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84494.log 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.83517.log.gz 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149895.log 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82285.log 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149517.log 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.148950.log.gz 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.149895.log.gz 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.82285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148786.log 2023-12-19T09:57:58.778 INFO:teuthology.orchestra.run.smithi099.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.82285.log.gz 2023-12-19T09:57:58.779 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148085.log 2023-12-19T09:57:58.782 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149517.log: /var/log/ceph/ceph-client.admin.148786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149979.log 2023-12-19T09:57:58.782 INFO:teuthology.orchestra.run.smithi099.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.149517.log.gz 2023-12-19T09:57:58.782 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84930.log 2023-12-19T09:57:58.782 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149979.log: 91.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85099.log 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84494.log.gz 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148786.log.gz 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.149979.log.gz 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84411.log 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148085.log.gz 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149643.log 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84411.log: gzip -5 91.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.84875.log.gz /var/log/ceph/ceph-client.admin.83475.log 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:57:58.783 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84271.log 2023-12-19T09:57:58.784 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85099.log.gz 2023-12-19T09:57:58.784 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84411.log.gz 2023-12-19T09:57:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82469.log 2023-12-19T09:57:58.784 INFO:teuthology.orchestra.run.smithi099.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.149643.log.gz 2023-12-19T09:57:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83475.log: /var/log/ceph/ceph-client.admin.84271.log: 85.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.83475.log.gz 2023-12-19T09:57:58.784 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.148953.log 2023-12-19T09:57:58.784 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.82469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85000.log 2023-12-19T09:57:58.785 INFO:teuthology.orchestra.run.smithi099.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.82469.log.gz 2023-12-19T09:57:58.785 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148137.log 2023-12-19T09:57:58.785 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85000.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-19T09:57:58.821 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82560.log 2023-12-19T09:57:58.821 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82440.log 2023-12-19T09:57:58.821 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-19T09:57:58.821 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.82560.log: /var/log/ceph/ceph-client.admin.82440.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-19T09:57:58.821 INFO:teuthology.orchestra.run.smithi178.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.82560.log.gz 2023-12-19T09:57:58.821 INFO:teuthology.orchestra.run.smithi178.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.82440.log.gz 2023-12-19T09:57:58.822 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-19T09:57:58.822 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82520.log 2023-12-19T09:57:58.822 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82480.log 2023-12-19T09:57:58.822 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.82520.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.82520.log.gz 2023-12-19T09:57:58.822 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.82480.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.82480.log.gz 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148137.log: gzip -5 --verbose -- 89.3% -- replaced with /var/log/ceph/ceph-client.admin.148953.log.gz 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.83937.log 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.148137.log.gz 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83285.log 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83937.log: gzip 91.7% -- replaced with /var/log/ceph/ceph-client.admin.85000.log.gz 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.84427.log 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83937.log.gz 2023-12-19T09:57:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149559.log 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.83285.log.gz 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84422.log 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85094.log 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84427.log.gz 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84422.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.149559.log.gz 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85073.log 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83784.log 2023-12-19T09:57:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85094.log: /var/log/ceph/ceph-client.admin.85073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149853.log 86.2% -- replaced with /var/log/ceph/ceph-client.admin.85094.log.gz 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.85073.log.gz 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149320.log 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83784.log.gz 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83979.log 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.149853.log.gz 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148225.log 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84695.log 2023-12-19T09:57:58.828 INFO:teuthology.orchestra.run.smithi099.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.149320.log.gz 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr: 86.2%/var/log/ceph/ceph-client.admin.148225.log: -- replaced with /var/log/ceph/ceph-client.admin.83979.log.gz 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.84271.log.gz 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148951.log 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84695.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148225.log.gz 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83433.log/var/log/ceph/ceph-osd.1.log: 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148951.log: gzip -5 --verbose -- 92.6% -- replaced with /var/log/ceph/ceph-client.admin.84930.log.gz 2023-12-19T09:57:58.829 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.148138.log 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85151.log 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84695.log.gz 86.1% -- replaced with /var/log/ceph/ceph-client.admin.83433.log.gz 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148951.log.gz 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85154.log 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82441.log 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.148138.log.gz 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148087.log 2023-12-19T09:57:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.82441.log: 86.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84807.log 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85154.log.gz 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.85151.log.gz 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.82441.log.gz 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149319.log 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84401.log 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149319.log: gzip -5 --verbose 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148087.log.gz 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.84285.log 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84807.log.gz 2023-12-19T09:57:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84326.log 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149319.log.gz 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85093.log 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83785.log 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149475.log 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83785.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.84326.log.gz 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.83785.log.gz 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.85093.log.gz 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.79885.log 2023-12-19T09:57:58.832 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83391.log 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.149475.log.gz 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.tmp-client.admin.79885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149811.log 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.79885.log.gz 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.83391.log: -- /var/log/ceph/ceph-client.admin.83349.log 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149811.log: 85.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.83391.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.149937.log 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.149811.log.gz 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148226.log 2023-12-19T09:57:58.833 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83349.log: /var/log/ceph/ceph-client.admin.149937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84719.log 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83349.log.gz 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148226.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.149937.log.gz 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84380.log 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.148226.log.gz 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.84719.log: -- /var/log/ceph/ceph-client.admin.148086.log 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84551.log 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.84719.log.gz 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149685.log 2023-12-19T09:57:58.834 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84551.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.148086.log.gz 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82206.log 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149685.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.84551.log.gz 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.149685.log.gz 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84313.log 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.82206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83787.log 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.82206.log.gz 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85060.log 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83787.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.83787.log.gz 2023-12-19T09:57:58.835 INFO:teuthology.orchestra.run.smithi099.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.84313.log.gz 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149321.log 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85060.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149321.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149321.log.gz 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.85060.log.gz 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83616.log 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148136.log 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.83616.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83616.log.gz 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148952.log 2023-12-19T09:57:58.836 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148136.log: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.84401.log.gz 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148136.log.gz 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.84380.log.gz 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.84907.log 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148952.log: gzip -5 --verbose 93.2% -- /var/log/ceph/ceph.log 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.84285.log.gz 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149727.log 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.148952.log.gz 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84701.log 2023-12-19T09:57:58.837 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83619.log 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149727.log: /var/log/ceph/ceph-client.admin.84701.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.149727.log.gz 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.84907.log.gz 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83895.log 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148949.log 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83895.log: /var/log/ceph/ceph-client.admin.83619.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.84701.log.gz 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr: 86.8% 85.7% -- replaced with /var/log/ceph/ceph-client.admin.83895.log.gz 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83619.log.gz 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85084.log 2023-12-19T09:57:58.838 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84705.log 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83786.log 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr: 68.0% -- replaced with /var/log/ceph/ceph-client.admin.85084.log.gz 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr: 87.1% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.148949.log.gz 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83618.log 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83786.log: gzip -5 --verbose -- 88.7% -- replaced with /var/log/ceph/ceph-client.admin.84705.log.gz 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.149601.log 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr: 86.3%/var/log/ceph/ceph-client.admin.83618.log: -- replaced with /var/log/ceph/ceph-client.admin.83786.log.gz 2023-12-19T09:57:58.839 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83617.log 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83618.log.gz 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.149601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150061.log 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.149601.log.gz 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84337.log 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83617.log.gz 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.150061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148788.log 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.150061.log.gz 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150021.log 2023-12-19T09:57:58.840 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.148788.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.84337.log.gz 2023-12-19T09:57:58.841 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.150021.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.150021.log.gz 2023-12-19T09:57:58.841 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148788.log.gz 2023-12-19T09:57:59.012 INFO:teuthology.orchestra.run.smithi178.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-19T09:57:59.198 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.84422.log.gz 2023-12-19T09:58:00.306 INFO:teuthology.orchestra.run.smithi099.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-19T09:58:00.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-19T09:58:21.841 INFO:teuthology.orchestra.run.smithi178.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-19T09:58:22.234 INFO:teuthology.orchestra.run.smithi178.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-19T09:58:22.236 INFO:teuthology.orchestra.run.smithi178.stderr: 2023-12-19T09:58:22.236 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m23.436s 2023-12-19T09:58:22.236 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m44.768s 2023-12-19T09:58:22.236 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m1.813s 2023-12-19T09:58:22.308 INFO:teuthology.orchestra.run.smithi099.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-19T09:58:23.148 INFO:teuthology.orchestra.run.smithi099.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-19T09:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr: 2023-12-19T09:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m24.394s 2023-12-19T09:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m47.877s 2023-12-19T09:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m2.049s 2023-12-19T09:58:23.150 INFO:tasks.ceph:Archiving logs... 2023-12-19T09:58:23.151 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/remote/smithi099/log 2023-12-19T09:58:23.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T09:58:31.052 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/remote/smithi178/log 2023-12-19T09:58:31.053 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T09:58:38.218 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T09:58:38.228 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T09:58:38.228 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T09:58:38.231 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T09:58:38.333 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T09:58:38.341 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T09:58:38.342 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T09:58:38.345 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T09:58:38.359 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2023-12-19T09:58:38.362 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2023-12-19T09:58:38.364 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T09:58:38.364 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2023-12-19T09:58:38.365 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 29 +776us[ +776us] +/- 78ms 2023-12-19T09:58:38.365 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -466us[ -473us] +/- 61ms 2023-12-19T09:58:38.365 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 -154us[ -154us] +/- 75ms 2023-12-19T09:58:38.365 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:58:38.367 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T09:58:38.367 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2023-12-19T09:58:38.367 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 +758us[ +760us] +/- 78ms 2023-12-19T09:58:38.367 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv02.front.sepia.ceph.com 3 6 377 31 -477us[ -475us] +/- 61ms 2023-12-19T09:58:38.367 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 -171us[ -169us] +/- 75ms 2023-12-19T09:58:38.367 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T09:58:38.368 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T09:58:38.376 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T09:58:38.377 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T09:58:38.385 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T09:58:38.501 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-19T09:58:38.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T09:58:38.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:58:38.631 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T09:58:38.664 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:58:38.664 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T09:58:38.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T09:58:38.683 INFO:teuthology.task.internal:Duration was 1680.557139 seconds 2023-12-19T09:58:38.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T09:58:38.692 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T09:58:38.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T09:58:38.694 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T09:58:38.735 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T09:58:38.748 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T09:58:39.127 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T09:58:39.128 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2023-12-19T09:58:39.128 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T09:58:39.187 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2023-12-19T09:58:39.187 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T09:58:39.219 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T09:58:39.219 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T09:58:39.230 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T09:58:39.287 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T09:58:39.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T09:58:39.298 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T09:58:39.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T09:58:39.432 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T09:58:39.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T09:58:39.459 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T09:58:39.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T09:58:39.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T09:58:39.502 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T09:58:39.525 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2023-12-19T09:58:39.552 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2023-12-19T09:58:39.589 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T09:58:39.618 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi099.front.sepia.ceph.com, flagging run as failed 2023-12-19T09:58:39.619 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T09:58:39.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:58:39.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T09:58:39.653 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T09:58:39.654 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/remote/smithi099 2023-12-19T09:58:39.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T09:58:45.723 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-12-19T09:58:45.733 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697/remote/smithi099/coredump/1702978948.84807.core.gz: gzip compressed data, was "1702978948.84807.core", last modified: Tue Dec 19 09:58:40 2023, max compression, original size modulo 2^32 184233984 2023-12-19T09:58:45.733 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-12-19T09:58:46.493 INFO:teuthology.task.internal: core looks like: /tmp/tmpc3yzudc6: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/ar', real uid: 1000, effective uid: 1000, real gid: 1301, effective gid: 1301, execfn: '/usr/bin/ceph_test_rados_api_watch_notify_pp', platform: 'x86_64' 2023-12-19T09:58:46.518 INFO:teuthology.task.internal: dump_program: ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/ar 2023-12-19T09:58:46.519 DEBUG:teuthology.orchestra.run.smithi099:> which 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/ar' 2023-12-19T09:58:46.537 INFO:teuthology.orchestra.run.smithi099.stderr:/usr/bin/which: unrecognized option '--gtest_output=xml:/home/ubuntu/cephtest/ar' 2023-12-19T09:58:46.538 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph_test_rados_api_watch_notify_pp 2023-12-19T09:58:46.599 DEBUG:teuthology.orchestra.remote:smithi099:/usr/bin/ceph_test_rados_api_watch_notify_pp is 795KB 2023-12-19T09:58:46.677 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2023-12-19T09:58:46.694 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.2EaWmMaqI1 2023-12-19T09:58:46.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /usr/bin/ceph_test_rados_api_watch_notify_pp.debug /tmp/tmp.2EaWmMaqI1 2023-12-19T09:58:46.762 INFO:teuthology.orchestra.run.smithi099.stderr:cp: cannot stat '/usr/bin/ceph_test_rados_api_watch_notify_pp.debug': No such file or directory 2023-12-19T09:58:46.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:58:46.764 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 363, in fetch_binaries_for_coredumps remote.get_file(debug_path, coredump_path) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 622, in get_file self.run(args=args) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 1: 'sudo cp /usr/bin/ceph_test_rados_api_watch_notify_pp.debug /tmp/tmp.2EaWmMaqI1' 2023-12-19T09:58:46.775 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T09:58:46.785 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T09:58:46.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T09:58:46.807 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T09:58:46.808 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T09:58:46.832 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T09:58:46.838 INFO:teuthology.orchestra.run.smithi099.stdout: 262166 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest 2023-12-19T09:58:46.838 INFO:teuthology.orchestra.run.smithi099.stdout: 402661 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 19 09:40 /home/ubuntu/cephtest/mnt.0 2023-12-19T09:58:46.838 INFO:teuthology.orchestra.run.smithi099.stdout: 402662 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 19 09:41 /home/ubuntu/cephtest/mnt.0/client.0 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538238 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 09:41 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538253 60 -rw-r--r-- 1 ubuntu ubuntu 58706 Dec 19 09:41 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_tier_pp.log 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538255 8 -rw-r--r-- 1 ubuntu ubuntu 4461 Dec 19 09:41 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat_pp.log 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538246 8 -rw-r--r-- 1 ubuntu ubuntu 7547 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock.log 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538262 4 -rw-r--r-- 1 ubuntu ubuntu 1714 Dec 19 09:43 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_read_operations.log 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538264 8 -rw-r--r-- 1 ubuntu ubuntu 5612 Dec 19 09:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_list_parallel.log 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538245 8 -rw-r--r-- 1 ubuntu ubuntu 7722 Dec 19 09:57 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc_pp.log 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538239 12 -rw-r--r-- 1 ubuntu ubuntu 9345 Dec 19 09:49 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio.log 2023-12-19T09:58:46.839 INFO:teuthology.orchestra.run.smithi099.stdout: 538247 4 -rw-r--r-- 1 ubuntu ubuntu 3008 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_misc.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538265 4 -rw-r--r-- 1 ubuntu ubuntu 1169 Dec 19 09:41 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cls_remote_reads.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538258 4 -rw-r--r-- 1 ubuntu ubuntu 592 Dec 19 09:41 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd_pp.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538257 4 -rw-r--r-- 1 ubuntu ubuntu 2054 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_cmd.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538254 4 -rw-r--r-- 1 ubuntu ubuntu 3960 Dec 19 09:43 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538250 8 -rw-r--r-- 1 ubuntu ubuntu 7104 Dec 19 09:43 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538243 24 -rw-r--r-- 1 ubuntu ubuntu 24387 Dec 19 09:41 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_asio.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538252 8 -rw-r--r-- 1 ubuntu ubuntu 4306 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_stat.log 2023-12-19T09:58:46.840 INFO:teuthology.orchestra.run.smithi099.stdout: 538266 4 -rw-r--r-- 1 ubuntu ubuntu 1311 Dec 19 09:48 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_delete_pools_parallel.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538261 4 -rw-r--r-- 1 ubuntu ubuntu 2628 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service_pp.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538260 4 -rw-r--r-- 1 ubuntu ubuntu 1205 Dec 19 09:54 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_c_write_operations.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538259 4 -rw-r--r-- 1 ubuntu ubuntu 2526 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_service.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538240 16 -rw-r--r-- 1 ubuntu ubuntu 12665 Dec 19 09:56 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_aio_pp.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538242 16 -rw-r--r-- 1 ubuntu ubuntu 15465 Dec 19 09:43 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io_pp.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538263 4 -rw-r--r-- 1 ubuntu ubuntu 1040 Dec 19 09:47 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_open_pools_parallel.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538256 4 -rw-r--r-- 1 ubuntu ubuntu 3848 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_watch_notify_pp.log 2023-12-19T09:58:46.841 INFO:teuthology.orchestra.run.smithi099.stdout: 538248 8 -rw-r--r-- 1 ubuntu ubuntu 7799 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_lock_pp.log 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 538249 4 -rw-r--r-- 1 ubuntu ubuntu 1609 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_pool.log 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 538244 12 -rw-r--r-- 1 ubuntu ubuntu 9568 Dec 19 09:53 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_list.log 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 538251 12 -rw-r--r-- 1 ubuntu ubuntu 9821 Dec 19 09:43 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_snapshots_pp.log 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 538241 12 -rw-r--r-- 1 ubuntu ubuntu 9517 Dec 19 09:42 /home/ubuntu/cephtest/mnt.0/client.0/tmp/ceph_test_rados_api_io.log 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 262167 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest/archive 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 267118 8 -rw-r--r-- 1 ubuntu ubuntu 6905 Dec 19 09:41 /home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 267120 8 -rw-r--r-- 1 ubuntu ubuntu 6793 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 267126 4 -rw-r--r-- 1 ubuntu ubuntu 924 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2023-12-19T09:58:46.842 INFO:teuthology.orchestra.run.smithi099.stdout: 267110 4 -rw-r--r-- 1 ubuntu ubuntu 1130 Dec 19 09:41 /home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2023-12-19T09:58:46.843 INFO:teuthology.orchestra.run.smithi099.stdout: 267152 8 -rw-r--r-- 1 ubuntu ubuntu 6063 Dec 19 09:53 /home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2023-12-19T09:58:46.843 INFO:teuthology.orchestra.run.smithi099.stdout: 267117 4 -rw-r--r-- 1 ubuntu ubuntu 2113 Dec 19 09:41 /home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2023-12-19T09:58:46.843 INFO:teuthology.orchestra.run.smithi099.stdout: 267153 4 -rw-r--r-- 1 ubuntu ubuntu 1664 Dec 19 09:54 /home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2023-12-19T09:58:46.843 INFO:teuthology.orchestra.run.smithi099.stdout: 267132 4 -rw-r--r-- 1 ubuntu ubuntu 3439 Dec 19 09:43 /home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2023-12-19T09:58:46.844 INFO:teuthology.orchestra.run.smithi099.stdout: 267116 108 -rw-r--r-- 1 ubuntu ubuntu 108092 Dec 19 09:41 /home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2023-12-19T09:58:46.845 INFO:teuthology.orchestra.run.smithi099.stdout: 267122 4 -rw-r--r-- 1 ubuntu ubuntu 920 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2023-12-19T09:58:46.845 INFO:teuthology.orchestra.run.smithi099.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest/archive/syslog 2023-12-19T09:58:46.845 INFO:teuthology.orchestra.run.smithi099.stdout: 262223 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Dec 19 09:30 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-19T09:58:46.845 INFO:teuthology.orchestra.run.smithi099.stdout: 265245 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Dec 19 09:30 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-19T09:58:46.845 INFO:teuthology.orchestra.run.smithi099.stdout: 265244 100 -rw-r--r-- 1 ubuntu ubuntu 101911 Dec 19 09:58 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T09:58:46.845 INFO:teuthology.orchestra.run.smithi099.stdout: 267119 4 -rw-r--r-- 1 ubuntu ubuntu 754 Dec 19 09:41 /home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 267159 12 -rw-r--r-- 1 ubuntu ubuntu 10317 Dec 19 09:57 /home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 524289 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest/archive/audit 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 524291 232 -rw------- 1 ubuntu ubuntu 236057 Dec 19 09:58 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 267130 12 -rw-r--r-- 1 ubuntu ubuntu 10381 Dec 19 09:43 /home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 262168 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 09:42 /home/ubuntu/cephtest/archive/coredump 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 267127 72060 -rw------- 1 ubuntu ubuntu 184233984 Dec 19 09:42 /home/ubuntu/cephtest/archive/coredump/1702978948.84807.core 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 267125 16 -rw-r--r-- 1 ubuntu ubuntu 13091 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 267131 28 -rw-r--r-- 1 ubuntu ubuntu 27650 Dec 19 09:43 /home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2023-12-19T09:58:46.846 INFO:teuthology.orchestra.run.smithi099.stdout: 267143 20 -rw-r--r-- 1 ubuntu ubuntu 16503 Dec 19 09:49 /home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267154 24 -rw-r--r-- 1 ubuntu ubuntu 21781 Dec 19 09:56 /home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267133 16 -rw-r--r-- 1 ubuntu ubuntu 14632 Dec 19 09:43 /home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267123 4 -rw-r--r-- 1 ubuntu ubuntu 2299 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267137 4 -rw-r--r-- 1 ubuntu ubuntu 2703 Dec 19 09:43 /home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267129 4 -rw-r--r-- 1 ubuntu ubuntu 2558 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267121 16 -rw-r--r-- 1 ubuntu ubuntu 12896 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267124 4 -rw-r--r-- 1 ubuntu ubuntu 886 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2023-12-19T09:58:46.847 INFO:teuthology.orchestra.run.smithi099.stdout: 267128 20 -rw-r--r-- 1 ubuntu ubuntu 16533 Dec 19 09:42 /home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2023-12-19T09:58:46.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T09:58:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-19T09:58:46.851 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 363, in fetch_binaries_for_coredumps remote.get_file(debug_path, coredump_path) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 622, in get_file self.run(args=args) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 1: 'sudo cp /usr/bin/ceph_test_rados_api_watch_notify_pp.debug /tmp/tmp.2EaWmMaqI1' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-12-19T09:58:46.863 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T09:58:46.874 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T09:58:46.886 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi099 with status 1: 'sudo cp /usr/bin/ceph_test_rados_api_watch_notify_pp.debug /tmp/tmp.2EaWmMaqI1' 2023-12-19T09:58:46.887 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T09:58:46.891 INFO:teuthology.orchestra.run.smithi178.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest 2023-12-19T09:58:46.891 INFO:teuthology.orchestra.run.smithi178.stdout: 262167 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest/archive 2023-12-19T09:58:46.892 INFO:teuthology.orchestra.run.smithi178.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest/archive/syslog 2023-12-19T09:58:46.892 INFO:teuthology.orchestra.run.smithi178.stdout: 262223 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Dec 19 09:30 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-12-19T09:58:46.892 INFO:teuthology.orchestra.run.smithi178.stdout: 265245 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Dec 19 09:30 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-12-19T09:58:46.892 INFO:teuthology.orchestra.run.smithi178.stdout: 265244 100 -rw-r--r-- 1 ubuntu ubuntu 100139 Dec 19 09:58 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T09:58:46.892 INFO:teuthology.orchestra.run.smithi178.stdout: 402716 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 09:58 /home/ubuntu/cephtest/archive/audit 2023-12-19T09:58:46.892 INFO:teuthology.orchestra.run.smithi178.stdout: 402995 228 -rw------- 1 ubuntu ubuntu 230669 Dec 19 09:58 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-12-19T09:58:46.893 INFO:teuthology.orchestra.run.smithi178.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-19T09:58:46.916 DEBUG:teuthology.nuke:shortname: smithi099 2023-12-19T09:58:46.917 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T09:58:46.941 DEBUG:teuthology.nuke:shortname: smithi178 2023-12-19T09:58:46.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T09:58:46.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 09:21:10.081254', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLhy5buduEgAKA/hTqmvrHMnhhTc6k0NQ1Ff3TBwtq1DY9Vf3jtWxsMdVd88TYNMw9zVbXLYXBbmQ30J1qaCGw8='} 2023-12-19T09:58:46.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-12-19_09:17:50-crimson-rados-wip-matanb-crimson-testing-misc-distro-crimson-smithi/7496697', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 09:21:10.079904', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEzExhvom+tJHNN0eqDALyW6WRzh8m7vfqQlFVZhO7Bdsq9i1QbnrtbvG3ZP82mmGBOPbFruBr9HTuj7KQdcnFI='} 2023-12-19T09:58:46.999 INFO:teuthology.orchestra.console.smithi099:Power off 2023-12-19T09:58:46.999 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T09:58:47.024 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-12-19T09:58:47.024 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T09:58:47.041 INFO:teuthology.orchestra.console.smithi178:Power off 2023-12-19T09:58:47.041 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T09:58:47.050 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-19T09:58:47.067 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-12-19T09:58:47.067 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T09:58:47.090 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-12-19T09:58:51.051 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T09:58:51.091 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T09:58:51.162 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-19T09:58:51.201 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-12-19T09:58:55.165 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T09:58:55.202 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T09:58:55.276 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-12-19T09:58:55.404 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-12-19T09:58:55.504 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-12-19T09:58:59.405 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T09:58:59.516 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-12-19T09:58:59.617 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-12-19T09:58:59.723 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 1680.5571389198303 failure_reason: 'Command failed (workunit test rados/test.sh) on smithi099 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=729869e4a72e72e756b33d15b6f2fbf113fa1a2d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh''' flavor: crimson owner: scheduled_matan@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=ac175a4eea8745cd992444fca1c28732 status: fail success: false 2023-12-19T09:58:59.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T09:58:59.808 INFO:teuthology.run:FAIL