2024-04-23T01:29:35.180 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T01:29:35.180 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yingxin@teuthology --name yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi --archive /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446 --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} -- /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/orig.config.yaml 2024-04-23T01:29:35.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T01:29:35.306 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446 branch: ci-yingxin-crimson-fix-tri-mutex-4 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: yingxin.cheng@intel.com first_in_suite: false job_id: '7669446' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: ci-yingxin-crimson-fix-tri-mutex-4 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: crimson sha1: a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: ci-yingxin-crimson-fix-tri-mutex-4 env: CRIMSON_COMPAT: '1' sha1: a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 owner: scheduled_yingxin@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b sha1: a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: ci-yingxin-crimson-fix-tri-mutex-4 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSUQEpbD0ApnW8N2EXlroGNHoD0dWM8HvLpKpKcos98yQMcXP9EbwbYa+ql9najApjWBYFQ0D9eqqAfiP0z+ck= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIf4m5Di6CFs21haxdg9spYMEs9e5bMxXtlxNrdN/THWapEabvQECegR9AZLAK2Jo9ZyKq/8Vnn4nx7JZkVBUgY= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_01:23:55 tube: smithi user: yingxin verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T01:29:35.306 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/qa; will attempt to use it 2024-04-23T01:29:35.307 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/qa/tasks 2024-04-23T01:29:35.307 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T01:29:35.309 INFO:teuthology.task.internal:Checking packages... 2024-04-23T01:29:35.334 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4' 2024-04-23T01:29:35.334 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T01:29:35.334 INFO:teuthology.packaging:ref: None 2024-04-23T01:29:35.334 INFO:teuthology.packaging:tag: None 2024-04-23T01:29:35.334 INFO:teuthology.packaging:branch: ci-yingxin-crimson-fix-tri-mutex-4 2024-04-23T01:29:35.334 INFO:teuthology.packaging:sha1: a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 2024-04-23T01:29:35.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=ci-yingxin-crimson-fix-tri-mutex-4 2024-04-23T01:29:35.479 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3192.ga1f34943 2024-04-23T01:29:35.480 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T01:29:35.487 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T01:29:35.487 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T01:29:35.507 INFO:teuthology.task.internal:Saving configuration 2024-04-23T01:29:35.519 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T01:29:35.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T01:29:35.553 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 01:24:26.862137', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSUQEpbD0ApnW8N2EXlroGNHoD0dWM8HvLpKpKcos98yQMcXP9EbwbYa+ql9najApjWBYFQ0D9eqqAfiP0z+ck='} 2024-04-23T01:29:35.576 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 01:24:26.860386', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIf4m5Di6CFs21haxdg9spYMEs9e5bMxXtlxNrdN/THWapEabvQECegR9AZLAK2Jo9ZyKq/8Vnn4nx7JZkVBUgY='} 2024-04-23T01:29:35.576 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T01:29:35.583 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-04-23T01:29:35.583 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-23T01:29:35.583 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T01:29:35.664 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b42004e50>, signals=[15]) 2024-04-23T01:29:35.665 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T01:29:35.671 INFO:teuthology.task.internal:Opening connections... 2024-04-23T01:29:35.671 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-04-23T01:29:35.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T01:29:35.752 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-04-23T01:29:35.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T01:29:35.826 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T01:29:35.832 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-04-23T01:29:35.851 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-04-23T01:29:35.851 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-04-23T01:29:35.910 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-04-23T01:29:35.911 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T01:29:35.911 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-04-23T01:29:35.911 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T01:29:35.911 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T01:29:35.911 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T01:29:35.911 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-04-23T01:29:35.940 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-23T01:29:35.958 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-23T01:29:35.958 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-04-23T01:29:36.017 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-04-23T01:29:36.018 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T01:29:36.018 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-04-23T01:29:36.018 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T01:29:36.018 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T01:29:36.018 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T01:29:36.018 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-23T01:29:36.040 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T01:29:36.049 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T01:29:36.054 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T01:29:36.054 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-04-23T01:29:36.057 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-04-23T01:29:36.072 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T01:29:36.078 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T01:29:36.079 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-04-23T01:29:36.115 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-04-23T01:29:36.195 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T01:29:36.251 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T01:29:36.265 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-23T01:29:36.265 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-23T01:29:36.266 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T01:29:36.266 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T01:29:36.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:29:36.283 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2024-04-23T01:29:36.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:29:36.284 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-04-23T01:29:36.340 INFO:teuthology.orchestra.run.smithi191.stdout:5.14.0-437.el9.x86_64 2024-04-23T01:29:36.340 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.14.0-437.el9.x86_64 2024-04-23T01:29:36.340 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2024-04-23T01:29:36.342 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-437.el9.x86_64 2024-04-23T01:29:36.342 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-437.el9.x86_64 2024-04-23T01:29:36.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-04-23T01:29:44.059 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.0 MB 00:06 2024-04-23T01:29:45.679 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.0 MB 00:07 2024-04-23T01:29:59.903 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-04-23T01:30:06.355 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 994 kB/s | 19 MB 00:19 2024-04-23T01:30:10.938 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 863 kB/s | 6.2 MB 00:07 2024-04-23T01:30:12.351 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 16 kB 00:00 2024-04-23T01:30:13.964 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-23T01:30:14.856 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 6.2 MB 00:04 2024-04-23T01:30:16.303 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-23T01:30:19.153 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-23T01:30:19.629 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 21 MB 00:03 2024-04-23T01:30:21.110 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-23T01:30:21.110 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-23T01:30:21.193 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:30:21.194 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:30:21.194 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:30:21.317 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2024-04-23T01:30:21.838 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:02 ago on Tue 23 Apr 2024 01:30:19 AM UTC. 2024-04-23T01:30:21.961 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 255 k 2024-04-23T01:30:21.981 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-04-23T01:30:21.982 INFO:teuthology.orchestra.run.smithi037.stderr:Operation aborted. 2024-04-23T01:30:22.034 INFO:teuthology.orchestra.run.smithi037.stdout:Is this ok [y/N]: 2024-04-23T01:30:22.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2024-04-23T01:30:22.549 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 01:30:19 AM UTC. 2024-04-23T01:30:22.670 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:30:22.671 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 255 k 2024-04-23T01:30:22.672 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-04-23T01:30:22.672 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:30:23.188 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.0 MB/s | 255 kB 00:00 2024-04-23T01:30:23.217 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:30:23.217 INFO:teuthology.orchestra.run.smithi037.stdout:Total 493 kB/s | 255 kB 00:00 2024-04-23T01:30:23.217 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:30:23.396 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:30:23.396 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:30:23.401 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:30:23.402 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:30:23.556 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:30:23.631 INFO:teuthology.orchestra.run.smithi037.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T01:30:23.631 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T01:30:24.262 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T01:30:24.263 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T01:30:24.687 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-23T01:30:25.011 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T01:30:25.011 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:30:25.011 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalled: 2024-04-23T01:30:25.012 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-23T01:30:25.012 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:30:25.012 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:30:25.160 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-04-23T01:30:25.208 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-23T01:30:25.209 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-23T01:30:25.209 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-23T01:30:25.209 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-23T01:30:25.210 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T01:30:25.248 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2024-04-23T01:30:25.271 DEBUG:teuthology.parallel:result is None 2024-04-23T01:30:26.510 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-23T01:30:26.510 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-23T01:30:26.603 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:30:26.604 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:30:26.604 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:30:26.720 DEBUG:teuthology.orchestra.run.smithi191:> echo no | sudo yum reinstall kernel || true 2024-04-23T01:30:27.213 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 01:30:24 AM UTC. 2024-04-23T01:30:27.343 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:30:27.358 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:30:27.358 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-23T01:30:27.358 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:30:27.358 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2024-04-23T01:30:27.358 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T01:30:27.358 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:30:27.358 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:30:27.359 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:30:27.359 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:30:27.359 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 255 k 2024-04-23T01:30:27.359 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2024-04-23T01:30:27.359 INFO:teuthology.orchestra.run.smithi191.stderr:Operation aborted. 2024-04-23T01:30:27.412 INFO:teuthology.orchestra.run.smithi191.stdout:Is this ok [y/N]: 2024-04-23T01:30:27.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum reinstall -y kernel || true 2024-04-23T01:30:27.905 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 01:30:24 AM UTC. 2024-04-23T01:30:28.021 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:30:28.022 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:30:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-23T01:30:28.022 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:30:28.022 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2024-04-23T01:30:28.022 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T01:30:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:30:28.023 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:30:28.023 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:30:28.023 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:30:28.023 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 255 k 2024-04-23T01:30:28.023 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2024-04-23T01:30:28.023 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:30:28.373 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-437.el9.x86_64.rpm 965 kB/s | 255 kB 00:00 2024-04-23T01:30:28.373 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:30:28.373 INFO:teuthology.orchestra.run.smithi191.stdout:Total 727 kB/s | 255 kB 00:00 2024-04-23T01:30:28.394 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:30:28.577 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:30:28.577 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:30:28.582 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:30:28.582 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:30:28.719 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:30:28.793 INFO:teuthology.orchestra.run.smithi191.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T01:30:28.794 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T01:30:29.408 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T01:30:29.409 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T01:30:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T01:30:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:30:30.118 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalled: 2024-04-23T01:30:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-23T01:30:30.118 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:30:30.118 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:30:30.313 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel | sort -rV | head -n 1 2024-04-23T01:30:30.360 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-23T01:30:30.360 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-23T01:30:30.360 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-23T01:30:30.360 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-23T01:30:30.360 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T01:30:30.394 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2024-04-23T01:30:30.414 DEBUG:teuthology.parallel:result is None 2024-04-23T01:30:30.414 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T01:30:30.421 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T01:30:30.422 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T01:30:30.425 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T01:30:30.469 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T01:30:30.476 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T01:30:30.482 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T01:30:30.483 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T01:30:30.485 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T01:30:30.533 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T01:30:30.540 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T01:30:30.540 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T01:30:30.551 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T01:30:30.581 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T01:30:30.592 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T01:30:30.625 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T01:30:30.634 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T01:30:30.638 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T01:30:30.645 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T01:30:30.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T01:30:30.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T01:30:30.672 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T01:30:30.681 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T01:30:30.681 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T01:30:30.715 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T01:30:30.730 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T01:30:30.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T01:30:30.865 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T01:30:30.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T01:30:30.988 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:30:30.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T01:30:31.053 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T01:30:31.095 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T01:30:31.144 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T01:30:31.226 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T01:30:31.264 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:30:31.264 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T01:30:31.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-04-23T01:30:31.330 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-04-23T01:30:31.364 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T01:30:31.406 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T01:30:31.715 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T01:30:31.723 INFO:teuthology.task.internal:Starting timer... 2024-04-23T01:30:31.723 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T01:30:31.733 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T01:30:31.741 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-23T01:30:31.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-04-23T01:30:31.802 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-04-23T01:30:31.804 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-04-23T01:30:31.863 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-04-23T01:30:31.863 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T01:30:31.864 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-04-23T01:30:31.890 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-04-23T01:30:31.890 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-04-23T01:30:31.911 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-04-23T01:30:31.911 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-04-23T01:30:31.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T01:30:31.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:30:31.957 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T01:30:31.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:30:31.983 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T01:30:31.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-04-23T01:30:32.025 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-04-23T01:30:32.055 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T01:30:32.067 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T01:30:32.085 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T01:30:32.087 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T01:34:05.153 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-04-23T01:34:05.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-23T01:34:05.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T01:34:05.237 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-04-23T01:34:05.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-23T01:34:05.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-23T01:34:05.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T01:34:05.392 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-23T01:34:05.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-23T01:34:05.470 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T01:34:05.481 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T01:34:05.481 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T01:34:05.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T01:34:05.484 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T01:34:05.484 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T01:34:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T01:34:05.527 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T01:34:05.540 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T01:34:05.553 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-04-23T01:34:05.554 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T01:34:05.563 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-04-23T01:34:05.577 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-04-23T01:34:05.578 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T01:34:05.587 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-04-23T01:34:05.591 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T01:34:05.600 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T01:34:05.613 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T01:34:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-23T01:34:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T01:34:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-23T01:34:05.651 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.652 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.652 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.652 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.669 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-23T01:34:05.672 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T01:34:05.672 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-23T01:34:05.672 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.673 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.673 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.673 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:34:05.674 INFO:teuthology.run_tasks:Running task install... 2024-04-23T01:34:05.685 DEBUG:teuthology.task.install:project ceph 2024-04-23T01:34:05.685 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4'}} 2024-04-23T01:34:05.685 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4'} 2024-04-23T01:34:05.686 INFO:teuthology.task.install:Using flavor: crimson 2024-04-23T01:34:05.691 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T01:34:05.691 INFO:teuthology.task.install:extra packages: [] 2024-04-23T01:34:05.692 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4', 'tag': None, 'wait_for_package': False} 2024-04-23T01:34:05.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 2024-04-23T01:34:05.694 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4', 'tag': None, 'wait_for_package': False} 2024-04-23T01:34:05.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 2024-04-23T01:34:05.842 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/ 2024-04-23T01:34:05.842 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3192.ga1f34943 2024-04-23T01:34:05.847 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/ 2024-04-23T01:34:05.847 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3192.ga1f34943 2024-04-23T01:34:06.062 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T01:34:06.063 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:34:06.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T01:34:06.065 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/ci-yingxin-crimson-fix-tri-mutex-4/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T01:34:06.065 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:34:06.065 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T01:34:06.091 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T01:34:06.091 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T01:34:06.092 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T01:34:06.092 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T01:34:06.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T01:34:06.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T01:34:06.230 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T01:34:06.233 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T01:34:06.293 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-04-23T01:34:06.295 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-04-23T01:34:06.297 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-04-23T01:34:06.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-04-23T01:34:06.519 INFO:teuthology.orchestra.run.smithi191.stdout:48 files removed 2024-04-23T01:34:06.534 INFO:teuthology.orchestra.run.smithi037.stdout:48 files removed 2024-04-23T01:34:06.545 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw 2024-04-23T01:34:06.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2024-04-23T01:34:07.434 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 146 kB/s | 87 kB 00:00 2024-04-23T01:34:07.436 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 138 kB/s | 87 kB 00:00 2024-04-23T01:34:07.801 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-04-23T01:34:08.046 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-04-23T01:34:08.285 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.6 kB/s | 2.0 kB 00:00 2024-04-23T01:34:08.663 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 3.5 kB/s | 2.0 kB 00:00 2024-04-23T01:34:11.272 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.0 MB 00:02 2024-04-23T01:34:14.233 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.0 MB 00:05 2024-04-23T01:34:28.086 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 19 MB 00:12 2024-04-23T01:34:33.409 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 924 kB/s | 19 MB 00:21 2024-04-23T01:34:35.121 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.2 MB 00:03 2024-04-23T01:34:36.618 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-23T01:34:39.736 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.2 MB 00:02 2024-04-23T01:34:41.525 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-04-23T01:34:42.752 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-23T01:34:43.868 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 21 MB 00:07 2024-04-23T01:34:47.868 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-23T01:34:49.013 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-23T01:34:49.977 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:34:49.979 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:34:49.979 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:34:49.979 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:34:49.979 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:34:49.979 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 10 M 2024-04-23T01:34:49.979 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 3.4 M 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 3.7 M 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 5.9 M 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 19 M 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 25 k 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 796 k 2024-04-23T01:34:49.980 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 548 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 5.3 M 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 45 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 135 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 159 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T01:34:49.981 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 315 k 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 293 k 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 99 k 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout:Installing weak dependencies: 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout:Install 30 Packages 2024-04-23T01:34:49.982 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 2 Packages 2024-04-23T01:34:49.983 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:34:49.983 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 59 M 2024-04-23T01:34:49.983 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:34:51.215 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:34:51.215 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:34:51.215 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:34:51.215 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:34:51.215 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:34:51.215 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 10 M 2024-04-23T01:34:51.215 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 3.4 M 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 3.7 M 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 5.9 M 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 19 M 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 25 k 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 796 k 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T01:34:51.216 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 548 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 5.3 M 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 45 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 135 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 159 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 315 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 293 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 99 k 2024-04-23T01:34:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:Install 30 Packages 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-04-23T01:34:51.218 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:34:51.219 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 59 M 2024-04-23T01:34:51.219 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:34:52.260 INFO:teuthology.orchestra.run.smithi191.stdout:(1/32): ceph-common-19.0.0-3192.ga1f34943.el7.x 10 MB/s | 19 MB 00:01 2024-04-23T01:34:52.335 INFO:teuthology.orchestra.run.smithi191.stdout:(2/32): ceph-base-19.0.0-3192.ga1f34943.el7.x86 2.9 MB/s | 5.9 MB 00:02 2024-04-23T01:34:52.361 INFO:teuthology.orchestra.run.smithi191.stdout:(3/32): ceph-selinux-19.0.0-3192.ga1f34943.el7. 251 kB/s | 25 kB 00:00 2024-04-23T01:34:52.469 INFO:teuthology.orchestra.run.smithi191.stdout:(4/32): libradosstriper1-19.0.0-3192.ga1f34943. 4.9 MB/s | 548 kB 00:00 2024-04-23T01:34:52.553 INFO:teuthology.orchestra.run.smithi191.stdout:(5/32): libcephfs2-19.0.0-3192.ga1f34943.el7.x8 3.6 MB/s | 796 kB 00:00 2024-04-23T01:34:52.661 INFO:teuthology.orchestra.run.smithi191.stdout:(6/32): python3-ceph-argparse-19.0.0-3192.ga1f3 416 kB/s | 45 kB 00:00 2024-04-23T01:34:52.779 INFO:teuthology.orchestra.run.smithi191.stdout:(7/32): python3-ceph-common-19.0.0-3192.ga1f349 1.1 MB/s | 135 kB 00:00 2024-04-23T01:34:52.963 INFO:teuthology.orchestra.run.smithi191.stdout:(8/32): ceph-radosgw-19.0.0-3192.ga1f34943.el7. 3.8 MB/s | 10 MB 00:02 2024-04-23T01:34:52.988 INFO:teuthology.orchestra.run.smithi191.stdout:(9/32): python3-cephfs-19.0.0-3192.ga1f34943.el 763 kB/s | 159 kB 00:00 2024-04-23T01:34:53.055 INFO:teuthology.orchestra.run.smithi191.stdout:(10/32): librgw2-19.0.0-3192.ga1f34943.el7.x86_ 9.0 MB/s | 5.3 MB 00:00 2024-04-23T01:34:53.080 INFO:teuthology.orchestra.run.smithi191.stdout:(11/32): python3-rbd-19.0.0-3192.ga1f34943.el7. 3.1 MB/s | 293 kB 00:00 2024-04-23T01:34:53.105 INFO:teuthology.orchestra.run.smithi191.stdout:(12/32): python3-rados-19.0.0-3192.ga1f34943.el 2.2 MB/s | 315 kB 00:00 2024-04-23T01:34:53.131 INFO:teuthology.orchestra.run.smithi191.stdout:(13/32): python3-rgw-19.0.0-3192.ga1f34943.el7. 1.3 MB/s | 99 kB 00:00 2024-04-23T01:34:53.198 INFO:teuthology.orchestra.run.smithi191.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-04-23T01:34:53.223 INFO:teuthology.orchestra.run.smithi191.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 750 kB/s | 107 kB 00:00 2024-04-23T01:34:53.248 INFO:teuthology.orchestra.run.smithi191.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-04-23T01:34:53.288 INFO:teuthology.orchestra.run.smithi037.stdout:(1/32): ceph-radosgw-19.0.0-3192.ga1f34943.el7. 5.3 MB/s | 10 MB 00:01 2024-04-23T01:34:53.307 INFO:teuthology.orchestra.run.smithi191.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 727 kB/s | 42 kB 00:00 2024-04-23T01:34:53.331 INFO:teuthology.orchestra.run.smithi037.stdout:(2/32): ceph-selinux-19.0.0-3192.ga1f34943.el7. 605 kB/s | 25 kB 00:00 2024-04-23T01:34:53.407 INFO:teuthology.orchestra.run.smithi191.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-04-23T01:34:53.422 INFO:teuthology.orchestra.run.smithi037.stdout:(3/32): libcephfs2-19.0.0-3192.ga1f34943.el7.x8 8.5 MB/s | 796 kB 00:00 2024-04-23T01:34:53.440 INFO:teuthology.orchestra.run.smithi191.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-04-23T01:34:53.466 INFO:teuthology.orchestra.run.smithi191.stdout:(20/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.2 MB/s | 292 kB 00:00 2024-04-23T01:34:53.489 INFO:teuthology.orchestra.run.smithi037.stdout:(4/32): libradosstriper1-19.0.0-3192.ga1f34943. 8.0 MB/s | 548 kB 00:00 2024-04-23T01:34:53.491 INFO:teuthology.orchestra.run.smithi191.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 429 kB/s | 36 kB 00:00 2024-04-23T01:34:53.541 INFO:teuthology.orchestra.run.smithi191.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 472 kB/s | 47 kB 00:00 2024-04-23T01:34:53.648 INFO:teuthology.orchestra.run.smithi037.stdout:(5/32): ceph-base-19.0.0-3192.ga1f34943.el7.x86 2.6 MB/s | 5.9 MB 00:02 2024-04-23T01:34:53.683 INFO:teuthology.orchestra.run.smithi191.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 184 kB/s | 26 kB 00:00 2024-04-23T01:34:53.723 INFO:teuthology.orchestra.run.smithi037.stdout:(6/32): python3-ceph-argparse-19.0.0-3192.ga1f3 603 kB/s | 45 kB 00:00 2024-04-23T01:34:53.758 INFO:teuthology.orchestra.run.smithi191.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.0 MB/s | 309 kB 00:00 2024-04-23T01:34:53.792 INFO:teuthology.orchestra.run.smithi191.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-04-23T01:34:53.806 INFO:teuthology.orchestra.run.smithi037.stdout:(7/32): python3-ceph-common-19.0.0-3192.ga1f349 1.6 MB/s | 135 kB 00:00 2024-04-23T01:34:53.819 INFO:teuthology.orchestra.run.smithi191.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-23T01:34:53.890 INFO:teuthology.orchestra.run.smithi037.stdout:(8/32): librgw2-19.0.0-3192.ga1f34943.el7.x86_6 13 MB/s | 5.3 MB 00:00 2024-04-23T01:34:53.892 INFO:teuthology.orchestra.run.smithi191.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-04-23T01:34:53.915 INFO:teuthology.orchestra.run.smithi037.stdout:(9/32): python3-cephfs-19.0.0-3192.ga1f34943.el 1.4 MB/s | 159 kB 00:00 2024-04-23T01:34:53.949 INFO:teuthology.orchestra.run.smithi037.stdout:(10/32): python3-rados-19.0.0-3192.ga1f34943.el 5.3 MB/s | 315 kB 00:00 2024-04-23T01:34:53.968 INFO:teuthology.orchestra.run.smithi191.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 9.3 MB/s | 4.4 MB 00:00 2024-04-23T01:34:53.983 INFO:teuthology.orchestra.run.smithi037.stdout:(11/32): python3-rbd-19.0.0-3192.ga1f34943.el7. 4.3 MB/s | 293 kB 00:00 2024-04-23T01:34:54.008 INFO:teuthology.orchestra.run.smithi037.stdout:(12/32): python3-rgw-19.0.0-3192.ga1f34943.el7. 1.7 MB/s | 99 kB 00:00 2024-04-23T01:34:54.069 INFO:teuthology.orchestra.run.smithi191.stdout:(29/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-04-23T01:34:54.102 INFO:teuthology.orchestra.run.smithi191.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-04-23T01:34:54.117 INFO:teuthology.orchestra.run.smithi037.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 802 kB/s | 107 kB 00:00 2024-04-23T01:34:54.158 INFO:teuthology.orchestra.run.smithi037.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-04-23T01:34:54.184 INFO:teuthology.orchestra.run.smithi037.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-04-23T01:34:54.251 INFO:teuthology.orchestra.run.smithi037.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-04-23T01:34:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-04-23T01:34:54.309 INFO:teuthology.orchestra.run.smithi037.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 724 kB/s | 42 kB 00:00 2024-04-23T01:34:54.335 INFO:teuthology.orchestra.run.smithi037.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-23T01:34:54.352 INFO:teuthology.orchestra.run.smithi037.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 858 kB/s | 36 kB 00:00 2024-04-23T01:34:54.360 INFO:teuthology.orchestra.run.smithi191.stdout:(31/32): librbd1-19.0.0-3192.ga1f34943.el7.x86_ 13 MB/s | 3.7 MB 00:00 2024-04-23T01:34:54.377 INFO:teuthology.orchestra.run.smithi037.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-04-23T01:34:54.486 INFO:teuthology.orchestra.run.smithi037.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.3 MB/s | 309 kB 00:00 2024-04-23T01:34:54.519 INFO:teuthology.orchestra.run.smithi037.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 781 kB/s | 26 kB 00:00 2024-04-23T01:34:54.552 INFO:teuthology.orchestra.run.smithi191.stdout:(32/32): librados2-19.0.0-3192.ga1f34943.el7.x8 5.8 MB/s | 3.4 MB 00:00 2024-04-23T01:34:54.555 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:34:54.555 INFO:teuthology.orchestra.run.smithi191.stdout:Total 13 MB/s | 59 MB 00:04 2024-04-23T01:34:54.561 INFO:teuthology.orchestra.run.smithi037.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-04-23T01:34:54.604 INFO:teuthology.orchestra.run.smithi037.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-04-23T01:34:54.659 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:34:54.696 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:34:54.696 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:34:54.737 INFO:teuthology.orchestra.run.smithi037.stdout:(26/32): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-23T01:34:54.763 INFO:teuthology.orchestra.run.smithi037.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-04-23T01:34:54.788 INFO:teuthology.orchestra.run.smithi037.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-23T01:34:54.871 INFO:teuthology.orchestra.run.smithi037.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-23T01:34:55.072 INFO:teuthology.orchestra.run.smithi037.stdout:(30/32): ceph-common-19.0.0-3192.ga1f34943.el7. 5.3 MB/s | 19 MB 00:03 2024-04-23T01:34:55.154 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:34:55.154 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:34:55.222 INFO:teuthology.orchestra.run.smithi037.stdout:(31/32): librbd1-19.0.0-3192.ga1f34943.el7.x86_ 10 MB/s | 3.7 MB 00:00 2024-04-23T01:34:56.222 INFO:teuthology.orchestra.run.smithi037.stdout:(32/32): librados2-19.0.0-3192.ga1f34943.el7.x8 2.4 MB/s | 3.4 MB 00:01 2024-04-23T01:34:56.225 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:34:56.226 INFO:teuthology.orchestra.run.smithi037.stdout:Total 12 MB/s | 59 MB 00:05 2024-04-23T01:34:56.325 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:34:56.367 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:34:56.367 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:34:56.629 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:34:56.854 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:34:56.854 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:34:57.160 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-23T01:34:57.213 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 2/34 2024-04-23T01:34:57.304 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 2/34 2024-04-23T01:34:57.393 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 3/34 2024-04-23T01:34:57.423 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 4/34 2024-04-23T01:34:57.486 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 4/34 2024-04-23T01:34:57.531 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-23T01:34:57.561 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-23T01:34:57.586 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-23T01:34:57.609 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-23T01:34:57.631 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-23T01:34:57.834 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-23T01:34:57.867 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-23T01:34:58.224 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-23T01:34:58.289 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 11/34 2024-04-23T01:34:58.355 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 11/34 2024-04-23T01:34:58.398 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.0.0-3192.ga1f34943.el7. 12/34 2024-04-23T01:34:58.454 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 13/34 2024-04-23T01:34:58.486 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 14/34 2024-04-23T01:34:58.496 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:34:58.592 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-23T01:34:58.616 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_6 16/34 2024-04-23T01:34:58.704 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_6 16/34 2024-04-23T01:34:58.740 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-23T01:34:58.852 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-23T01:34:58.891 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-23T01:34:58.946 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-23T01:34:58.981 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-23T01:34:59.010 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-23T01:34:59.041 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-23T01:34:59.045 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-23T01:34:59.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-23T01:34:59.091 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 2/34 2024-04-23T01:34:59.167 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 2/34 2024-04-23T01:34:59.258 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 3/34 2024-04-23T01:34:59.301 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 4/34 2024-04-23T01:34:59.347 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 4/34 2024-04-23T01:34:59.385 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-23T01:34:59.414 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-23T01:34:59.439 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-23T01:34:59.462 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-23T01:34:59.481 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-23T01:34:59.656 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-23T01:34:59.681 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 26/34 2024-04-23T01:34:59.696 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-23T01:34:59.729 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-23T01:34:59.753 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 26/34 2024-04-23T01:34:59.830 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 27/34 2024-04-23T01:34:59.859 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.0.0-3192.ga1f34943.el7.x8 28/34 2024-04-23T01:35:00.101 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-23T01:35:00.157 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 11/34 2024-04-23T01:35:00.224 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 11/34 2024-04-23T01:35:00.267 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-3192.ga1f34943.el7. 12/34 2024-04-23T01:35:00.331 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 13/34 2024-04-23T01:35:00.363 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 14/34 2024-04-23T01:35:00.452 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-23T01:35:00.477 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_6 16/34 2024-04-23T01:35:00.556 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_6 16/34 2024-04-23T01:35:00.592 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-23T01:35:00.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-23T01:35:00.735 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-23T01:35:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-23T01:35:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-23T01:35:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-23T01:35:00.860 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-23T01:35:00.896 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-23T01:35:01.497 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-23T01:35:01.525 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 26/34 2024-04-23T01:35:01.597 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 26/34 2024-04-23T01:35:01.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 27/34 2024-04-23T01:35:01.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-3192.ga1f34943.el7.x8 28/34 2024-04-23T01:35:02.315 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 29/34 2024-04-23T01:35:02.347 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 29/34 2024-04-23T01:35:03.010 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 29/34 2024-04-23T01:35:03.050 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 30/34 2024-04-23T01:35:03.142 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 30/34 2024-04-23T01:35:03.142 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T01:35:03.143 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T01:35:03.143 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:03.177 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 31/34 2024-04-23T01:35:04.249 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 29/34 2024-04-23T01:35:04.282 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 29/34 2024-04-23T01:35:04.985 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 29/34 2024-04-23T01:35:05.035 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 30/34 2024-04-23T01:35:05.112 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 30/34 2024-04-23T01:35:05.112 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T01:35:05.112 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T01:35:05.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:05.163 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 31/34 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 31/34 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-04-23T01:35:13.445 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:14.546 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 32/34 2024-04-23T01:35:14.570 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 32/34 2024-04-23T01:35:14.571 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:35:14.571 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T01:35:14.571 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T01:35:14.571 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T01:35:14.571 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:14.572 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T01:35:14.656 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T01:35:14.656 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T01:35:15.449 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 31/34 2024-04-23T01:35:15.449 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-04-23T01:35:15.449 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-04-23T01:35:15.449 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-04-23T01:35:15.449 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-04-23T01:35:15.450 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-04-23T01:35:15.450 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-04-23T01:35:15.450 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-04-23T01:35:15.450 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:16.022 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T01:35:16.023 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 1/34 2024-04-23T01:35:16.023 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 2/34 2024-04-23T01:35:16.023 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 3/34 2024-04-23T01:35:16.023 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 4/34 2024-04-23T01:35:16.023 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 5/34 2024-04-23T01:35:16.024 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_6 6/34 2024-04-23T01:35:16.024 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 7/34 2024-04-23T01:35:16.024 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3192.ga1f34943.el7. 8/34 2024-04-23T01:35:16.024 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.0.0-3192.ga1f34943.el7.x8 9/34 2024-04-23T01:35:16.024 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 10/34 2024-04-23T01:35:16.024 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 11/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 12/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 13/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-23T01:35:16.025 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 31/34 2024-04-23T01:35:16.026 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-23T01:35:16.027 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 33/34 2024-04-23T01:35:16.554 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 32/34 2024-04-23T01:35:16.580 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 32/34 2024-04-23T01:35:16.580 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:35:16.580 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T01:35:16.580 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T01:35:16.580 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T01:35:16.581 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:16.586 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T01:35:16.657 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T01:35:16.657 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T01:35:16.799 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T01:35:16.799 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:16.799 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-04-23T01:35:16.799 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.799 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.799 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T01:35:16.800 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:16.801 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T01:35:16.802 INFO:teuthology.orchestra.run.smithi191.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T01:35:16.802 INFO:teuthology.orchestra.run.smithi191.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T01:35:16.802 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T01:35:16.802 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T01:35:16.802 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:16.802 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:35:17.053 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-test 2024-04-23T01:35:17.588 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:30 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:35:17.711 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:35:17.712 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:35:17.712 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:35:17.712 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 84 M 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 173 k 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:35:17.713 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:35:17.714 INFO:teuthology.orchestra.run.smithi191.stdout:Install 9 Packages 2024-04-23T01:35:17.714 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:17.714 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 87 M 2024-04-23T01:35:17.714 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 813 M 2024-04-23T01:35:17.714 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:35:17.978 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T01:35:17.978 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 1/34 2024-04-23T01:35:17.978 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 2/34 2024-04-23T01:35:17.978 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 3/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 4/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 5/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_6 6/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 7/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3192.ga1f34943.el7. 8/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-3192.ga1f34943.el7.x8 9/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 10/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 11/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 12/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 13/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-23T01:35:17.979 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-23T01:35:17.980 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-23T01:35:17.981 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 31/34 2024-04-23T01:35:17.981 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-23T01:35:17.981 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 33/34 2024-04-23T01:35:18.688 INFO:teuthology.orchestra.run.smithi191.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 214 kB/s | 94 kB 00:00 2024-04-23T01:35:18.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T01:35:18.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T01:35:18.722 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T01:35:18.723 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:18.724 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:35:18.847 INFO:teuthology.orchestra.run.smithi191.stdout:(2/9): libcephsqlite-19.0.0-3192.ga1f34943.el7. 289 kB/s | 173 kB 00:00 2024-04-23T01:35:19.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2024-04-23T01:35:19.126 INFO:teuthology.orchestra.run.smithi191.stdout:(3/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 1.0 MB/s | 469 kB 00:00 2024-04-23T01:35:19.403 INFO:teuthology.orchestra.run.smithi191.stdout:(4/9): libubsan-11.4.1-3.el9.x86_64.rpm 337 kB/s | 187 kB 00:00 2024-04-23T01:35:19.528 INFO:teuthology.orchestra.run.smithi191.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-04-23T01:35:19.553 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:31 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:35:19.637 INFO:teuthology.orchestra.run.smithi191.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-04-23T01:35:19.680 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:35:19.681 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:35:19.681 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:35:19.681 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:35:19.681 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:35:19.681 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 84 M 2024-04-23T01:35:19.681 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 173 k 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:35:19.682 INFO:teuthology.orchestra.run.smithi037.stdout:Install 9 Packages 2024-04-23T01:35:19.683 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:19.683 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 87 M 2024-04-23T01:35:19.683 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 813 M 2024-04-23T01:35:19.683 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:35:19.746 INFO:teuthology.orchestra.run.smithi191.stdout:(7/9): socat-1.7.4.1-5.el9.x86_64.rpm 890 kB/s | 305 kB 00:00 2024-04-23T01:35:19.979 INFO:teuthology.orchestra.run.smithi191.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 356 kB/s | 122 kB 00:00 2024-04-23T01:35:20.789 INFO:teuthology.orchestra.run.smithi037.stdout:(1/9): libcephsqlite-19.0.0-3192.ga1f34943.el7. 503 kB/s | 173 kB 00:00 2024-04-23T01:35:20.875 INFO:teuthology.orchestra.run.smithi037.stdout:(2/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 219 kB/s | 94 kB 00:00 2024-04-23T01:35:21.032 INFO:teuthology.orchestra.run.smithi037.stdout:(3/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 1.9 MB/s | 469 kB 00:00 2024-04-23T01:35:21.108 INFO:teuthology.orchestra.run.smithi037.stdout:(4/9): libubsan-11.4.1-3.el9.x86_64.rpm 795 kB/s | 187 kB 00:00 2024-04-23T01:35:21.167 INFO:teuthology.orchestra.run.smithi037.stdout:(5/9): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-04-23T01:35:21.260 INFO:teuthology.orchestra.run.smithi037.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 687 kB/s | 64 kB 00:00 2024-04-23T01:35:21.370 INFO:teuthology.orchestra.run.smithi037.stdout:(7/9): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-04-23T01:35:21.620 INFO:teuthology.orchestra.run.smithi037.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 339 kB/s | 122 kB 00:00 2024-04-23T01:35:27.329 INFO:teuthology.orchestra.run.smithi191.stdout:(9/9): ceph-test-19.0.0-3192.ga1f34943.el7.x86_ 9.3 MB/s | 84 MB 00:09 2024-04-23T01:35:27.331 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:35:27.332 INFO:teuthology.orchestra.run.smithi191.stdout:Total 9.0 MB/s | 87 MB 00:09 2024-04-23T01:35:27.413 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:35:27.436 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:35:27.436 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:35:28.037 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:35:28.037 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:35:28.836 INFO:teuthology.orchestra.run.smithi037.stdout:(9/9): ceph-test-19.0.0-3192.ga1f34943.el7.x86_ 10 MB/s | 84 MB 00:08 2024-04-23T01:35:28.838 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:35:28.839 INFO:teuthology.orchestra.run.smithi037.stdout:Total 9.5 MB/s | 87 MB 00:09 2024-04-23T01:35:28.922 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:35:28.942 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:35:28.948 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:35:28.948 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:35:29.011 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-23T01:35:29.055 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-23T01:35:29.100 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-23T01:35:29.126 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-23T01:35:29.156 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-23T01:35:29.181 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-23T01:35:29.250 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-23T01:35:29.290 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-23T01:35:29.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 8/9 2024-04-23T01:35:29.579 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:35:29.579 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:35:30.506 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:35:30.586 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-23T01:35:30.638 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-23T01:35:30.683 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-23T01:35:30.718 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-23T01:35:30.748 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-23T01:35:30.773 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-23T01:35:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-23T01:35:30.882 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-23T01:35:30.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 8/9 2024-04-23T01:35:40.568 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 8/9 2024-04-23T01:35:40.647 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 9/9 2024-04-23T01:35:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 8/9 2024-04-23T01:35:43.026 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 9/9 2024-04-23T01:35:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 9/9 2024-04-23T01:35:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 1/9 2024-04-23T01:35:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 2/9 2024-04-23T01:35:47.041 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-23T01:35:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-23T01:35:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-23T01:35:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-23T01:35:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-23T01:35:47.042 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-23T01:35:47.362 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-23T01:35:47.362 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:47.362 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:35:47.362 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:47.362 INFO:teuthology.orchestra.run.smithi191.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-23T01:35:47.362 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:47.363 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:35:47.615 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph 2024-04-23T01:35:48.127 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:01 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:35:48.249 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 6.5 k 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 2.2 M 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 1.6 M 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 249 k 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 5.0 M 2024-04-23T01:35:48.252 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 71 M 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T01:35:48.253 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T01:35:48.254 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout:Install 36 Packages 2024-04-23T01:35:48.255 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:35:48.256 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 85 M 2024-04-23T01:35:48.256 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 923 M 2024-04-23T01:35:48.256 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:35:48.984 INFO:teuthology.orchestra.run.smithi191.stdout:(1/36): ceph-19.0.0-3192.ga1f34943.el7.x86_64.r 31 kB/s | 6.5 kB 00:00 2024-04-23T01:35:49.036 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 9/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 1/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 2/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-23T01:35:49.037 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-23T01:35:49.184 INFO:teuthology.orchestra.run.smithi191.stdout:(2/36): ceph-mds-19.0.0-3192.ga1f34943.el7.x86_ 5.4 MB/s | 2.2 MB 00:00 2024-04-23T01:35:49.359 INFO:teuthology.orchestra.run.smithi191.stdout:(3/36): ceph-mgr-19.0.0-3192.ga1f34943.el7.x86_ 2.7 MB/s | 1.6 MB 00:00 2024-04-23T01:35:49.363 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-23T01:35:49.363 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:49.363 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:35:49.363 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:49.363 INFO:teuthology.orchestra.run.smithi037.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-23T01:35:49.363 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:49.364 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:35:49.501 INFO:teuthology.orchestra.run.smithi191.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3192.ga1f3 1.7 MB/s | 249 kB 00:00 2024-04-23T01:35:49.610 INFO:teuthology.orchestra.run.smithi191.stdout:(5/36): ceph-mon-19.0.0-3192.ga1f34943.el7.x86_ 8.0 MB/s | 5.0 MB 00:00 2024-04-23T01:35:49.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2024-04-23T01:35:50.110 INFO:teuthology.orchestra.run.smithi191.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 416 kB/s | 253 kB 00:00 2024-04-23T01:35:50.199 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:02 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:35:50.227 INFO:teuthology.orchestra.run.smithi191.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 913 kB/s | 106 kB 00:00 2024-04-23T01:35:50.325 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:35:50.327 INFO:teuthology.orchestra.run.smithi191.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.3 MB/s | 135 kB 00:00 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 6.5 k 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 2.2 M 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 1.6 M 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 249 k 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 5.0 M 2024-04-23T01:35:50.328 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 71 M 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T01:35:50.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T01:35:50.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout:Install 36 Packages 2024-04-23T01:35:50.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:35:50.332 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 85 M 2024-04-23T01:35:50.332 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 923 M 2024-04-23T01:35:50.332 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:35:50.436 INFO:teuthology.orchestra.run.smithi191.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-04-23T01:35:50.470 INFO:teuthology.orchestra.run.smithi191.stdout:(10/36): python3-cryptography-36.0.1-4.el9.x86_ 1.4 MB/s | 1.2 MB 00:00 2024-04-23T01:35:50.636 INFO:teuthology.orchestra.run.smithi191.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.0 MB/s | 215 kB 00:00 2024-04-23T01:35:50.745 INFO:teuthology.orchestra.run.smithi191.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 685 kB/s | 188 kB 00:00 2024-04-23T01:35:50.804 INFO:teuthology.orchestra.run.smithi191.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 595 kB/s | 35 kB 00:00 2024-04-23T01:35:50.870 INFO:teuthology.orchestra.run.smithi191.stdout:(14/36): python3-mako-1.1.4-6.el9.noarch.rpm 736 kB/s | 172 kB 00:00 2024-04-23T01:35:50.896 INFO:teuthology.orchestra.run.smithi191.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-04-23T01:35:50.929 INFO:teuthology.orchestra.run.smithi191.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-04-23T01:35:51.046 INFO:teuthology.orchestra.run.smithi191.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-04-23T01:35:51.072 INFO:teuthology.orchestra.run.smithi191.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-04-23T01:35:51.106 INFO:teuthology.orchestra.run.smithi191.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 739 kB/s | 43 kB 00:00 2024-04-23T01:35:51.173 INFO:teuthology.orchestra.run.smithi191.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 5.2 MB/s | 358 kB 00:00 2024-04-23T01:35:51.198 INFO:teuthology.orchestra.run.smithi191.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-23T01:35:51.223 INFO:teuthology.orchestra.run.smithi191.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-04-23T01:35:51.249 INFO:teuthology.orchestra.run.smithi191.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-04-23T01:35:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:(1/36): ceph-19.0.0-3192.ga1f34943.el7.x86_64.r 15 kB/s | 6.5 kB 00:00 2024-04-23T01:35:51.274 INFO:teuthology.orchestra.run.smithi191.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 459 kB/s | 23 kB 00:00 2024-04-23T01:35:51.299 INFO:teuthology.orchestra.run.smithi191.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-04-23T01:35:51.324 INFO:teuthology.orchestra.run.smithi191.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-04-23T01:35:51.350 INFO:teuthology.orchestra.run.smithi191.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-04-23T01:35:51.384 INFO:teuthology.orchestra.run.smithi191.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.3 MB/s | 79 kB 00:00 2024-04-23T01:35:51.409 INFO:teuthology.orchestra.run.smithi191.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-04-23T01:35:51.434 INFO:teuthology.orchestra.run.smithi191.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-04-23T01:35:51.459 INFO:teuthology.orchestra.run.smithi191.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-04-23T01:35:51.484 INFO:teuthology.orchestra.run.smithi191.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-04-23T01:35:51.517 INFO:teuthology.orchestra.run.smithi037.stdout:(2/36): ceph-mds-19.0.0-3192.ga1f34943.el7.x86_ 3.1 MB/s | 2.2 MB 00:00 2024-04-23T01:35:51.518 INFO:teuthology.orchestra.run.smithi191.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-23T01:35:51.560 INFO:teuthology.orchestra.run.smithi191.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-04-23T01:35:51.585 INFO:teuthology.orchestra.run.smithi191.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 299 kB/s | 20 kB 00:00 2024-04-23T01:35:51.734 INFO:teuthology.orchestra.run.smithi037.stdout:(3/36): ceph-mgr-19.0.0-3192.ga1f34943.el7.x86_ 1.7 MB/s | 1.6 MB 00:00 2024-04-23T01:35:51.851 INFO:teuthology.orchestra.run.smithi037.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3192.ga1f3 2.1 MB/s | 249 kB 00:00 2024-04-23T01:35:52.366 INFO:teuthology.orchestra.run.smithi037.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 498 kB/s | 253 kB 00:00 2024-04-23T01:35:52.818 INFO:teuthology.orchestra.run.smithi037.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 2.7 MB/s | 1.2 MB 00:00 2024-04-23T01:35:52.918 INFO:teuthology.orchestra.run.smithi037.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-04-23T01:35:53.127 INFO:teuthology.orchestra.run.smithi037.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 649 kB/s | 135 kB 00:00 2024-04-23T01:35:53.236 INFO:teuthology.orchestra.run.smithi037.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 1.1 MB/s | 125 kB 00:00 2024-04-23T01:35:53.286 INFO:teuthology.orchestra.run.smithi191.stdout:(36/36): ceph-osd-19.0.0-3192.ga1f34943.el7.x86 17 MB/s | 71 MB 00:04 2024-04-23T01:35:53.288 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:35:53.289 INFO:teuthology.orchestra.run.smithi191.stdout:Total 17 MB/s | 85 MB 00:05 2024-04-23T01:35:53.344 INFO:teuthology.orchestra.run.smithi037.stdout:(10/36): ceph-mon-19.0.0-3192.ga1f34943.el7.x86 2.4 MB/s | 5.0 MB 00:02 2024-04-23T01:35:53.369 INFO:teuthology.orchestra.run.smithi037.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.6 MB/s | 215 kB 00:00 2024-04-23T01:35:53.423 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:35:53.464 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:35:53.464 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:35:53.470 INFO:teuthology.orchestra.run.smithi037.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-23T01:35:53.495 INFO:teuthology.orchestra.run.smithi037.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-04-23T01:35:53.520 INFO:teuthology.orchestra.run.smithi037.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 692 kB/s | 35 kB 00:00 2024-04-23T01:35:53.546 INFO:teuthology.orchestra.run.smithi037.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-23T01:35:53.571 INFO:teuthology.orchestra.run.smithi037.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-04-23T01:35:53.763 INFO:teuthology.orchestra.run.smithi037.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 790 kB/s | 151 kB 00:00 2024-04-23T01:35:53.813 INFO:teuthology.orchestra.run.smithi037.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 871 kB/s | 43 kB 00:00 2024-04-23T01:35:53.880 INFO:teuthology.orchestra.run.smithi037.stdout:(19/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-23T01:35:53.955 INFO:teuthology.orchestra.run.smithi037.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2024-04-23T01:35:54.006 INFO:teuthology.orchestra.run.smithi037.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 215 kB/s | 11 kB 00:00 2024-04-23T01:35:54.056 INFO:teuthology.orchestra.run.smithi037.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 354 kB/s | 18 kB 00:00 2024-04-23T01:35:54.075 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:35:54.075 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:35:54.106 INFO:teuthology.orchestra.run.smithi037.stdout:(23/36): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-04-23T01:35:54.157 INFO:teuthology.orchestra.run.smithi037.stdout:(24/36): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-04-23T01:35:54.207 INFO:teuthology.orchestra.run.smithi037.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 394 kB/s | 20 kB 00:00 2024-04-23T01:35:54.257 INFO:teuthology.orchestra.run.smithi037.stdout:(26/36): python3-logutils-0.3.5-21.el9.noarch.r 926 kB/s | 46 kB 00:00 2024-04-23T01:35:54.307 INFO:teuthology.orchestra.run.smithi037.stdout:(27/36): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-04-23T01:35:54.366 INFO:teuthology.orchestra.run.smithi037.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-04-23T01:35:54.416 INFO:teuthology.orchestra.run.smithi037.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-04-23T01:35:54.467 INFO:teuthology.orchestra.run.smithi037.stdout:(30/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-04-23T01:35:54.517 INFO:teuthology.orchestra.run.smithi037.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 719 kB/s | 36 kB 00:00 2024-04-23T01:35:54.567 INFO:teuthology.orchestra.run.smithi037.stdout:(32/36): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-04-23T01:35:54.618 INFO:teuthology.orchestra.run.smithi037.stdout:(33/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 8.4 MB/s | 427 kB 00:00 2024-04-23T01:35:54.668 INFO:teuthology.orchestra.run.smithi037.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-04-23T01:35:55.460 INFO:teuthology.orchestra.run.smithi037.stdout:(35/36): ceph-osd-19.0.0-3192.ga1f34943.el7.x86 18 MB/s | 71 MB 00:03 2024-04-23T01:35:55.645 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:35:55.705 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-23T01:35:55.737 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-23T01:35:55.765 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-23T01:35:55.837 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-23T01:35:55.881 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-23T01:35:55.914 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-23T01:35:56.005 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-23T01:35:56.084 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-23T01:35:56.133 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-23T01:35:56.168 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-23T01:35:56.198 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-23T01:35:56.233 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-23T01:35:56.266 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-23T01:35:56.307 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-23T01:35:56.358 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-23T01:35:56.414 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-23T01:35:56.455 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-23T01:35:56.532 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-23T01:35:56.790 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-23T01:35:56.872 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-23T01:35:56.925 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-23T01:35:56.964 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-23T01:35:57.012 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-23T01:35:57.069 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-23T01:35:57.255 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-23T01:35:57.310 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-23T01:35:57.380 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-23T01:35:57.469 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-23T01:35:57.509 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-23T01:35:57.644 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-23T01:35:57.827 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3192.ga1f34943.el7. 31/36 2024-04-23T01:35:57.853 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 32/36 2024-04-23T01:35:57.877 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 32/36 2024-04-23T01:35:57.878 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:35:57.878 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T01:35:57.878 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T01:35:57.878 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T01:35:57.878 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:08.728 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 33/36 2024-04-23T01:36:08.754 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 33/36 2024-04-23T01:36:08.754 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:08.754 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T01:36:08.754 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T01:36:08.754 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T01:36:08.754 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:09.295 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 34/36 2024-04-23T01:36:09.318 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 34/36 2024-04-23T01:36:09.319 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:09.319 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T01:36:09.319 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T01:36:09.319 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T01:36:09.319 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:09.555 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 35/36 2024-04-23T01:36:09.577 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 35/36 2024-04-23T01:36:09.577 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:09.577 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T01:36:09.577 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T01:36:09.577 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T01:36:09.577 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:09.641 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 36/36 2024-04-23T01:36:16.806 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 36/36 2024-04-23T01:36:16.806 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 1/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 2/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 3/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 4/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 5/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3192.ga1f34943.el7. 6/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-23T01:36:16.807 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-23T01:36:16.808 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-23T01:36:16.811 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-23T01:36:16.811 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-23T01:36:16.812 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-23T01:36:17.758 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T01:36:17.759 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T01:36:17.760 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:17.761 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:36:18.108 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-base 2024-04-23T01:36:18.617 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:31 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:36:18.696 INFO:teuthology.orchestra.run.smithi191.stdout:Package ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:36:18.737 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:36:18.738 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:36:18.739 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:36:18.815 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install cephadm 2024-04-23T01:36:19.318 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:32 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:36:19.438 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:36:19.439 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:19.439 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:36:19.439 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:19.439 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 762 k 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 762 k 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 769 k 2024-04-23T01:36:19.440 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:36:20.213 INFO:teuthology.orchestra.run.smithi191.stdout:cephadm-19.0.0-3192.ga1f34943.el7.noarch.rpm 987 kB/s | 762 kB 00:00 2024-04-23T01:36:20.214 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:36:20.214 INFO:teuthology.orchestra.run.smithi191.stdout:Total 984 kB/s | 762 kB 00:00 2024-04-23T01:36:20.214 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:36:20.219 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:36:20.219 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:36:20.225 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:36:20.225 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:36:20.296 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:36:20.730 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:36:20.815 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:36:21.159 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:36:21.382 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:36:21.382 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:21.382 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:36:21.382 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:36:21.383 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:21.383 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:36:21.618 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T01:36:22.139 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:35 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:36:22.259 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:36:22.260 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:22.260 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-04-23T01:36:22.260 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:22.260 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 157 k 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 157 k 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 640 k 2024-04-23T01:36:22.261 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:36:22.495 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-immutable-object-cache-19.0.0-3192.ga1f349 671 kB/s | 157 kB 00:00 2024-04-23T01:36:22.496 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:36:22.497 INFO:teuthology.orchestra.run.smithi191.stdout:Total 666 kB/s | 157 kB 00:00 2024-04-23T01:36:22.497 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:36:22.506 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:36:22.506 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:36:22.563 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:36:22.564 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:36:22.726 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:36:22.823 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943. 1/1 2024-04-23T01:36:22.846 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943. 1/1 2024-04-23T01:36:22.846 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:22.846 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T01:36:22.846 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943. 1/1 2024-04-23T01:36:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:23.782 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:36:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:23.782 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:23.782 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:36:24.024 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr 2024-04-23T01:36:24.532 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:37 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:36:24.612 INFO:teuthology.orchestra.run.smithi191.stdout:Package ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:36:24.656 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:36:24.657 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:36:24.657 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:36:24.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T01:36:25.239 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:38 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:36:25.359 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:36:25.360 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:25.360 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:36:25.360 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 3.5 M 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 34 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 16 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T01:36:25.361 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:25.362 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:36:25.362 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:25.362 INFO:teuthology.orchestra.run.smithi191.stdout:Install 11 Packages 2024-04-23T01:36:25.362 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:25.362 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 7.6 M 2024-04-23T01:36:25.363 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 100 M 2024-04-23T01:36:25.363 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:36:26.125 INFO:teuthology.orchestra.run.smithi191.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3192.ga1 176 kB/s | 34 kB 00:00 2024-04-23T01:36:26.150 INFO:teuthology.orchestra.run.smithi191.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3192.ga1f 75 kB/s | 16 kB 00:00 2024-04-23T01:36:26.542 INFO:teuthology.orchestra.run.smithi191.stdout:(3/11): ceph-mgr-dashboard-19.0.0-3192.ga1f3494 5.8 MB/s | 3.5 MB 00:00 2024-04-23T01:36:26.817 INFO:teuthology.orchestra.run.smithi191.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.9 MB/s | 548 kB 00:00 2024-04-23T01:36:26.901 INFO:teuthology.orchestra.run.smithi191.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-04-23T01:36:26.993 INFO:teuthology.orchestra.run.smithi191.stdout:(6/11): protobuf-compiler-3.14.0-13.el9.x86_64. 1.0 MB/s | 863 kB 00:00 2024-04-23T01:36:27.143 INFO:teuthology.orchestra.run.smithi191.stdout:(7/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 8.4 MB/s | 2.0 MB 00:00 2024-04-23T01:36:27.227 INFO:teuthology.orchestra.run.smithi191.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 618 kB/s | 144 kB 00:00 2024-04-23T01:36:27.252 INFO:teuthology.orchestra.run.smithi191.stdout:(9/11): python3-repoze-lru-0.7-16.el9.noarch.rp 283 kB/s | 31 kB 00:00 2024-04-23T01:36:27.328 INFO:teuthology.orchestra.run.smithi191.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2024-04-23T01:36:33.098 INFO:teuthology.orchestra.run.smithi037.stdout:(36/36): lua-devel-5.4.4-4.el9.x86_64.rpm 576 B/s | 22 kB 00:39 2024-04-23T01:36:33.102 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:36:33.102 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.0 MB/s | 85 MB 00:42 2024-04-23T01:36:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:36:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:36:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:36:33.929 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:36:33.929 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:36:35.709 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:36:35.767 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-23T01:36:35.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-23T01:36:35.836 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-23T01:36:35.910 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-23T01:36:35.960 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-23T01:36:35.993 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-23T01:36:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-23T01:36:36.166 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-23T01:36:36.221 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-23T01:36:36.256 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-23T01:36:36.286 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-23T01:36:36.320 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-23T01:36:36.353 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-23T01:36:36.394 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-23T01:36:36.438 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-23T01:36:36.472 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-23T01:36:36.511 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-23T01:36:36.587 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-23T01:36:36.746 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-23T01:36:36.829 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-23T01:36:36.881 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-23T01:36:36.919 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-23T01:36:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-23T01:36:37.041 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-23T01:36:37.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-23T01:36:37.298 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-23T01:36:37.378 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-23T01:36:37.467 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-23T01:36:37.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-23T01:36:37.627 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-23T01:36:37.831 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3192.ga1f34943.el7. 31/36 2024-04-23T01:36:37.856 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 32/36 2024-04-23T01:36:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 32/36 2024-04-23T01:36:37.883 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:37.883 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T01:36:37.883 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T01:36:37.883 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T01:36:37.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:41.925 INFO:teuthology.orchestra.run.smithi191.stdout:(11/11): python3-protobuf-3.14.0-13.el9.noarch. 17 kB/s | 269 kB 00:15 2024-04-23T01:36:41.929 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:36:41.929 INFO:teuthology.orchestra.run.smithi191.stdout:Total 472 kB/s | 7.6 MB 00:16 2024-04-23T01:36:41.961 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:36:41.980 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:36:41.980 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:36:42.125 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:36:42.126 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:36:42.606 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:36:42.698 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-23T01:36:42.729 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-23T01:36:42.806 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-23T01:36:42.938 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-23T01:36:42.993 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-23T01:36:43.077 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-23T01:36:43.120 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-23T01:36:43.149 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-23T01:36:43.181 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3192.ga1f34943.el7 9/11 2024-04-23T01:36:44.232 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3192.ga1f34943.el 10/11 2024-04-23T01:36:44.341 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noa 11/11 2024-04-23T01:36:45.552 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noa 11/11 2024-04-23T01:36:45.552 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3192.ga1f34943.el 1/11 2024-04-23T01:36:45.552 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noa 2/11 2024-04-23T01:36:45.552 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3192.ga1f34943.el7 3/11 2024-04-23T01:36:45.553 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-23T01:36:45.553 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-23T01:36:45.553 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-23T01:36:45.553 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-23T01:36:45.553 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-23T01:36:45.553 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-23T01:36:45.553 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-23T01:36:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-23T01:36:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:45.853 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:36:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T01:36:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:45.854 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:36:46.112 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T01:36:46.626 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:59 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:36:46.748 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 7.4 M 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T01:36:46.749 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================= 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout:Install 12 Packages 2024-04-23T01:36:46.750 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:46.751 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 38 M 2024-04-23T01:36:46.751 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 209 M 2024-04-23T01:36:46.751 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:36:47.273 INFO:teuthology.orchestra.run.smithi191.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-04-23T01:36:47.365 INFO:teuthology.orchestra.run.smithi191.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-04-23T01:36:47.399 INFO:teuthology.orchestra.run.smithi191.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 260 kB/s | 33 kB 00:00 2024-04-23T01:36:47.457 INFO:teuthology.orchestra.run.smithi191.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 311 kB/s | 18 kB 00:00 2024-04-23T01:36:47.516 INFO:teuthology.orchestra.run.smithi191.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-04-23T01:36:47.800 INFO:teuthology.orchestra.run.smithi191.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.9 MB/s | 3.0 MB 00:00 2024-04-23T01:36:47.859 INFO:teuthology.orchestra.run.smithi191.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-04-23T01:36:47.968 INFO:teuthology.orchestra.run.smithi191.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2024-04-23T01:36:48.035 INFO:teuthology.orchestra.run.smithi191.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.7 MB/s | 250 kB 00:00 2024-04-23T01:36:48.144 INFO:teuthology.orchestra.run.smithi191.stdout:(10/12): ceph-mgr-diskprediction-local-19.0.0-3 7.3 MB/s | 7.4 MB 00:01 2024-04-23T01:36:48.235 INFO:teuthology.orchestra.run.smithi191.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-04-23T01:36:48.786 INFO:teuthology.orchestra.run.smithi191.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-04-23T01:36:48.787 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:36:48.787 INFO:teuthology.orchestra.run.smithi191.stdout:Total 19 MB/s | 38 MB 00:02 2024-04-23T01:36:49.136 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:36:49.163 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:36:49.163 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:36:49.324 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 33/36 2024-04-23T01:36:49.351 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 33/36 2024-04-23T01:36:49.351 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:49.351 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T01:36:49.351 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T01:36:49.352 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T01:36:49.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:49.570 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:36:49.570 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:36:49.916 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 34/36 2024-04-23T01:36:49.939 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 34/36 2024-04-23T01:36:49.940 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:49.940 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T01:36:49.940 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T01:36:49.940 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T01:36:49.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:50.291 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 35/36 2024-04-23T01:36:50.315 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 35/36 2024-04-23T01:36:50.316 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:36:50.316 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T01:36:50.316 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T01:36:50.316 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T01:36:50.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:50.390 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 36/36 2024-04-23T01:36:50.397 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:36:50.449 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T01:36:50.518 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T01:36:50.617 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T01:36:50.662 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T01:36:50.840 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T01:36:50.869 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T01:36:50.951 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T01:36:51.612 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T01:36:51.727 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T01:36:52.946 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T01:36:53.998 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T01:36:54.019 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34 12/12 2024-04-23T01:36:56.880 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34 12/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34 1/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T01:36:56.881 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 36/36 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 1/36 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 2/36 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 3/36 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 4/36 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 5/36 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3192.ga1f34943.el7. 6/36 2024-04-23T01:36:56.899 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-23T01:36:56.900 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-23T01:36:56.901 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-23T01:36:56.901 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-23T01:36:56.901 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-23T01:36:56.901 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-23T01:36:56.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-23T01:36:56.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-23T01:36:56.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-23T01:36:56.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-23T01:36:56.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-23T01:36:56.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-23T01:36:56.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-23T01:36:56.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-23T01:36:56.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-23T01:36:56.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-23T01:36:57.310 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T01:36:57.310 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:57.310 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:36:57.310 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:36:57.310 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T01:36:57.310 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:57.311 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:36:57.684 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-rook 2024-04-23T01:36:58.004 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-23T01:36:58.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:58.004 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:36:58.004 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T01:36:58.005 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T01:36:58.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:58.007 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:36:58.212 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:11 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:36:58.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2024-04-23T01:36:58.335 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:36:58.336 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 49 k 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T01:36:58.337 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout:Install 13 Packages 2024-04-23T01:36:58.338 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:36:58.339 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 2.2 M 2024-04-23T01:36:58.339 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 26 M 2024-04-23T01:36:58.339 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:36:58.701 INFO:teuthology.orchestra.run.smithi191.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 229 kB/s | 26 kB 00:00 2024-04-23T01:36:58.726 INFO:teuthology.orchestra.run.smithi191.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 140 kB/s | 19 kB 00:00 2024-04-23T01:36:58.835 INFO:teuthology.orchestra.run.smithi191.stdout:(3/13): ceph-mgr-rook-19.0.0-3192.ga1f34943.el7 200 kB/s | 49 kB 00:00 2024-04-23T01:36:58.848 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:10 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:36:58.861 INFO:teuthology.orchestra.run.smithi191.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-23T01:36:58.887 INFO:teuthology.orchestra.run.smithi191.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-04-23T01:36:58.920 INFO:teuthology.orchestra.run.smithi191.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 911 kB/s | 54 kB 00:00 2024-04-23T01:36:58.929 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-base-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:36:58.973 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:36:58.975 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:36:58.975 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:36:59.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install cephadm 2024-04-23T01:36:59.070 INFO:teuthology.orchestra.run.smithi191.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 175 kB/s | 32 kB 00:00 2024-04-23T01:36:59.096 INFO:teuthology.orchestra.run.smithi191.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 85 kB/s | 15 kB 00:00 2024-04-23T01:36:59.138 INFO:teuthology.orchestra.run.smithi191.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 923 kB/s | 279 kB 00:00 2024-04-23T01:36:59.296 INFO:teuthology.orchestra.run.smithi191.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 896 kB/s | 203 kB 00:00 2024-04-23T01:36:59.322 INFO:teuthology.orchestra.run.smithi191.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 322 kB/s | 59 kB 00:00 2024-04-23T01:36:59.372 INFO:teuthology.orchestra.run.smithi191.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-04-23T01:36:59.440 INFO:teuthology.orchestra.run.smithi191.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.0 MB/s | 1.0 MB 00:00 2024-04-23T01:36:59.440 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:36:59.440 INFO:teuthology.orchestra.run.smithi191.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-04-23T01:36:59.502 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:36:59.517 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:36:59.518 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:36:59.567 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:11 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:36:59.601 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:36:59.602 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:36:59.692 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 762 k 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-23T01:36:59.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:36:59.694 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 762 k 2024-04-23T01:36:59.694 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 769 k 2024-04-23T01:36:59.694 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:00.033 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm-19.0.0-3192.ga1f34943.el7.noarch.rpm 2.2 MB/s | 762 kB 00:00 2024-04-23T01:37:00.033 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:00.033 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.2 MB/s | 762 kB 00:00 2024-04-23T01:37:00.034 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:00.039 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:00.039 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:00.045 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:00.046 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:00.118 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:00.127 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:00.286 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T01:37:00.350 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T01:37:00.414 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T01:37:00.452 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T01:37:00.492 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T01:37:00.518 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:37:00.596 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T01:37:00.604 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:37:00.698 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-23T01:37:00.753 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T01:37:01.084 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:37:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/1 2024-04-23T01:37:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:01.323 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:01.323 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:01.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:01.324 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:01.469 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T01:37:01.520 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T01:37:01.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T01:37:01.554 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T01:37:01.602 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T01:37:01.633 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 13/13 2024-04-23T01:37:02.082 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:14 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:02.208 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 157 k 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:02.209 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:02.210 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-23T01:37:02.210 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:02.210 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 157 k 2024-04-23T01:37:02.210 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 640 k 2024-04-23T01:37:02.210 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 13/13 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 1/13 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T01:37:02.419 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T01:37:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T01:37:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T01:37:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-23T01:37:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T01:37:02.420 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T01:37:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-immutable-object-cache-19.0.0-3192.ga1f349 352 kB/s | 157 kB 00:00 2024-04-23T01:37:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:Total 351 kB/s | 157 kB 00:00 2024-04-23T01:37:02.657 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:02.667 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:02.668 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:02.732 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T01:37:02.732 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:02.732 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T01:37:02.733 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T01:37:02.734 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T01:37:02.734 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:02.734 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:02.978 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T01:37:02.993 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:03.090 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943. 1/1 2024-04-23T01:37:03.116 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943. 1/1 2024-04-23T01:37:03.116 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:37:03.116 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T01:37:03.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:03.493 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:16 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:03.614 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 142 k 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T01:37:03.615 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T01:37:03.616 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T01:37:03.616 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:03.616 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:03.616 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:03.616 INFO:teuthology.orchestra.run.smithi191.stdout:Install 6 Packages 2024-04-23T01:37:03.616 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:03.617 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 7.0 M 2024-04-23T01:37:03.617 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 33 M 2024-04-23T01:37:03.617 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:04.065 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943. 1/1 2024-04-23T01:37:04.065 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:04.065 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:04.065 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:04.065 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:04.065 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:04.074 INFO:teuthology.orchestra.run.smithi191.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-04-23T01:37:04.241 INFO:teuthology.orchestra.run.smithi191.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.2 MB/s | 548 kB 00:00 2024-04-23T01:37:04.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2024-04-23T01:37:04.325 INFO:teuthology.orchestra.run.smithi191.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-04-23T01:37:04.342 INFO:teuthology.orchestra.run.smithi191.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 572 kB/s | 58 kB 00:00 2024-04-23T01:37:04.409 INFO:teuthology.orchestra.run.smithi191.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 610 kB/s | 51 kB 00:00 2024-04-23T01:37:04.460 INFO:teuthology.orchestra.run.smithi191.stdout:(6/6): ceph-mgr-cephadm-19.0.0-3192.ga1f34943.e 255 kB/s | 142 kB 00:00 2024-04-23T01:37:04.461 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:04.461 INFO:teuthology.orchestra.run.smithi191.stdout:Total 8.3 MB/s | 7.0 MB 00:00 2024-04-23T01:37:04.530 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:04.541 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:04.542 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:04.638 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:04.639 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:04.812 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:16 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:04.895 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-mgr-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:04.939 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:04.940 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:37:04.940 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:04.943 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:05.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T01:37:05.126 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T01:37:05.187 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T01:37:05.532 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:17 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:05.657 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:05.658 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:05.658 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:37:05.658 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 3.5 M 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 34 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 16 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T01:37:05.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:05.660 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:05.660 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:05.660 INFO:teuthology.orchestra.run.smithi037.stdout:Install 11 Packages 2024-04-23T01:37:05.660 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:05.660 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 7.6 M 2024-04-23T01:37:05.660 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 100 M 2024-04-23T01:37:05.660 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:05.708 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T01:37:05.807 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T01:37:05.879 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T01:37:05.909 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 6/6 2024-04-23T01:37:06.741 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 6/6 2024-04-23T01:37:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/6 2024-04-23T01:37:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T01:37:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T01:37:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T01:37:06.742 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T01:37:06.876 INFO:teuthology.orchestra.run.smithi037.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3192.ga1 58 kB/s | 34 kB 00:00 2024-04-23T01:37:06.901 INFO:teuthology.orchestra.run.smithi037.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3192.ga1f 27 kB/s | 16 kB 00:00 2024-04-23T01:37:06.989 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T01:37:06.989 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:06.989 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:06.990 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:07.202 INFO:teuthology.orchestra.run.smithi037.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 828 kB/s | 269 kB 00:00 2024-04-23T01:37:07.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-fuse 2024-04-23T01:37:07.764 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:20 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:07.818 INFO:teuthology.orchestra.run.smithi037.stdout:(4/11): ceph-mgr-dashboard-19.0.0-3192.ga1f3494 2.3 MB/s | 3.5 MB 00:01 2024-04-23T01:37:07.844 INFO:teuthology.orchestra.run.smithi037.stdout:(5/11): protobuf-compiler-3.14.0-13.el9.x86_64. 916 kB/s | 863 kB 00:00 2024-04-23T01:37:07.877 INFO:teuthology.orchestra.run.smithi037.stdout:(6/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 811 kB/s | 548 kB 00:00 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 871 k 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T01:37:07.885 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:07.886 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:07.886 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:07.886 INFO:teuthology.orchestra.run.smithi191.stdout:Install 2 Packages 2024-04-23T01:37:07.886 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:07.886 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 951 k 2024-04-23T01:37:07.886 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 4.0 M 2024-04-23T01:37:07.887 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:07.903 INFO:teuthology.orchestra.run.smithi037.stdout:(7/11): grpc-data-1.46.7-10.el9.noarch.rpm 232 kB/s | 19 kB 00:00 2024-04-23T01:37:07.953 INFO:teuthology.orchestra.run.smithi037.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 618 kB/s | 31 kB 00:00 2024-04-23T01:37:08.012 INFO:teuthology.orchestra.run.smithi037.stdout:(9/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.1 MB/s | 144 kB 00:00 2024-04-23T01:37:08.062 INFO:teuthology.orchestra.run.smithi037.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-04-23T01:37:08.395 INFO:teuthology.orchestra.run.smithi037.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.7 MB/s | 2.0 MB 00:00 2024-04-23T01:37:08.397 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:08.398 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.8 MB/s | 7.6 MB 00:02 2024-04-23T01:37:08.432 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:08.609 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:08.610 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:08.691 INFO:teuthology.orchestra.run.smithi191.stdout:(1/2): ceph-fuse-19.0.0-3192.ga1f34943.el7.x86_ 1.3 MB/s | 871 kB 00:00 2024-04-23T01:37:08.758 INFO:teuthology.orchestra.run.smithi191.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 111 kB/s | 80 kB 00:00 2024-04-23T01:37:08.758 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:08.758 INFO:teuthology.orchestra.run.smithi191.stdout:Total 1.1 MB/s | 951 kB 00:00 2024-04-23T01:37:08.770 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:08.795 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:08.795 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:08.872 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:08.873 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:09.054 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:09.096 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:09.170 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-23T01:37:09.199 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-23T01:37:09.209 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T01:37:09.278 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 2/2 2024-04-23T01:37:09.279 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-23T01:37:09.415 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-23T01:37:09.469 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-23T01:37:09.557 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-23T01:37:09.605 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-23T01:37:09.641 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-23T01:37:09.673 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3192.ga1f34943.el7 9/11 2024-04-23T01:37:09.896 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 2/2 2024-04-23T01:37:09.896 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/2 2024-04-23T01:37:10.148 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T01:37:10.148 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:10.148 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:10.148 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T01:37:10.149 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:10.149 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:10.414 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-volume 2024-04-23T01:37:10.780 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3192.ga1f34943.el 10/11 2024-04-23T01:37:10.823 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noa 11/11 2024-04-23T01:37:10.943 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:23 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:11.066 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:11.066 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:11.066 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-04-23T01:37:11.066 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:11.066 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:11.070 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 273 k 2024-04-23T01:37:11.070 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-04-23T01:37:11.070 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T01:37:11.070 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:11.070 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:11.071 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:11.071 INFO:teuthology.orchestra.run.smithi191.stdout:Install 2 Packages 2024-04-23T01:37:11.071 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:11.071 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 350 k 2024-04-23T01:37:11.071 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 1.5 M 2024-04-23T01:37:11.071 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:11.227 INFO:teuthology.orchestra.run.smithi191.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 871 kB/s | 77 kB 00:00 2024-04-23T01:37:11.619 INFO:teuthology.orchestra.run.smithi191.stdout:(2/2): ceph-volume-19.0.0-3192.ga1f34943.el7.no 568 kB/s | 273 kB 00:00 2024-04-23T01:37:11.619 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:11.620 INFO:teuthology.orchestra.run.smithi191.stdout:Total 633 kB/s | 350 kB 00:00 2024-04-23T01:37:11.631 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:11.641 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:11.641 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:11.667 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:11.668 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:11.823 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:12.018 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-23T01:37:12.064 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 2/2 2024-04-23T01:37:12.079 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 2/2 2024-04-23T01:37:12.079 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:37:12.079 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T01:37:12.080 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noa 11/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3192.ga1f34943.el 1/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noa 2/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3192.ga1f34943.el7 3/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-23T01:37:12.085 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-23T01:37:12.382 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-23T01:37:12.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T01:37:12.383 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T01:37:12.384 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:12.384 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:12.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T01:37:12.758 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 1/2 2024-04-23T01:37:13.020 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-23T01:37:13.020 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:13.020 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:13.020 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:13.020 INFO:teuthology.orchestra.run.smithi191.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T01:37:13.020 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:13.021 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:13.162 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:25 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:13.291 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 7.4 M 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T01:37:13.292 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout:Install 12 Packages 2024-04-23T01:37:13.293 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 38 M 2024-04-23T01:37:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 209 M 2024-04-23T01:37:13.294 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:13.319 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librados-devel 2024-04-23T01:37:13.836 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:26 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:13.961 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:13.962 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:13.962 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-04-23T01:37:13.962 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:13.962 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 125 k 2024-04-23T01:37:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:13.963 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:13.963 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:13.963 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-04-23T01:37:13.963 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:13.963 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 125 k 2024-04-23T01:37:13.964 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 445 k 2024-04-23T01:37:13.964 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:14.189 INFO:teuthology.orchestra.run.smithi191.stdout:librados-devel-19.0.0-3192.ga1f34943.el7.x86_64 551 kB/s | 125 kB 00:00 2024-04-23T01:37:14.190 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:14.190 INFO:teuthology.orchestra.run.smithi191.stdout:Total 547 kB/s | 125 kB 00:00 2024-04-23T01:37:14.190 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:14.196 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:14.196 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:14.258 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:14.259 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:14.354 INFO:teuthology.orchestra.run.smithi037.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 223 kB/s | 195 kB 00:00 2024-04-23T01:37:14.413 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:14.471 INFO:teuthology.orchestra.run.smithi037.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 281 kB/s | 33 kB 00:00 2024-04-23T01:37:14.519 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:14.763 INFO:teuthology.orchestra.run.smithi037.stdout:(3/12): ceph-mgr-diskprediction-local-19.0.0-31 5.7 MB/s | 7.4 MB 00:01 2024-04-23T01:37:14.855 INFO:teuthology.orchestra.run.smithi037.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 199 kB/s | 18 kB 00:00 2024-04-23T01:37:14.941 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:14.947 INFO:teuthology.orchestra.run.smithi037.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 385 kB/s | 35 kB 00:00 2024-04-23T01:37:15.072 INFO:teuthology.orchestra.run.smithi037.stdout:(6/12): libgfortran-11.4.1-3.el9.x86_64.rpm 504 kB/s | 803 kB 00:01 2024-04-23T01:37:15.180 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:15.180 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:15.180 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:15.180 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:15.180 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:15.180 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:15.264 INFO:teuthology.orchestra.run.smithi037.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-04-23T01:37:15.358 INFO:teuthology.orchestra.run.smithi037.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.4 MB/s | 3.0 MB 00:00 2024-04-23T01:37:15.461 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install libcephfs2 2024-04-23T01:37:15.464 INFO:teuthology.orchestra.run.smithi037.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 250 kB 00:00 2024-04-23T01:37:15.589 INFO:teuthology.orchestra.run.smithi037.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 7.4 MB/s | 4.7 MB 00:00 2024-04-23T01:37:15.865 INFO:teuthology.orchestra.run.smithi037.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.5 MB/s | 5.1 MB 00:00 2024-04-23T01:37:15.985 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:28 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:16.066 INFO:teuthology.orchestra.run.smithi191.stdout:Package libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:16.107 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:16.108 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:37:16.108 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:16.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install libcephfs-devel 2024-04-23T01:37:16.702 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:29 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:16.822 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 32 k 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:16.823 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-04-23T01:37:16.824 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:16.824 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 32 k 2024-04-23T01:37:16.824 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 142 k 2024-04-23T01:37:16.824 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:17.374 INFO:teuthology.orchestra.run.smithi191.stdout:libcephfs-devel-19.0.0-3192.ga1f34943.el7.x86_6 58 kB/s | 32 kB 00:00 2024-04-23T01:37:17.375 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:17.375 INFO:teuthology.orchestra.run.smithi191.stdout:Total 57 kB/s | 32 kB 00:00 2024-04-23T01:37:17.375 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:17.379 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:17.379 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:17.381 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:17.381 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:17.469 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:17.587 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:17.932 INFO:teuthology.orchestra.run.smithi037.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-04-23T01:37:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:Total 8.2 MB/s | 38 MB 00:04 2024-04-23T01:37:17.950 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:18.161 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:18.162 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:18.162 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:18.162 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:18.162 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:18.162 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:18.300 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:18.328 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:18.328 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:18.356 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librados2 2024-04-23T01:37:18.769 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:18.769 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:18.872 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:31 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:18.951 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:18.993 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:18.994 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:37:18.994 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:19.083 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librbd1 2024-04-23T01:37:19.598 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:32 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:19.602 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:19.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T01:37:19.718 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:19.718 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T01:37:19.719 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:19.720 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:37:19.720 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:19.791 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rados 2024-04-23T01:37:19.813 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T01:37:19.848 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T01:37:20.035 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T01:37:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T01:37:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T01:37:20.310 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:33 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:20.389 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:20.430 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:20.431 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:37:20.431 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:20.501 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rgw 2024-04-23T01:37:20.859 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T01:37:21.005 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T01:37:21.014 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:34 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:21.093 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:21.134 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:21.135 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:37:21.135 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:21.208 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-cephfs 2024-04-23T01:37:21.720 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:34 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:21.800 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:21.841 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:21.841 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:37:21.842 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:21.913 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rbd 2024-04-23T01:37:22.339 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T01:37:22.428 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:35 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:22.507 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:22.548 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:22.549 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2024-04-23T01:37:22.549 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:22.616 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-fuse 2024-04-23T01:37:23.124 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:36 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:23.244 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:23.245 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-23T01:37:23.245 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:23.245 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 90 k 2024-04-23T01:37:23.245 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:23.245 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:23.246 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:23.246 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-04-23T01:37:23.246 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:23.246 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 90 k 2024-04-23T01:37:23.246 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 313 k 2024-04-23T01:37:23.246 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:23.448 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T01:37:23.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34 12/12 2024-04-23T01:37:24.037 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-fuse-19.0.0-3192.ga1f34943.el7.x86_64.rpm 114 kB/s | 90 kB 00:00 2024-04-23T01:37:24.037 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:24.038 INFO:teuthology.orchestra.run.smithi191.stdout:Total 113 kB/s | 90 kB 00:00 2024-04-23T01:37:24.038 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:24.048 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:24.048 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:24.113 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:24.113 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:24.258 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:24.376 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:24.757 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:25.009 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:25.009 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:25.010 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:25.010 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:25.010 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:25.010 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:25.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-mirror 2024-04-23T01:37:25.786 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:38 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:25.873 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34 12/12 2024-04-23T01:37:25.873 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34 1/12 2024-04-23T01:37:25.873 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T01:37:25.873 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T01:37:25.873 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T01:37:25.874 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T01:37:25.874 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T01:37:25.874 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T01:37:25.874 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T01:37:25.874 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T01:37:25.874 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T01:37:25.874 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T01:37:25.919 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:25.920 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:25.920 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2024-04-23T01:37:25.920 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 3.4 M 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 3.4 M 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 29 M 2024-04-23T01:37:25.921 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:26.257 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T01:37:26.257 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:26.257 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:26.257 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:26.257 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T01:37:26.258 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T01:37:26.259 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T01:37:26.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:26.259 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:26.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-rook 2024-04-23T01:37:27.199 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:39 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:27.325 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 49 k 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T01:37:27.326 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:27.327 INFO:teuthology.orchestra.run.smithi037.stdout:Install 13 Packages 2024-04-23T01:37:27.328 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:27.328 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.2 M 2024-04-23T01:37:27.328 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 26 M 2024-04-23T01:37:27.328 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:28.362 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-mirror-19.0.0-3192.ga1f34943.el7.x86_64.rpm 1.4 MB/s | 3.4 MB 00:02 2024-04-23T01:37:28.363 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:28.363 INFO:teuthology.orchestra.run.smithi191.stdout:Total 1.4 MB/s | 3.4 MB 00:02 2024-04-23T01:37:28.363 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:28.376 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:28.376 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:28.381 INFO:teuthology.orchestra.run.smithi037.stdout:(1/13): ceph-mgr-rook-19.0.0-3192.ga1f34943.el7 91 kB/s | 49 kB 00:00 2024-04-23T01:37:28.406 INFO:teuthology.orchestra.run.smithi037.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 34 kB/s | 19 kB 00:00 2024-04-23T01:37:28.461 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:28.462 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:28.499 INFO:teuthology.orchestra.run.smithi037.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 39 kB/s | 26 kB 00:00 2024-04-23T01:37:29.062 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:29.129 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:29.154 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:29.154 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:37:29.154 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T01:37:29.154 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T01:37:29.154 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T01:37:29.155 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:29.257 INFO:teuthology.orchestra.run.smithi037.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 254 kB/s | 222 kB 00:00 2024-04-23T01:37:29.282 INFO:teuthology.orchestra.run.smithi037.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 181 kB/s | 159 kB 00:00 2024-04-23T01:37:29.366 INFO:teuthology.orchestra.run.smithi037.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 387 kB/s | 32 kB 00:00 2024-04-23T01:37:29.408 INFO:teuthology.orchestra.run.smithi037.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 360 kB/s | 15 kB 00:00 2024-04-23T01:37:29.491 INFO:teuthology.orchestra.run.smithi037.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 281 kB/s | 279 kB 00:00 2024-04-23T01:37:29.541 INFO:teuthology.orchestra.run.smithi037.stdout:(9/13): python3-google-auth-2.28.2-1.el9.noarch 1.5 MB/s | 203 kB 00:00 2024-04-23T01:37:29.575 INFO:teuthology.orchestra.run.smithi037.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-04-23T01:37:29.634 INFO:teuthology.orchestra.run.smithi037.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-04-23T01:37:29.809 INFO:teuthology.orchestra.run.smithi037.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.5 MB/s | 1.0 MB 00:00 2024-04-23T01:37:29.919 INFO:teuthology.orchestra.run.smithi037.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 81 kB/s | 54 kB 00:00 2024-04-23T01:37:29.919 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:29.919 INFO:teuthology.orchestra.run.smithi037.stdout:Total 868 kB/s | 2.2 MB 00:02 2024-04-23T01:37:29.991 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:30.009 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:30.009 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:30.103 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:30.103 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:30.386 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:30.386 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:30.386 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:30.386 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:30.386 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:30.386 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:30.625 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:30.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-nbd 2024-04-23T01:37:30.803 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T01:37:30.863 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T01:37:30.927 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T01:37:30.962 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T01:37:31.004 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T01:37:31.103 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T01:37:31.162 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:44 ago on Tue 23 Apr 2024 01:34:47 AM UTC. 2024-04-23T01:37:31.215 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-23T01:37:31.272 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 175 k 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2024-04-23T01:37:31.289 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:31.290 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 175 k 2024-04-23T01:37:31.290 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 673 k 2024-04-23T01:37:31.290 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-04-23T01:37:31.562 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-nbd-19.0.0-3192.ga1f34943.el7.x86_64.rpm 642 kB/s | 175 kB 00:00 2024-04-23T01:37:31.563 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:31.563 INFO:teuthology.orchestra.run.smithi191.stdout:Total 639 kB/s | 175 kB 00:00 2024-04-23T01:37:31.563 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-04-23T01:37:31.572 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-04-23T01:37:31.573 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-04-23T01:37:31.641 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-04-23T01:37:31.641 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-04-23T01:37:31.826 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-04-23T01:37:31.934 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:32.037 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T01:37:32.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T01:37:32.128 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T01:37:32.177 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T01:37:32.205 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 13/13 2024-04-23T01:37:32.309 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:32.562 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:32.562 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:32.562 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-04-23T01:37:32.563 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:32.563 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:37:32.563 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-04-23T01:37:32.809 DEBUG:teuthology.parallel:result is None 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 13/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 1/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T01:37:32.995 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-23T01:37:32.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T01:37:32.996 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T01:37:33.329 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T01:37:33.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:33.329 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:33.329 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:33.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T01:37:33.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T01:37:33.329 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:33.330 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:33.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T01:37:34.109 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:46 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:34.237 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:34.238 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:34.238 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:37:34.238 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:34.238 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 142 k 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2024-04-23T01:37:34.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:34.240 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 7.0 M 2024-04-23T01:37:34.240 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 33 M 2024-04-23T01:37:34.240 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:34.944 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3192.ga1f34943.e 673 kB/s | 142 kB 00:00 2024-04-23T01:37:35.578 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 865 kB/s | 548 kB 00:00 2024-04-23T01:37:35.670 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 629 kB/s | 58 kB 00:00 2024-04-23T01:37:35.720 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 251 kB/s | 248 kB 00:00 2024-04-23T01:37:35.771 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 510 kB/s | 51 kB 00:00 2024-04-23T01:37:43.353 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 708 kB/s | 6.0 MB 00:08 2024-04-23T01:37:43.355 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:43.356 INFO:teuthology.orchestra.run.smithi037.stdout:Total 785 kB/s | 7.0 MB 00:09 2024-04-23T01:37:43.431 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:43.444 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:43.444 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:43.547 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:43.548 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:43.868 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:44.053 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T01:37:44.106 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T01:37:44.664 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T01:37:44.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T01:37:44.815 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T01:37:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 6/6 2024-04-23T01:37:45.518 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 6/6 2024-04-23T01:37:45.519 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 1/6 2024-04-23T01:37:45.519 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T01:37:45.519 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T01:37:45.519 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T01:37:45.519 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T01:37:45.804 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:45.805 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:46.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2024-04-23T01:37:46.599 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:58 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:46.726 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:46.726 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:46.726 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:37:46.726 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:46.726 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:46.726 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 871 k 2024-04-23T01:37:46.727 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:37:46.727 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T01:37:46.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:46.727 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:46.727 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:46.727 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2024-04-23T01:37:46.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:46.728 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 951 k 2024-04-23T01:37:46.728 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 4.0 M 2024-04-23T01:37:46.728 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:46.947 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-04-23T01:37:47.922 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): ceph-fuse-19.0.0-3192.ga1f34943.el7.x86_ 773 kB/s | 871 kB 00:01 2024-04-23T01:37:47.923 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:47.923 INFO:teuthology.orchestra.run.smithi037.stdout:Total 795 kB/s | 951 kB 00:01 2024-04-23T01:37:47.937 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:47.966 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:47.966 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:48.052 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:48.052 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:48.250 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:48.413 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T01:37:48.481 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 2/2 2024-04-23T01:37:49.189 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 2/2 2024-04-23T01:37:49.189 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/2 2024-04-23T01:37:49.499 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T01:37:49.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:49.499 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:49.499 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T01:37:49.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:49.500 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:49.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-volume 2024-04-23T01:37:50.289 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:02 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:50.419 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:50.419 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:50.419 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-23T01:37:50.419 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-3192.ga1f34943.el7 ceph-noarch 273 k 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2024-04-23T01:37:50.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:50.421 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 350 k 2024-04-23T01:37:50.421 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 1.5 M 2024-04-23T01:37:50.421 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:51.186 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 111 kB/s | 77 kB 00:00 2024-04-23T01:37:51.211 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): ceph-volume-19.0.0-3192.ga1f34943.el7.no 379 kB/s | 273 kB 00:00 2024-04-23T01:37:51.211 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:51.211 INFO:teuthology.orchestra.run.smithi037.stdout:Total 442 kB/s | 350 kB 00:00 2024-04-23T01:37:51.224 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:51.235 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:51.235 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:51.264 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:51.264 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:51.410 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:51.600 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-23T01:37:51.643 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 2/2 2024-04-23T01:37:51.658 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 2/2 2024-04-23T01:37:51.658 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:37:51.659 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T01:37:51.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:52.374 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 1/2 2024-04-23T01:37:52.676 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-23T01:37:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:52.677 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-3192.ga1f34943.el7.noarch 2024-04-23T01:37:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T01:37:52.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:52.677 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:52.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2024-04-23T01:37:53.519 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:05 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:53.644 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 125 k 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:53.645 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:53.646 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-23T01:37:53.646 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:53.646 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 125 k 2024-04-23T01:37:53.646 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 445 k 2024-04-23T01:37:53.646 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:54.008 INFO:teuthology.orchestra.run.smithi037.stdout:librados-devel-19.0.0-3192.ga1f34943.el7.x86_64 346 kB/s | 125 kB 00:00 2024-04-23T01:37:54.008 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:54.008 INFO:teuthology.orchestra.run.smithi037.stdout:Total 344 kB/s | 125 kB 00:00 2024-04-23T01:37:54.009 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:54.014 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:54.015 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:54.082 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:54.082 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:55.049 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:55.049 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:55.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2024-04-23T01:37:55.785 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:07 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:55.867 INFO:teuthology.orchestra.run.smithi037.stdout:Package libcephfs2-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:55.911 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:55.914 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:37:55.914 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:55.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2024-04-23T01:37:56.519 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:08 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:56.644 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:56.644 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 32 k 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 32 k 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 142 k 2024-04-23T01:37:56.645 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:37:57.128 INFO:teuthology.orchestra.run.smithi037.stdout:libcephfs-devel-19.0.0-3192.ga1f34943.el7.x86_6 66 kB/s | 32 kB 00:00 2024-04-23T01:37:57.128 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:37:57.128 INFO:teuthology.orchestra.run.smithi037.stdout:Total 65 kB/s | 32 kB 00:00 2024-04-23T01:37:57.129 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:37:57.132 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:37:57.133 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:37:57.135 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:37:57.135 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:37:57.218 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:37:57.326 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:37:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:58.009 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:37:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:37:58.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:37:58.009 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:58.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2024-04-23T01:37:58.708 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:10 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:58.791 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:58.836 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:58.837 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:37:58.837 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:58.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2024-04-23T01:37:59.443 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:11 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:37:59.526 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:37:59.569 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:37:59.570 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:37:59.570 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:37:59.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rados 2024-04-23T01:38:00.171 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:12 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:38:00.252 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rados-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:38:00.295 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:38:00.296 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:38:00.296 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:38:00.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rgw 2024-04-23T01:38:00.906 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:12 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:38:00.988 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rgw-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:38:01.032 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:38:01.032 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:38:01.032 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:38:01.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-cephfs 2024-04-23T01:38:01.634 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:13 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:38:01.715 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-cephfs-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:38:01.758 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:38:01.759 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:38:01.759 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:38:01.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rbd 2024-04-23T01:38:02.359 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:14 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:38:02.440 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rbd-2:19.0.0-3192.ga1f34943.el7.x86_64 is already installed. 2024-04-23T01:38:02.483 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:38:02.484 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-23T01:38:02.484 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:38:02.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2024-04-23T01:38:03.076 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:15 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:38:03.201 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:38:03.201 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-23T01:38:03.201 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:03.201 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:38:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 90 k 2024-04-23T01:38:03.201 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:03.202 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:38:03.202 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:03.202 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-23T01:38:03.202 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:03.202 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 90 k 2024-04-23T01:38:03.202 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 313 k 2024-04-23T01:38:03.203 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:38:03.631 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-fuse-19.0.0-3192.ga1f34943.el7.x86_64.rpm 210 kB/s | 90 kB 00:00 2024-04-23T01:38:03.632 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:38:03.632 INFO:teuthology.orchestra.run.smithi037.stdout:Total 209 kB/s | 90 kB 00:00 2024-04-23T01:38:03.632 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:38:03.642 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:38:03.642 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:38:03.710 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:38:03.710 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:38:03.861 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:38:03.972 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:04.311 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:04.574 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:04.575 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:04.575 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:38:04.575 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:38:04.575 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:04.575 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:38:04.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2024-04-23T01:38:05.412 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:17 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:38:05.537 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:38:05.538 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:05.538 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-23T01:38:05.538 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 3.4 M 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 3.4 M 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 29 M 2024-04-23T01:38:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:38:06.659 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-mirror-19.0.0-3192.ga1f34943.el7.x86_64.rpm 3.0 MB/s | 3.4 MB 00:01 2024-04-23T01:38:06.660 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:38:06.661 INFO:teuthology.orchestra.run.smithi037.stdout:Total 3.0 MB/s | 3.4 MB 00:01 2024-04-23T01:38:06.661 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:38:06.674 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:38:06.674 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:38:06.763 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:38:06.764 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:38:07.372 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:38:07.418 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:07.444 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:07.444 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T01:38:07.444 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T01:38:07.444 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T01:38:07.444 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T01:38:07.445 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:08.582 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:08.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:08.582 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:38:08.583 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:38:08.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:08.583 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:38:08.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2024-04-23T01:38:09.338 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:03:21 ago on Tue 23 Apr 2024 01:34:48 AM UTC. 2024-04-23T01:38:09.464 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-3192.ga1f34943.el7 ceph 175 k 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-23T01:38:09.465 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-23T01:38:09.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:09.466 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 175 k 2024-04-23T01:38:09.466 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 673 k 2024-04-23T01:38:09.466 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-23T01:38:09.687 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-nbd-19.0.0-3192.ga1f34943.el7.x86_64.rpm 793 kB/s | 175 kB 00:00 2024-04-23T01:38:09.688 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-23T01:38:09.688 INFO:teuthology.orchestra.run.smithi037.stdout:Total 787 kB/s | 175 kB 00:00 2024-04-23T01:38:09.688 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-23T01:38:09.699 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-23T01:38:09.699 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-23T01:38:09.772 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-23T01:38:09.773 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-23T01:38:09.932 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-23T01:38:10.036 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:10.432 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:10.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 1/1 2024-04-23T01:38:10.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:10.639 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-23T01:38:10.639 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-3192.ga1f34943.el7.x86_64 2024-04-23T01:38:10.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:10.640 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-23T01:38:10.857 DEBUG:teuthology.parallel:result is None 2024-04-23T01:38:10.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 2024-04-23T01:38:11.083 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T01:38:11.105 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-3192.ga1f34943.el7 2024-04-23T01:38:11.105 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3192.ga1f34943.el7 2024-04-23T01:38:11.106 INFO:teuthology.task.install:The correct ceph version 19.0.0-3192.ga1f34943 is installed. 2024-04-23T01:38:11.109 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 2024-04-23T01:38:11.256 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T01:38:11.280 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-3192.ga1f34943.el7 2024-04-23T01:38:11.281 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3192.ga1f34943.el7 2024-04-23T01:38:11.281 INFO:teuthology.task.install:The correct ceph version 19.0.0-3192.ga1f34943 is installed. 2024-04-23T01:38:11.283 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T01:38:11.283 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:11.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T01:38:11.309 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:11.309 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T01:38:11.349 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T01:38:11.350 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:11.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T01:38:11.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T01:38:11.440 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:11.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T01:38:11.468 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T01:38:11.534 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T01:38:11.535 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:11.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T01:38:11.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T01:38:11.623 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:11.623 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T01:38:11.650 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T01:38:11.716 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T01:38:11.716 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:11.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T01:38:11.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T01:38:11.806 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:11.806 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T01:38:11.829 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T01:38:11.893 INFO:teuthology.run_tasks:Running task ceph... 2024-04-23T01:38:11.987 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-23T01:38:11.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-04-23T01:38:11.989 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2024-04-23T01:38:12.013 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-23T01:38:12.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T01:38:12.054 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T01:38:12.080 INFO:tasks.ceph:Creating extra log directories... 2024-04-23T01:38:12.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T01:38:12.118 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T01:38:12.153 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-23T01:38:12.153 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-23T01:38:12.153 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446', 'branch': 'ci-yingxin-crimson-fix-tri-mutex-4', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': 'yingxin.cheng@intel.com', 'first_in_suite': False, 'job_id': '7669446', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'ci-yingxin-crimson-fix-tri-mutex-4'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'ci-yingxin-crimson-fix-tri-mutex-4', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4'}}, 'owner': 'scheduled_yingxin@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'ci-yingxin-crimson-fix-tri-mutex-4', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSUQEpbD0ApnW8N2EXlroGNHoD0dWM8HvLpKpKcos98yQMcXP9EbwbYa+ql9najApjWBYFQ0D9eqqAfiP0z+ck=', 'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIf4m5Di6CFs21haxdg9spYMEs9e5bMxXtlxNrdN/THWapEabvQECegR9AZLAK2Jo9ZyKq/8Vnn4nx7JZkVBUgY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_01:23:55', 'tube': 'smithi', 'user': 'yingxin', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-23T01:38:12.154 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T01:38:12.183 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T01:38:12.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T01:38:12.238 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T01:38:12.261 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:12.262 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T01:38:12.320 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T01:38:12.320 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-04-23T01:38:12.374 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T01:38:12.374 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:12.374 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-23T01:38:12.375 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:12.375 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:12.375 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-23 01:38:07.682965524 +0000 2024-04-23T01:38:12.375 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-23 01:33:46.357432140 +0000 2024-04-23T01:38:12.375 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-23 01:33:46.357432140 +0000 2024-04-23T01:38:12.375 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-23 01:33:46.357432140 +0000 2024-04-23T01:38:12.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T01:38:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-23T01:38:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-23T01:38:12.438 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000262202 s, 2.0 MB/s 2024-04-23T01:38:12.439 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T01:38:12.495 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-04-23T01:38:12.551 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T01:38:12.551 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:12.552 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-23T01:38:12.552 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:12.552 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:12.552 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-23 01:38:07.682965524 +0000 2024-04-23T01:38:12.552 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-23 01:33:46.692427372 +0000 2024-04-23T01:38:12.552 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-23 01:33:46.692427372 +0000 2024-04-23T01:38:12.553 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-23 01:33:46.692427372 +0000 2024-04-23T01:38:12.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T01:38:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-23T01:38:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-23T01:38:12.615 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000220415 s, 2.3 MB/s 2024-04-23T01:38:12.617 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T01:38:12.674 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-04-23T01:38:12.731 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T01:38:12.731 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:12.731 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-23T01:38:12.731 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:12.732 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:12.732 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-23 01:38:07.683965511 +0000 2024-04-23T01:38:12.732 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-23 01:33:47.039422434 +0000 2024-04-23T01:38:12.732 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-23 01:33:47.039422434 +0000 2024-04-23T01:38:12.732 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-23 01:33:47.039422434 +0000 2024-04-23T01:38:12.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T01:38:12.794 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-23T01:38:12.794 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-23T01:38:12.794 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000183983 s, 2.8 MB/s 2024-04-23T01:38:12.795 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T01:38:12.851 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-23 01:38:07.683965511 +0000 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-23 01:33:47.386417495 +0000 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-23 01:33:47.386417495 +0000 2024-04-23T01:38:12.907 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-23 01:33:47.386417495 +0000 2024-04-23T01:38:12.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T01:38:12.970 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-23T01:38:12.970 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-23T01:38:12.970 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000211323 s, 2.4 MB/s 2024-04-23T01:38:12.971 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T01:38:13.027 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-23T01:38:13.027 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:13.027 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T01:38:13.043 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T01:38:13.043 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-23 01:37:29.396103203 +0000 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-23 01:33:42.043325982 +0000 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-23 01:33:42.043325982 +0000 2024-04-23T01:38:13.099 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-23 01:33:42.043325982 +0000 2024-04-23T01:38:13.099 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T01:38:13.161 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-23T01:38:13.161 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-23T01:38:13.161 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000209295 s, 2.4 MB/s 2024-04-23T01:38:13.162 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T01:38:13.218 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-04-23T01:38:13.273 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T01:38:13.273 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:13.273 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-23T01:38:13.273 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:13.274 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:13.274 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-23 01:37:29.397103186 +0000 2024-04-23T01:38:13.274 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-23 01:33:42.384319979 +0000 2024-04-23T01:38:13.274 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-23 01:33:42.384319979 +0000 2024-04-23T01:38:13.274 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-23 01:33:42.384319979 +0000 2024-04-23T01:38:13.274 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T01:38:13.339 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-23T01:38:13.339 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-23T01:38:13.339 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.00021126 s, 2.4 MB/s 2024-04-23T01:38:13.340 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T01:38:13.395 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-04-23T01:38:13.450 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T01:38:13.450 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:13.450 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-23T01:38:13.450 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:13.451 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:13.451 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-23 01:37:29.397103186 +0000 2024-04-23T01:38:13.451 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-23 01:33:42.715314151 +0000 2024-04-23T01:38:13.451 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-23 01:33:42.715314151 +0000 2024-04-23T01:38:13.451 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-23 01:33:42.715314151 +0000 2024-04-23T01:38:13.451 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T01:38:13.512 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-23T01:38:13.512 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-23T01:38:13.512 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000222828 s, 2.3 MB/s 2024-04-23T01:38:13.514 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T01:38:13.569 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-04-23 01:37:29.398103169 +0000 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-04-23 01:33:43.061308059 +0000 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-04-23 01:33:43.061308059 +0000 2024-04-23T01:38:13.624 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-04-23 01:33:43.061308059 +0000 2024-04-23T01:38:13.625 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T01:38:13.686 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-04-23T01:38:13.686 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-04-23T01:38:13.686 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000187015 s, 2.7 MB/s 2024-04-23T01:38:13.687 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T01:38:13.748 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-23T01:38:13.748 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-23T01:38:13.748 INFO:tasks.ceph:Generating config... 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-04-23T01:38:13.750 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] osd class default list = * 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] osd class load list = * 2024-04-23T01:38:13.751 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-23T01:38:13.751 INFO:tasks.ceph:[client] debug ms = 1 2024-04-23T01:38:13.751 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-04-23T01:38:13.751 INFO:tasks.ceph:[global] ms client mode = crc 2024-04-23T01:38:13.751 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-04-23T01:38:13.751 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-04-23T01:38:13.752 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-04-23T01:38:13.752 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-04-23T01:38:13.752 INFO:tasks.ceph:[global] ms service mode = crc 2024-04-23T01:38:13.752 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-23T01:38:13.752 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-23T01:38:13.752 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-04-23T01:38:13.752 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-04-23T01:38:13.752 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-04-23T01:38:13.752 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-04-23T01:38:13.752 INFO:tasks.ceph:Setting up mon.a... 2024-04-23T01:38:13.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-23T01:38:13.823 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2024-04-23T01:38:13.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-23T01:38:13.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T01:38:13.906 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37')] 2024-04-23T01:38:13.907 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-04-23T01:38:13.908 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:13.908 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T01:38:13.968 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:14.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:14.061+0000 7f43a203bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:14.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:14.061+0000 7f43a203bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:14.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:14.061+0000 7f43a203bf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:fsid e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2024-04-23T01:38:14.062948+0000 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-23T01:38:14.062948+0000 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 17 (quincy) 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-04-23T01:38:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-23T01:38:14.062 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T01:38:14.076 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e132a9f8-f5c5-4318-805c-a5b188312643... 2024-04-23T01:38:14.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T01:38:14.119 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T01:38:14.157 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-04-23T01:38:14.158 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-04-23T01:38:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-04-23T01:38:14.160 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = 172.21.15.37 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: ms client mode = crc 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: ms cluster mode = crc 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: ms mon client mode = crc 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: ms mon cluster mode = crc 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: ms mon service mode = crc 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: ms service mode = crc 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-04-23T01:38:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-04-23T01:38:14.162 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: debug monc = 20 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: crimson alien thread cpu cores = 6-7 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: crimson osd obc lru size = 10 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-04-23T01:38:14.163 INFO:teuthology.orchestra.run.smithi037.stdout: osd blocked scrub grace period = 3600 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: osd class default list = * 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: osd class load list = * 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: osd shutdown pgref assert = True 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.164 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T01:38:14.165 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon min osdmap epochs = 50 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon osdmap full prune interval = 2 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon osdmap full prune min = 15 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon osdmap full prune txsize = 2 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: paxos service trim min = 10 2024-04-23T01:38:14.166 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on pool no app = False 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default crimson = True 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 0-2 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-04-23T01:38:14.167 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 3-5 2024-04-23T01:38:14.168 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-04-23T01:38:14.168 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 0-2 2024-04-23T01:38:14.168 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-04-23T01:38:14.168 INFO:teuthology.orchestra.run.smithi037.stdout: crimson seastar cpu cores = 3-5 2024-04-23T01:38:14.169 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2024-04-23T01:38:14.169 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2024-04-23T01:38:14.169 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T01:38:14.170 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2024-04-23T01:38:14.171 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = 172.21.15.37 2024-04-23T01:38:14.172 INFO:teuthology.orchestra.run.smithi191.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms client mode = crc 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms cluster mode = crc 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms mon client mode = crc 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms mon cluster mode = crc 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms mon service mode = crc 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: ms service mode = crc 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2024-04-23T01:38:14.173 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug trim objects = true 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2024-04-23T01:38:14.174 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: debug monc = 20 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: crimson alien thread cpu cores = 6-7 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: crimson osd obc lru size = 10 2024-04-23T01:38:14.175 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: osd blocked scrub grace period = 3600 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: osd class default list = * 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: osd class load list = * 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: osd shutdown pgref assert = True 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-23T01:38:14.176 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T01:38:14.177 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon min osdmap epochs = 50 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon osdmap full prune interval = 2 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon osdmap full prune min = 15 2024-04-23T01:38:14.178 INFO:teuthology.orchestra.run.smithi191.stdout: mon osdmap full prune txsize = 2 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: paxos service trim min = 10 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on pool no app = False 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default crimson = True 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout: crimson seastar cpu cores = 0-2 2024-04-23T01:38:14.179 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2024-04-23T01:38:14.180 INFO:teuthology.orchestra.run.smithi191.stdout: crimson seastar cpu cores = 3-5 2024-04-23T01:38:14.180 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2024-04-23T01:38:14.180 INFO:teuthology.orchestra.run.smithi191.stdout: crimson seastar cpu cores = 0-2 2024-04-23T01:38:14.180 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2024-04-23T01:38:14.180 INFO:teuthology.orchestra.run.smithi191.stdout: crimson seastar cpu cores = 3-5 2024-04-23T01:38:14.180 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-23T01:38:14.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-23T01:38:14.273 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-23T01:38:14.273 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:14.273 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-23T01:38:14.288 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:14.288 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-23T01:38:14.343 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-04-23T01:38:14.344 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:14.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T01:38:14.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T01:38:14.417 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:14.417 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:14.473 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2024-04-23T01:38:14.473 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:14.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T01:38:14.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T01:38:14.506 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:14.506 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:14.563 INFO:tasks.ceph:Setting up mon nodes... 2024-04-23T01:38:14.563 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-23T01:38:14.564 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T01:38:14.665 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T01:38:14.668 INFO:tasks.ceph:Setting up mds nodes... 2024-04-23T01:38:14.668 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-23T01:38:14.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T01:38:14.719 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-23T01:38:14.732 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-23T01:38:14.779 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-23T01:38:14.791 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-23T01:38:14.792 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-23T01:38:14.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-23T01:38:14.817 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-23T01:38:14.817 INFO:tasks.ceph:role: osd.0 2024-04-23T01:38:14.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-23T01:38:14.817 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T01:38:14.889 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T01:38:14.889 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T01:38:14.889 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T01:38:14.889 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T01:38:14.889 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T01:38:14.890 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-23T01:38:14.890 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T01:38:14.890 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T01:38:14.890 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T01:38:14.890 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T01:38:15.401 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-23T01:38:15.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-23T01:38:15.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-23T01:38:15.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-23T01:38:15.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-23T01:38:15.632 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-23T01:38:15.632 INFO:tasks.ceph:role: osd.1 2024-04-23T01:38:15.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-23T01:38:15.633 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T01:38:15.704 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T01:38:15.704 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T01:38:15.704 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T01:38:15.704 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T01:38:15.704 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T01:38:15.705 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-04-23T01:38:15.705 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T01:38:15.705 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T01:38:15.705 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T01:38:15.705 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T01:38:16.151 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-04-23T01:38:16.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-04-23T01:38:16.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-23T01:38:16.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-23T01:38:16.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:16.571 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:16,575 seastar - Reactor backend: linux-aio 2024-04-23T01:38:16.590 INFO:teuthology.orchestra.run.smithi037.stderr:==26265==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:16.695 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9d9299 0xb8abd60 0xb8ad2dc 0xb8ad4f2 0xb8ad648 0xb8adb11 0x3e6ef 0x113bbf 0x4a0bd 0x35b7c 0x36eee 0x5dd0029 0x5dac675 0x5bf135d 0x5c0c421 0x6ee4d94 0x6ef6567 0x6ef7a04 0x6ef7a89 0x6ef7b8b 0x6ef7c83 0x6ef7e90 0x6ef8076 0x6ef83c5 0x6ef8769 0x6ef8999 0x6ef8c03 0x6ef8ed0 0x6ef90ee 0x6ef91a6 0x6ef926c 0x6ef934d 0x5a59c56 0x5a59d60 0x5a59e1c 0x5a59ed8 0x5a59f94 0x5a5a0e1 0x5a5a26c 0x5a5a62d 0x5a7656e 0xb8be9e5 0xb8d8c7f 0xb979c7d 0xb97b2cb 0xb657ab1 0xb65842d 0x37d891a 0x37d9473 0x3678d7a 0x2958f 0x2963f 0x3465444 2024-04-23T01:38:16.696 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-04-23T01:38:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:16,711 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-23T01:38:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:16,711 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-23T01:38:16.709 INFO:teuthology.orchestra.run.smithi037.stderr:DEBUG 2024-04-23 01:38:16,712 [shard 0:main] seastar - reactor::drain 2024-04-23T01:38:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-04-23T01:38:17.267 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-04-23T01:38:17.267 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:17.267 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:38:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:17,329 seastar - Reactor backend: linux-aio 2024-04-23T01:38:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:==26263==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9d9299 0xb8abd60 0xb8ad2dc 0xb8ad4f2 0xb8ad648 0xb8adb11 0x3e6ef 0x368cd 0x5da8f8e 0x5dac324 0x5dac826 0x5bf135d 0x5c0c421 0x6ee4d94 0x6ef6567 0x6ef7a04 0x6ef7a89 0x6ef7b8b 0x6ef7c83 0x6ef7e90 0x6ef8076 0x6ef83c5 0x6ef8769 0x6ef8999 0x6ef8c03 0x6ef8ed0 0x6ef90ee 0x6ef91a6 0x6ef926c 0x6ef934d 0x5a59c56 0x5a59d60 0x5a59e1c 0x5a59ed8 0x5a59f94 0x5a5a0e1 0x5a5a26c 0x5a5a62d 0x5a7656e 0xb8be9e5 0xb8d8c7f 0xb979c7d 0xb97b2cb 0xb657ab1 0xb65842d 0x367958a 0x2958f 0x2963f 0x3465444 2024-04-23T01:38:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-04-23T01:38:20.828 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:20.828 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-04-23T01:38:20.828 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-04-23T01:38:20.829 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:20.829 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:38:20.829 INFO:teuthology.orchestra.run.smithi037.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:20.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T01:38:20.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:21.178 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:21.179 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:21,183 seastar - Reactor backend: linux-aio 2024-04-23T01:38:21.185 INFO:teuthology.orchestra.run.smithi037.stderr:==27073==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9d9299 0xb8abd60 0xb8ad2dc 0xb8ad4f2 0xb8ad648 0xb8adb11 0x3e6ef 0xe49b2 0xef7ec 0x4a0a5 0x35b7c 0x3629e 0x5dde4c4 0x5dde6c0 0x5dde8bd 0x5ddeb93 0x5e2d3d3 0x5e2d5d9 0x5dac0c0 0x5dac5f4 0x5bf135d 0x5c0c421 0x6ee4d94 0x6ef6567 0x6ef7a04 0x6ef7a89 0x6ef7b8b 0x6ef7c83 0x6ef7e90 0x6ef8076 0x6ef83c5 0x6ef8769 0x6ef8999 0x6ef8c03 0x6ef8ed0 0x6ef90ee 0x6ef91a6 0x6ef926c 0x6ef934d 0x5a59c56 0x5a59d60 0x5a59e1c 0x5a59ed8 0x5a59f94 0x5a5a0e1 0x5a5a26c 0x5a5a62d 0x5a7656e 0xb8be9e5 0xb8d8c7f 0xb979c7d 0xb97b2cb 0xb657ab1 0xb65842d 0x37d891a 0x37d9473 0x3678d7a 0x2958f 0x2963f 0x3465444 2024-04-23T01:38:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-04-23T01:38:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:21,305 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-23T01:38:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:21,305 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-23T01:38:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:DEBUG 2024-04-23 01:38:21,306 [shard 0:main] seastar - reactor::drain 2024-04-23T01:38:21.856 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:21.926 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-04-23T01:38:21.926 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-04-23T01:38:21.926 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:21.926 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:21.926 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:38:21.927 INFO:teuthology.orchestra.run.smithi037.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:21.927 INFO:teuthology.orchestra.run.smithi037.stderr:INFO 2024-04-23 01:38:21,921 seastar - Reactor backend: linux-aio 2024-04-23T01:38:21.927 INFO:teuthology.orchestra.run.smithi037.stderr:==27071==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:21.991 INFO:teuthology.orchestra.run.smithi037.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9d9299 0xb8abd60 0xb8ad2dc 0xb8ad4f2 0xb8ad648 0xb8adb11 0x3e6ef 0x33f148f 0x5dde4c4 0x5dde68c 0x5dde8bd 0x5ddeb93 0x5e2d3d3 0x5e2d5d9 0x5dac0c0 0x5dac5f4 0x5bf135d 0x5c0c421 0x6ee4d94 0x6ef6567 0x6ef7a04 0x6ef7a89 0x6ef7b8b 0x6ef7c83 0x6ef7e90 0x6ef8076 0x6ef83c5 0x6ef8769 0x6ef8999 0x6ef8c03 0x6ef8ed0 0x6ef90ee 0x6ef91a6 0x6ef926c 0x6ef934d 0x5a59c56 0x5a59d60 0x5a59e1c 0x5a59ed8 0x5a59f94 0x5a5a0e1 0x5a5a26c 0x5a5a62d 0x5a7656e 0xb8be9e5 0xb8d8c7f 0xb979c7d 0xb97b2cb 0xb657ab1 0xb65842d 0x367958a 0x2958f 0x2963f 0x3465444 2024-04-23T01:38:21.991 INFO:teuthology.orchestra.run.smithi037.stderr:kernel callstack: 2024-04-23T01:38:25.406 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:Suppressions used: 2024-04-23T01:38:25.407 INFO:teuthology.orchestra.run.smithi037.stderr: count bytes template 2024-04-23T01:38:25.407 INFO:teuthology.orchestra.run.smithi037.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:25.407 INFO:teuthology.orchestra.run.smithi037.stderr:----------------------------------------------------- 2024-04-23T01:38:25.407 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:38:25.408 INFO:teuthology.orchestra.run.smithi037.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:25.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T01:38:25.456 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-23T01:38:25.485 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-23T01:38:25.485 INFO:tasks.ceph:role: osd.2 2024-04-23T01:38:25.485 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-23T01:38:25.485 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T01:38:25.561 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T01:38:25.561 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T01:38:25.562 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T01:38:25.562 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T01:38:25.562 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T01:38:25.562 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-23T01:38:25.562 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T01:38:25.562 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T01:38:25.563 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T01:38:25.563 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T01:38:26.076 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-23T01:38:26.078 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-23T01:38:26.078 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-23T01:38:26.217 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-23T01:38:26.249 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-23T01:38:26.315 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-23T01:38:26.315 INFO:tasks.ceph:role: osd.3 2024-04-23T01:38:26.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-23T01:38:26.316 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T01:38:26.388 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T01:38:26.388 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T01:38:26.388 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T01:38:26.388 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T01:38:26.388 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T01:38:26.389 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2024-04-23T01:38:26.389 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T01:38:26.389 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T01:38:26.389 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T01:38:26.389 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T01:38:26.837 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2024-04-23T01:38:26.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2024-04-23T01:38:26.839 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-04-23T01:38:26.934 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-23T01:38:26.965 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:27.255 INFO:teuthology.orchestra.run.smithi191.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:27.255 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:27,259 seastar - Reactor backend: linux-aio 2024-04-23T01:38:27.266 INFO:teuthology.orchestra.run.smithi191.stderr:==26308==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:27.374 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:27,377 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-23T01:38:27.375 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:27,377 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-23T01:38:27.375 INFO:teuthology.orchestra.run.smithi191.stderr:DEBUG 2024-04-23 01:38:27,378 [shard 0:main] seastar - reactor::drain 2024-04-23T01:38:27.908 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:27.908 INFO:teuthology.orchestra.run.smithi191.stderr:Suppressions used: 2024-04-23T01:38:27.908 INFO:teuthology.orchestra.run.smithi191.stderr: count bytes template 2024-04-23T01:38:27.908 INFO:teuthology.orchestra.run.smithi191.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:27.908 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:27.908 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-23T01:38:27.971 INFO:teuthology.orchestra.run.smithi191.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:27.975 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:27,978 seastar - Reactor backend: linux-aio 2024-04-23T01:38:27.984 INFO:teuthology.orchestra.run.smithi191.stderr:==26306==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:28.049 INFO:teuthology.orchestra.run.smithi191.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9d9299 0xb8abd60 0xb8ad2dc 0xb8ad4f2 0xb8ad648 0xb8adb11 0x3e6ef 0x155df 0x4a09d 0x35b7c 0x3689e 0x5dac0cf 0x5dac29a 0x5dac826 0x5bf135d 0x5c0c421 0x6ee4d94 0x6ef6567 0x6ef7a04 0x6ef7a89 0x6ef7b8b 0x6ef7c83 0x6ef7e90 0x6ef8076 0x6ef83c5 0x6ef8769 0x6ef8999 0x6ef8c03 0x6ef8ed0 0x6ef90ee 0x6ef91a6 0x6ef926c 0x6ef934d 0x5a59c56 0x5a59d60 0x5a59e1c 0x5a59ed8 0x5a59f94 0x5a5a0e1 0x5a5a26c 0x5a5a62d 0x5a7656e 0xb8be9e5 0xb8d8c7f 0xb979c7d 0xb97b2cb 0xb657ab1 0xb65842d 0x367958a 0x2958f 0x2963f 0x3465444 2024-04-23T01:38:28.049 INFO:teuthology.orchestra.run.smithi191.stderr:kernel callstack: 2024-04-23T01:38:31.431 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:31.431 INFO:teuthology.orchestra.run.smithi191.stderr:Suppressions used: 2024-04-23T01:38:31.432 INFO:teuthology.orchestra.run.smithi191.stderr: count bytes template 2024-04-23T01:38:31.432 INFO:teuthology.orchestra.run.smithi191.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:31.432 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:31.432 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-23T01:38:31.432 INFO:teuthology.orchestra.run.smithi191.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:31.458 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T01:38:31.481 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:31.764 INFO:teuthology.orchestra.run.smithi191.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:31.765 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:31,769 seastar - Reactor backend: linux-aio 2024-04-23T01:38:31.770 INFO:teuthology.orchestra.run.smithi191.stderr:==27116==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:31.873 INFO:teuthology.orchestra.run.smithi191.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9d9299 0xb8abd60 0xb8ad2dc 0xb8ad4f2 0xb8ad648 0xb8adb11 0x3e6ef 0xc9dde 0xca7a6 0x347fb78 0x37e22ed 0x5a0180f 0x5a0487d 0x5c5d3f7 0x5c5ea23 0x5c5ebe4 0x5c08389 0x6ee4e03 0x6ef6567 0x6ef7a04 0x6ef7a89 0x6ef7b8b 0x6ef7c83 0x6ef7e90 0x6ef8076 0x6ef83c5 0x6ef8769 0x6ef8999 0x6ef8c03 0x6ef8ed0 0x6ef90ee 0x6ef91a6 0x6ef926c 0x6ef934d 0x5a59c56 0x5a59d60 0x5a59e1c 0x5a59ed8 0x5a59f94 0x5a5a0e1 0x5a5a26c 0x5a5a62d 0x5a7656e 0xb8be9e5 0xb8d8c7f 0xb979c7d 0xb97b2cb 0xb657ab1 0xb65842d 0x37d891a 0x37d9473 0x3678d7a 0x2958f 0x2963f 0x3465444 2024-04-23T01:38:31.873 INFO:teuthology.orchestra.run.smithi191.stderr:kernel callstack: 2024-04-23T01:38:31.878 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:31,881 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-23T01:38:31.878 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:31,881 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-23T01:38:31.878 INFO:teuthology.orchestra.run.smithi191.stderr:DEBUG 2024-04-23 01:38:31,882 [shard 0:main] seastar - reactor::drain 2024-04-23T01:38:32.408 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:32.408 INFO:teuthology.orchestra.run.smithi191.stderr:Suppressions used: 2024-04-23T01:38:32.408 INFO:teuthology.orchestra.run.smithi191.stderr: count bytes template 2024-04-23T01:38:32.408 INFO:teuthology.orchestra.run.smithi191.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:32.408 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:32.408 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-23T01:38:32.464 INFO:teuthology.orchestra.run.smithi191.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-23T01:38:32.468 INFO:teuthology.orchestra.run.smithi191.stderr:INFO 2024-04-23 01:38:32,471 seastar - Reactor backend: linux-aio 2024-04-23T01:38:32.481 INFO:teuthology.orchestra.run.smithi191.stderr:==27114==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-23T01:38:32.580 INFO:teuthology.orchestra.run.smithi191.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9d9299 0xb8abd60 0xb8ad2dc 0xb8ad4f2 0xb8ad648 0xb8adb11 0x3e6ef 0x5cd6375 0x5cd65c2 0x5cd0bd0 0x5bf3029 0x5c02980 0x5c07ca6 0x5c082a8 0x6ee4e03 0x6ef6567 0x6ef7a04 0x6ef7a89 0x6ef7b8b 0x6ef7c83 0x6ef7e90 0x6ef8076 0x6ef83c5 0x6ef8769 0x6ef8999 0x6ef8c03 0x6ef8ed0 0x6ef90ee 0x6ef91a6 0x6ef926c 0x6ef934d 0x5a59c56 0x5a59d60 0x5a59e1c 0x5a59ed8 0x5a59f94 0x5a5a0e1 0x5a5a26c 0x5a5a62d 0x5a7656e 0xb8be9e5 0xb8d8c7f 0xb979c7d 0xb97b2cb 0xb657ab1 0xb65842d 0x367958a 0x2958f 0x2963f 0x3465444 2024-04-23T01:38:32.581 INFO:teuthology.orchestra.run.smithi191.stderr:kernel callstack: 2024-04-23T01:38:35.953 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:35.953 INFO:teuthology.orchestra.run.smithi191.stderr:Suppressions used: 2024-04-23T01:38:35.953 INFO:teuthology.orchestra.run.smithi191.stderr: count bytes template 2024-04-23T01:38:35.953 INFO:teuthology.orchestra.run.smithi191.stderr: 1 8 MallocExtension::Register 2024-04-23T01:38:35.953 INFO:teuthology.orchestra.run.smithi191.stderr:----------------------------------------------------- 2024-04-23T01:38:35.954 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-23T01:38:35.954 INFO:teuthology.orchestra.run.smithi191.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:38:35.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T01:38:36.002 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-23T01:38:36.003 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:36.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-23T01:38:36.033 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:36.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-23T01:38:36.101 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:36.101 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-23T01:38:36.124 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:36.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-23T01:38:36.187 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:36.188 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-23T01:38:36.250 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:36.251 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-23T01:38:36.269 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:36.270 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-23T01:38:36.305 INFO:tasks.ceph:Adding keys to all mons... 2024-04-23T01:38:36.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAJESdmjnr+HBAAKtk+O5E3SYy95TntWV8Gaw== 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAOESdm+ih8BBAAfDk9cKrjOm4N6wRL3c0qAg== 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAGESdm9NvXJxAAtgvjkA9RN4c5q5zAYEcqoQ== 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAUESdm34dCBxAAFSseBV1JcbCsoPKLuzvt+Q== 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-04-23T01:38:36.337 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAYESdmfuy8JRAAMjtUYKYVU+jgFp3R0r7vpg== 2024-04-23T01:38:36.338 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-04-23T01:38:36.338 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAGESdmhIYSKxAAwdUK/Eo3f/TQ3phvqXjNiQ== 2024-04-23T01:38:36.338 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2024-04-23T01:38:36.338 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAGESdmaFStLhAA+HIGbBpd+jOOhGDSQxPqXQ== 2024-04-23T01:38:36.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T01:38:36.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T01:38:36.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T01:38:36.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T01:38:36.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T01:38:36.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T01:38:36.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T01:38:36.817 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-23T01:38:36.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-23T01:38:36.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T01:38:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:36.950+0000 7fa7d4e8ca80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:36.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:36.950+0000 7fa7d4e8ca80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:36.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-23T01:38:36.985 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T01:38:37.040 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-23T01:38:37.040 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-23T01:38:37.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-23T01:38:37.083 INFO:tasks.ceph.mon.a:Started 2024-04-23T01:38:37.083 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-23T01:38:37.083 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-23T01:38:37.083 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-23T01:38:37.086 INFO:tasks.ceph.mgr.x:Started 2024-04-23T01:38:37.086 INFO:tasks.ceph:Setting crush tunables to default 2024-04-23T01:38:37.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2024-04-23T01:38:37.167 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-04-23T01:38:37.169+0000 7f6865c65a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.167 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-04-23T01:38:37.169+0000 7f6865c65a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.167 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-04-23T01:38:37.169+0000 7f6865c65a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.175 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.178+0000 7fc956571000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.193+0000 7f1cb222d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.200+0000 7f1cb222d640 1 Processor -- start 2024-04-23T01:38:37.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.200+0000 7f1cb222d640 1 -- start start 2024-04-23T01:38:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cb222d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 0x7f1cac131dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cb222d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cac132720 con 0x7f1cac132310 2024-04-23T01:38:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cb222d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1cac0a0440 con 0x7f1cac0a1100 2024-04-23T01:38:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cab7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 0x7f1cac131dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1caaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1cac132310 0x7f1cac134d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45224/0 (socket says 172.21.15.37:45224) 2024-04-23T01:38:37.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1caaffd640 1 -- 172.21.15.37:0/32580644 learned_addr learned my addr 172.21.15.37:0/32580644 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cab7fe640 1 -- 172.21.15.37:0/32580644 >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 msgr2=0x7f1cac131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T01:38:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cab7fe640 1 -- 172.21.15.37:0/32580644 >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 msgr2=0x7f1cac131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T01:38:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cab7fe640 1 --2- 172.21.15.37:0/32580644 >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 0x7f1cac131dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T01:38:37.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.202+0000 7f1cab7fe640 1 --2- 172.21.15.37:0/32580644 >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 0x7f1cac131dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.209+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497709643 0 0) 0x7f1cac132720 con 0x7f1cac132310 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.209+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c98003580 con 0x7f1cac132310 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2693808217 0 0) 0x7f1c98003580 con 0x7f1cac132310 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 msgr2=0x7f1cac131dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 --2- 172.21.15.37:0/32580644 >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 0x7f1cac131dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac131820 con 0x7f1cac132310 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2911918567 0 0) 0x7f1c940015a0 con 0x7f1cac132310 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 >> v1:172.21.15.37:6789/0 conn(0x7f1cac132310 legacy=0x7f1cac134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 --2- 172.21.15.37:0/32580644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1c98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac0a0440 con 0x7f1c980039d0 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1cab7fe640 1 --2- 172.21.15.37:0/32580644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1c98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:37.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.210+0000 7f1cab7fe640 1 -- 172.21.15.37:0/32580644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c98003580 con 0x7f1c980039d0 2024-04-23T01:38:37.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.211+0000 7f1cab7fe640 1 --2- 172.21.15.37:0/32580644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1c98003e20 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b1a7f8cc51c39e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:37.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.211+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c9c0095f0 con 0x7f1c980039d0 2024-04-23T01:38:37.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.211+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1c9c00c040 con 0x7f1c980039d0 2024-04-23T01:38:37.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.211+0000 7f1caa7fc640 1 -- 172.21.15.37:0/32580644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c9c009c30 con 0x7f1c980039d0 2024-04-23T01:38:37.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 -- 172.21.15.37:0/32580644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 msgr2=0x7f1c98003e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:37.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 --2- 172.21.15.37:0/32580644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1c98003e20 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 -- 172.21.15.37:0/32580644 shutdown_connections 2024-04-23T01:38:37.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 --2- 172.21.15.37:0/32580644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1c98003e20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 --2- 172.21.15.37:0/32580644 >> v2:172.21.15.37:3300/0 conn(0x7f1cac0a1100 0x7f1cac131dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 -- 172.21.15.37:0/32580644 >> 172.21.15.37:0/32580644 conn(0x7f1cac0a4eb0 msgr2=0x7f1cac0a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:37.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 -- 172.21.15.37:0/32580644 shutdown_connections 2024-04-23T01:38:37.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.212+0000 7f1cb222d640 1 -- 172.21.15.37:0/32580644 wait complete. 2024-04-23T01:38:37.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.213+0000 7f1cb222d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.214+0000 7f1cb222d640 1 Processor -- start 2024-04-23T01:38:37.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.214+0000 7f1cb222d640 1 -- start start 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.216+0000 7f1cb222d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1cac1209a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.216+0000 7f1cb222d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1cac120550 con 0x7f1c980039d0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.216+0000 7f1cab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1cac1209a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.216+0000 7f1cab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1cac1209a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33906/0 (socket says 172.21.15.37:33906) 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.216+0000 7f1cab7fe640 1 -- 172.21.15.37:0/1074570634 learned_addr learned my addr 172.21.15.37:0/1074570634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.216+0000 7f1cab7fe640 1 -- 172.21.15.37:0/1074570634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cac1223b0 con 0x7f1c980039d0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1cab7fe640 1 --2- 172.21.15.37:0/1074570634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1cac1209a0 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1ca3fff640 1 -- 172.21.15.37:0/1074570634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c9c0095c0 con 0x7f1c980039d0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1ca3fff640 1 -- 172.21.15.37:0/1074570634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1c9c003670 con 0x7f1c980039d0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cac11ff10 con 0x7f1c980039d0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1ca3fff640 1 -- 172.21.15.37:0/1074570634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1c9c003910 con 0x7f1c980039d0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cac123f50 con 0x7f1c980039d0 2024-04-23T01:38:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1ca3fff640 1 -- 172.21.15.37:0/1074570634 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f1c9c003b50 con 0x7f1c980039d0 2024-04-23T01:38:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.217+0000 7f1ca3fff640 1 -- 172.21.15.37:0/1074570634 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7f1c9c0158e0 con 0x7f1c980039d0 2024-04-23T01:38:37.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.218+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cac120350 con 0x7f1c980039d0 2024-04-23T01:38:37.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.220+0000 7f1ca3fff640 1 -- 172.21.15.37:0/1074570634 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f1c9c00f040 con 0x7f1c980039d0 2024-04-23T01:38:37.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.286+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1cac063880 con 0x7f1c980039d0 2024-04-23T01:38:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.287+0000 7f1ca3fff640 1 -- 172.21.15.37:0/1074570634 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7f1c9c015bf0 con 0x7f1c980039d0 2024-04-23T01:38:37.285 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-04-23T01:38:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.288+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 msgr2=0x7f1cac1209a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.288+0000 7f1cb222d640 1 --2- 172.21.15.37:0/1074570634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1cac1209a0 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.288+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 shutdown_connections 2024-04-23T01:38:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.288+0000 7f1cb222d640 1 --2- 172.21.15.37:0/1074570634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c980039d0 0x7f1cac1209a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.288+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 >> 172.21.15.37:0/1074570634 conn(0x7f1cac0a4eb0 msgr2=0x7f1cac06f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.288+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 shutdown_connections 2024-04-23T01:38:37.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.288+0000 7f1cb222d640 1 -- 172.21.15.37:0/1074570634 wait complete. 2024-04-23T01:38:37.296 INFO:tasks.ceph:check_enable_crimson: True 2024-04-23T01:38:37.297 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-04-23T01:38:37.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-04-23T01:38:37.381 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.383+0000 7fc956571000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.381 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.383+0000 7fc956571000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.402+0000 7f0b6295d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.408+0000 7f0b6295d640 1 Processor -- start 2024-04-23T01:38:37.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.409+0000 7f0b6295d640 1 -- start start 2024-04-23T01:38:37.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.410+0000 7f0b6295d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b5c09f6c0 0x7f0b5c09fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:37.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.410+0000 7f0b6295d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b5c070d80 con 0x7f0b5c0a0010 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.410+0000 7f0b6295d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0b5c0717b0 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.410+0000 7f0b5bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b5c09f6c0 0x7f0b5c09fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.410+0000 7f0b5b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b5c0a0010 0x7f0b5c1329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45234/0 (socket says 172.21.15.37:45234) 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.410+0000 7f0b5bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b5c09f6c0 0x7f0b5c09fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33914/0 (socket says 172.21.15.37:33914) 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.410+0000 7f0b5b7fe640 1 -- 172.21.15.37:0/3060554055 learned_addr learned my addr 172.21.15.37:0/3060554055 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.411+0000 7f0b5bfff640 1 -- 172.21.15.37:0/3060554055 >> v1:172.21.15.37:6789/0 conn(0x7f0b5c0a0010 legacy=0x7f0b5c1329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.411+0000 7f0b5affd640 1 -- 172.21.15.37:0/3060554055 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005883409 0 0) 0x7f0b5c070d80 con 0x7f0b5c0a0010 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.411+0000 7f0b5bfff640 1 -- 172.21.15.37:0/3060554055 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c072330 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.411+0000 7f0b5bfff640 1 --2- 172.21.15.37:0/3060554055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c09fad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d07a3644cfb0fc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.411+0000 7f0b5affd640 1 -- 172.21.15.37:0/3060554055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b44009d90 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.411+0000 7f0b5affd640 1 -- 172.21.15.37:0/3060554055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b4400e230 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.411+0000 7f0b5affd640 1 -- 172.21.15.37:0/3060554055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b4400e4d0 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 1 -- 172.21.15.37:0/3060554055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 msgr2=0x7f0b5c09fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:37.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 1 --2- 172.21.15.37:0/3060554055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c09fad0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 1 -- 172.21.15.37:0/3060554055 shutdown_connections 2024-04-23T01:38:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 1 --2- 172.21.15.37:0/3060554055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c09fad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 1 -- 172.21.15.37:0/3060554055 >> 172.21.15.37:0/3060554055 conn(0x7f0b5c0a1960 msgr2=0x7f0b5c0a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 1 -- 172.21.15.37:0/3060554055 shutdown_connections 2024-04-23T01:38:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 1 -- 172.21.15.37:0/3060554055 wait complete. 2024-04-23T01:38:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.412+0000 7f0b6295d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:37.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.414+0000 7f0b6295d640 1 Processor -- start 2024-04-23T01:38:37.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.414+0000 7f0b6295d640 1 -- start start 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.415+0000 7f0b6295d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c11f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.415+0000 7f0b6295d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c123310 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.415+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c11f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.415+0000 7f0b5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c11f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33920/0 (socket says 172.21.15.37:33920) 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.415+0000 7f0b5bfff640 1 -- 172.21.15.37:0/3343147741 learned_addr learned my addr 172.21.15.37:0/3343147741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b5bfff640 1 -- 172.21.15.37:0/3343147741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c121f50 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b5bfff640 1 --2- 172.21.15.37:0/3343147741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c11f110 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:37.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b58ff9640 1 -- 172.21.15.37:0/3343147741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b44013610 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b58ff9640 1 -- 172.21.15.37:0/3343147741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b44013770 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c120330 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b58ff9640 1 -- 172.21.15.37:0/3343147741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b44013a10 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c1226a0 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b58ff9640 1 -- 172.21.15.37:0/3343147741 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f0b440123f0 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.416+0000 7f0b58ff9640 1 -- 172.21.15.37:0/3343147741 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7f0b44018040 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.417+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5c121a30 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.419+0000 7f0b58ff9640 1 -- 172.21.15.37:0/3343147741 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f0b44012880 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.483 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.485+0000 7fc956571000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T01:38:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:37.496+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7f0b5c0692b0 con 0x7f0b5c09f6c0 2024-04-23T01:38:37.494 INFO:tasks.ceph.mon.a.smithi037.stderr:2024-04-23T01:38:37.496+0000 7f685c9f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-04-23T01:38:37.494 INFO:tasks.ceph.mon.a.smithi037.stderr:Please be aware that this feature is experimental, untested, 2024-04-23T01:38:37.494 INFO:tasks.ceph.mon.a.smithi037.stderr:unsupported, and may result in data corruption, data loss, 2024-04-23T01:38:37.494 INFO:tasks.ceph.mon.a.smithi037.stderr:and/or irreparable damage to your cluster. Do not use 2024-04-23T01:38:37.494 INFO:tasks.ceph.mon.a.smithi037.stderr:feature with important data. 2024-04-23T01:38:37.494 INFO:tasks.ceph.mon.a.smithi037.stderr: 2024-04-23T01:38:37.628 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.630+0000 7fc956571000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T01:38:37.681 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.683+0000 7fc956571000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T01:38:37.926 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.928+0000 7fc956571000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T01:38:37.971 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:37.973+0000 7fc956571000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T01:38:38.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.288+0000 7f0b58ff9640 1 -- 172.21.15.37:0/3343147741 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7f0b44012a20 con 0x7f0b5c09f6c0 2024-04-23T01:38:38.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.289+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 msgr2=0x7f0b5c11f110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:38.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.289+0000 7f0b6295d640 1 --2- 172.21.15.37:0/3343147741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c11f110 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.290+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 shutdown_connections 2024-04-23T01:38:38.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.290+0000 7f0b6295d640 1 --2- 172.21.15.37:0/3343147741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c09f6c0 0x7f0b5c11f110 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.290+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 >> 172.21.15.37:0/3343147741 conn(0x7f0b5c0a1960 msgr2=0x7f0b5c09c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:38.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.290+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 shutdown_connections 2024-04-23T01:38:38.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:38.290+0000 7f0b6295d640 1 -- 172.21.15.37:0/3343147741 wait complete. 2024-04-23T01:38:38.302 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-23T01:38:38.302 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:38.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-23T01:38:38.331 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:38:38.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-23T01:38:38.398 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:38.398 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-23T01:38:38.422 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-04-23T01:38:38.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-23T01:38:38.486 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 9aacf45a-9611-4f14-9dea-50f0fc0f3a3f 0 2024-04-23T01:38:38.635 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.631+0000 7f1e9775d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:38.635 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.637+0000 7f1e9775d640 1 Processor -- start 2024-04-23T01:38:38.636 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.637+0000 7f1e9775d640 1 -- start start 2024-04-23T01:38:38.636 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.638+0000 7f1e9775d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e90113990 0x7f1e90113da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:38.636 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.638+0000 7f1e9775d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e90114560 con 0x7f1e90118370 2024-04-23T01:38:38.636 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.638+0000 7f1e9775d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1e90118eb0 con 0x7f1e90113990 2024-04-23T01:38:38.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.638+0000 7f1e954f9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e90113990 0x7f1e90113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:38.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.638+0000 7f1e954f9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1e90113990 0x7f1e90113da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57394/0 (socket says 172.21.15.191:57394) 2024-04-23T01:38:38.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.638+0000 7f1e954f9640 1 -- 172.21.15.191:0/1442008182 learned_addr learned my addr 172.21.15.191:0/1442008182 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:38.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.638+0000 7f1e94cf8640 1 --1- 172.21.15.191:0/1442008182 >> v1:172.21.15.37:6789/0 conn(0x7f1e90118370 0x7f1e90118780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.191:60230/0 (socket says 172.21.15.191:60230) 2024-04-23T01:38:38.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.639+0000 7f1e954f9640 1 -- 172.21.15.191:0/1442008182 >> v1:172.21.15.37:6789/0 conn(0x7f1e90118370 legacy=0x7f1e90118780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:38.637 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.639+0000 7f1e954f9640 1 -- 172.21.15.191:0/1442008182 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e90119020 con 0x7f1e90113990 2024-04-23T01:38:38.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.639+0000 7f1e954f9640 1 --2- 172.21.15.191:0/1442008182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e90113da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9b8ebc130436a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:38.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.639+0000 7f1e87fff640 1 -- 172.21.15.191:0/1442008182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e80009e50 con 0x7f1e90113990 2024-04-23T01:38:38.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.639+0000 7f1e87fff640 1 -- 172.21.15.191:0/1442008182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e8000e230 con 0x7f1e90113990 2024-04-23T01:38:38.638 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.639+0000 7f1e87fff640 1 -- 172.21.15.191:0/1442008182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e8000e4d0 con 0x7f1e90113990 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 1 -- 172.21.15.191:0/1442008182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 msgr2=0x7f1e90113da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 1 --2- 172.21.15.191:0/1442008182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e90113da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 1 -- 172.21.15.191:0/1442008182 shutdown_connections 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 1 --2- 172.21.15.191:0/1442008182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e90113da0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 1 -- 172.21.15.191:0/1442008182 >> 172.21.15.191:0/1442008182 conn(0x7f1e9006eda0 msgr2=0x7f1e90111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 1 -- 172.21.15.191:0/1442008182 shutdown_connections 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 1 -- 172.21.15.191:0/1442008182 wait complete. 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.640+0000 7f1e9775d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:38.639 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.641+0000 7f1e9775d640 1 Processor -- start 2024-04-23T01:38:38.640 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.641+0000 7f1e9775d640 1 -- start start 2024-04-23T01:38:38.640 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.641+0000 7f1e9775d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e901ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:38.640 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.641+0000 7f1e9775d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e901ae680 con 0x7f1e90113990 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.642+0000 7f1e954f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e901ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.642+0000 7f1e954f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e901ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57408/0 (socket says 172.21.15.191:57408) 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.642+0000 7f1e954f9640 1 -- 172.21.15.191:0/3508782738 learned_addr learned my addr 172.21.15.191:0/3508782738 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.642+0000 7f1e954f9640 1 -- 172.21.15.191:0/3508782738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e901ae7c0 con 0x7f1e90113990 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.642+0000 7f1e954f9640 1 --2- 172.21.15.191:0/3508782738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e901ae0b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.643+0000 7f1e85ffb640 1 -- 172.21.15.191:0/3508782738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e8000ee80 con 0x7f1e90113990 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.643+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e901ae9b0 con 0x7f1e90113990 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.643+0000 7f1e85ffb640 1 -- 172.21.15.191:0/3508782738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1e80015420 con 0x7f1e90113990 2024-04-23T01:38:38.641 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.643+0000 7f1e85ffb640 1 -- 172.21.15.191:0/3508782738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1e80015710 con 0x7f1e90113990 2024-04-23T01:38:38.642 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.643+0000 7f1e85ffb640 1 -- 172.21.15.191:0/3508782738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f1e80015c00 con 0x7f1e90113990 2024-04-23T01:38:38.642 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.643+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e901a8490 con 0x7f1e90113990 2024-04-23T01:38:38.642 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.643+0000 7f1e85ffb640 1 -- 172.21.15.191:0/3508782738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f1e80011900 con 0x7f1e90113990 2024-04-23T01:38:38.642 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.644+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e90063880 con 0x7f1e90113990 2024-04-23T01:38:38.644 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.646+0000 7f1e85ffb640 1 -- 172.21.15.191:0/3508782738 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f1e80011ac0 con 0x7f1e90113990 2024-04-23T01:38:38.694 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:38.694+0000 7fc956571000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T01:38:38.716 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.718+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9aacf45a-9611-4f14-9dea-50f0fc0f3a3f", "id": 0} v 0) -- 0x7f1e90118370 con 0x7f1e90113990 2024-04-23T01:38:38.718 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.720+0000 7f1e85ffb640 1 -- 172.21.15.191:0/3508782738 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9aacf45a-9611-4f14-9dea-50f0fc0f3a3f", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f1e80011c60 con 0x7f1e90113990 2024-04-23T01:38:38.718 INFO:teuthology.orchestra.run.smithi191.stdout:0 2024-04-23T01:38:38.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.721+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 msgr2=0x7f1e901ae0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:38.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.721+0000 7f1e9775d640 1 --2- 172.21.15.191:0/3508782738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e901ae0b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.721+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 shutdown_connections 2024-04-23T01:38:38.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.721+0000 7f1e9775d640 1 --2- 172.21.15.191:0/3508782738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e90113990 0x7f1e901ae0b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.719 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.721+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 >> 172.21.15.191:0/3508782738 conn(0x7f1e9006eda0 msgr2=0x7f1e90111fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:38.720 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.721+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 shutdown_connections 2024-04-23T01:38:38.720 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.721+0000 7f1e9775d640 1 -- 172.21.15.191:0/3508782738 wait complete. 2024-04-23T01:38:38.729 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new ed271568-29f8-4d1b-a810-ca3b16b2682d 1 2024-04-23T01:38:38.784 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:38.786+0000 7fc956571000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T01:38:38.830 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:38.832+0000 7fc956571000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T01:38:38.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.832+0000 7f0a1542d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:38.836 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.838+0000 7f0a1542d640 1 Processor -- start 2024-04-23T01:38:38.836 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.838+0000 7f0a1542d640 1 -- start start 2024-04-23T01:38:38.837 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.838+0000 7f0a1542d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a10112660 0x7f0a10112a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a1542d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a10117d70 con 0x7f0a10112fe0 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a1542d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0a10117f20 con 0x7f0a10112660 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a0effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a10112660 0x7f0a10112a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a0effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a10112660 0x7f0a10112a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57416/0 (socket says 172.21.15.191:57416) 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a0effd640 1 -- 172.21.15.191:0/1138464346 learned_addr learned my addr 172.21.15.191:0/1138464346 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a07fff640 1 --1- 172.21.15.191:0/1138464346 >> v1:172.21.15.37:6789/0 conn(0x7f0a10112fe0 0x7f0a10117520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.191:60242/0 (socket says 172.21.15.191:60242) 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a0effd640 1 -- 172.21.15.191:0/1138464346 >> v1:172.21.15.37:6789/0 conn(0x7f0a10112fe0 legacy=0x7f0a10117520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.839+0000 7f0a0effd640 1 -- 172.21.15.191:0/1138464346 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a10118090 con 0x7f0a10112660 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.840+0000 7f0a0effd640 1 --2- 172.21.15.191:0/1138464346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a10112a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba6b9b3af3be9c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:38.838 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.840+0000 7f0a0e7fc640 1 -- 172.21.15.191:0/1138464346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a00009e50 con 0x7f0a10112660 2024-04-23T01:38:38.839 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.840+0000 7f0a0e7fc640 1 -- 172.21.15.191:0/1138464346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0a0000e230 con 0x7f0a10112660 2024-04-23T01:38:38.839 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.840+0000 7f0a0e7fc640 1 -- 172.21.15.191:0/1138464346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a0000e4d0 con 0x7f0a10112660 2024-04-23T01:38:38.841 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.840+0000 7f0a1542d640 1 -- 172.21.15.191:0/1138464346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 msgr2=0x7f0a10112a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:38.841 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.840+0000 7f0a1542d640 1 --2- 172.21.15.191:0/1138464346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a10112a70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 1 -- 172.21.15.191:0/1138464346 shutdown_connections 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 1 --2- 172.21.15.191:0/1138464346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a10112a70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 1 -- 172.21.15.191:0/1138464346 >> 172.21.15.191:0/1138464346 conn(0x7f0a10070730 msgr2=0x7f0a10072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 1 -- 172.21.15.191:0/1138464346 shutdown_connections 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 1 -- 172.21.15.191:0/1138464346 wait complete. 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 1 Processor -- start 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.841+0000 7f0a1542d640 1 -- start start 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.842+0000 7f0a1542d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a101abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.842+0000 7f0a1542d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101ac4d0 con 0x7f0a10112660 2024-04-23T01:38:38.842 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.842+0000 7f0a0effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a101abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.842+0000 7f0a0effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a101abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57420/0 (socket says 172.21.15.191:57420) 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.842+0000 7f0a0effd640 1 -- 172.21.15.191:0/1634234596 learned_addr learned my addr 172.21.15.191:0/1634234596 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.842+0000 7f0a0effd640 1 -- 172.21.15.191:0/1634234596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a101ac610 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a0effd640 1 --2- 172.21.15.191:0/1634234596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a101abf00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a077fe640 1 -- 172.21.15.191:0/1634234596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a0000ee80 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a101ac800 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a077fe640 1 -- 172.21.15.191:0/1634234596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0a00015420 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a077fe640 1 -- 172.21.15.191:0/1634234596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a00015710 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a101a62e0 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a077fe640 1 -- 172.21.15.191:0/1634234596 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f0a00015c00 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.843+0000 7f0a077fe640 1 -- 172.21.15.191:0/1634234596 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f0a00011740 con 0x7f0a10112660 2024-04-23T01:38:38.843 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.844+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a10063880 con 0x7f0a10112660 2024-04-23T01:38:38.844 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.846+0000 7f0a077fe640 1 -- 172.21.15.191:0/1634234596 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f0a00011900 con 0x7f0a10112660 2024-04-23T01:38:38.916 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.918+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ed271568-29f8-4d1b-a810-ca3b16b2682d", "id": 1} v 0) -- 0x7f0a101a6e50 con 0x7f0a10112660 2024-04-23T01:38:38.917 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.920+0000 7f0a077fe640 1 -- 172.21.15.191:0/1634234596 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed271568-29f8-4d1b-a810-ca3b16b2682d", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f0a00011bf0 con 0x7f0a10112660 2024-04-23T01:38:38.918 INFO:teuthology.orchestra.run.smithi191.stdout:1 2024-04-23T01:38:38.919 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.921+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 msgr2=0x7f0a101abf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:38.919 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.921+0000 7f0a1542d640 1 --2- 172.21.15.191:0/1634234596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a101abf00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.919 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.921+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 shutdown_connections 2024-04-23T01:38:38.919 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.921+0000 7f0a1542d640 1 --2- 172.21.15.191:0/1634234596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a10112660 0x7f0a101abf00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:38.919 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.921+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 >> 172.21.15.191:0/1634234596 conn(0x7f0a10070730 msgr2=0x7f0a10113830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:38.919 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.921+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 shutdown_connections 2024-04-23T01:38:38.919 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:38.921+0000 7f0a1542d640 1 -- 172.21.15.191:0/1634234596 wait complete. 2024-04-23T01:38:38.930 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new d9c96632-2efd-4fc2-8d5a-896bbe7a5204 2 2024-04-23T01:38:39.006 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:39.009+0000 7fc956571000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T01:38:39.037 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.033+0000 7f59d12ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:39.038 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59d12ad640 1 Processor -- start 2024-04-23T01:38:39.038 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59d12ad640 1 -- start start 2024-04-23T01:38:39.038 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59d12ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59cc11c790 0x7f59cc11ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:39.038 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59d12ad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59cc11f0f0 con 0x7f59cc06d850 2024-04-23T01:38:39.038 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59d12ad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f59cc120290 con 0x7f59cc11c790 2024-04-23T01:38:39.040 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59ca7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59cc11c790 0x7f59cc11ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:39.040 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59ca7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59cc11c790 0x7f59cc11ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57430/0 (socket says 172.21.15.191:57430) 2024-04-23T01:38:39.040 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.040+0000 7f59ca7fc640 1 -- 172.21.15.191:0/3278231626 learned_addr learned my addr 172.21.15.191:0/3278231626 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:39.040 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.041+0000 7f59ca7fc640 1 -- 172.21.15.191:0/3278231626 >> v1:172.21.15.37:6789/0 conn(0x7f59cc06d850 legacy=0x7f59cc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.041+0000 7f59ca7fc640 1 -- 172.21.15.191:0/3278231626 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc1203d0 con 0x7f59cc11c790 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.041+0000 7f59ca7fc640 1 --2- 172.21.15.191:0/3278231626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc11c790 0x7f59cc11ebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4338900d6039143 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.041+0000 7f59c9ffb640 1 -- 172.21.15.191:0/3278231626 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59c0009e50 con 0x7f59cc11c790 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.041+0000 7f59c9ffb640 1 -- 172.21.15.191:0/3278231626 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59c000e230 con 0x7f59cc11c790 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.041+0000 7f59c9ffb640 1 -- 172.21.15.191:0/3278231626 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59c000e4d0 con 0x7f59cc11c790 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 1 -- 172.21.15.191:0/3278231626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc11c790 msgr2=0x7f59cc11ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 1 --2- 172.21.15.191:0/3278231626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc11c790 0x7f59cc11ebb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 1 -- 172.21.15.191:0/3278231626 shutdown_connections 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 1 --2- 172.21.15.191:0/3278231626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc11c790 0x7f59cc11ebb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 1 -- 172.21.15.191:0/3278231626 >> 172.21.15.191:0/3278231626 conn(0x7f59cc0716a0 msgr2=0x7f59cc073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 1 -- 172.21.15.191:0/3278231626 shutdown_connections 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 1 -- 172.21.15.191:0/3278231626 wait complete. 2024-04-23T01:38:39.041 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.042+0000 7f59d12ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:39.043 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.043+0000 7f59d12ad640 1 Processor -- start 2024-04-23T01:38:39.043 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.043+0000 7f59d12ad640 1 -- start start 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.043+0000 7f59d12ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc06d850 0x7f59cc1ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.043+0000 7f59d12ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc1ae670 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc06d850 0x7f59cc1ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc06d850 0x7f59cc1ae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57432/0 (socket says 172.21.15.191:57432) 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59caffd640 1 -- 172.21.15.191:0/1941309143 learned_addr learned my addr 172.21.15.191:0/1941309143 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59caffd640 1 -- 172.21.15.191:0/1941309143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc1ae7b0 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59caffd640 1 --2- 172.21.15.191:0/1941309143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc06d850 0x7f59cc1ae0a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59b37fe640 1 -- 172.21.15.191:0/1941309143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59bc00c870 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59b37fe640 1 -- 172.21.15.191:0/1941309143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59bc00c9d0 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc1aea00 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59b37fe640 1 -- 172.21.15.191:0/1941309143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59bc00cc70 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.044+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc1a8480 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.045+0000 7f59b37fe640 1 -- 172.21.15.191:0/1941309143 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f59bc0116a0 con 0x7f59cc06d850 2024-04-23T01:38:39.044 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.045+0000 7f59b37fe640 1 -- 172.21.15.191:0/1941309143 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f59bc010e10 con 0x7f59cc06d850 2024-04-23T01:38:39.045 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.046+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc063880 con 0x7f59cc06d850 2024-04-23T01:38:39.046 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.048+0000 7f59b37fe640 1 -- 172.21.15.191:0/1941309143 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f59bc0109d0 con 0x7f59cc06d850 2024-04-23T01:38:39.066 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:39.068+0000 7fc956571000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T01:38:39.118 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.120+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9c96632-2efd-4fc2-8d5a-896bbe7a5204", "id": 2} v 0) -- 0x7f59cc11c830 con 0x7f59cc06d850 2024-04-23T01:38:39.119 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.122+0000 7f59b37fe640 1 -- 172.21.15.191:0/1941309143 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9c96632-2efd-4fc2-8d5a-896bbe7a5204", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f59bc010c30 con 0x7f59cc06d850 2024-04-23T01:38:39.119 INFO:teuthology.orchestra.run.smithi191.stdout:2 2024-04-23T01:38:39.120 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:39.122+0000 7fc956571000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T01:38:39.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.123+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc06d850 msgr2=0x7f59cc1ae0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.123+0000 7f59d12ad640 1 --2- 172.21.15.191:0/1941309143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc06d850 0x7f59cc1ae0a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.123+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 shutdown_connections 2024-04-23T01:38:39.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.123+0000 7f59d12ad640 1 --2- 172.21.15.191:0/1941309143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59cc06d850 0x7f59cc1ae0a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.123+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 >> 172.21.15.191:0/1941309143 conn(0x7f59cc0716a0 msgr2=0x7f59cc072c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:39.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.123+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 shutdown_connections 2024-04-23T01:38:39.121 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.123+0000 7f59d12ad640 1 -- 172.21.15.191:0/1941309143 wait complete. 2024-04-23T01:38:39.131 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new e191d386-d82b-47ee-b6c7-5154e1d630c4 3 2024-04-23T01:38:39.237 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.234+0000 7fe83939d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:39.238 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.240+0000 7fe83939d640 1 Processor -- start 2024-04-23T01:38:39.238 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.240+0000 7fe83939d640 1 -- start start 2024-04-23T01:38:39.238 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe83939d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe83411c640 0x7fe83411ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:39.238 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe83939d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe83411f030 con 0x7fe834113990 2024-04-23T01:38:39.239 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe83939d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe8341201d0 con 0x7fe83411c640 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe8327fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe83411c640 0x7fe83411ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe8327fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe83411c640 0x7fe83411ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57448/0 (socket says 172.21.15.191:57448) 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe832ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe834113990 0x7fe834113da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.191:60256/0 (socket says 172.21.15.191:60256) 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe8327fc640 1 -- 172.21.15.191:0/3262875410 learned_addr learned my addr 172.21.15.191:0/3262875410 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe8327fc640 1 -- 172.21.15.191:0/3262875410 >> v1:172.21.15.37:6789/0 conn(0x7fe834113990 legacy=0x7fe834113da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.241+0000 7fe8327fc640 1 -- 172.21.15.191:0/3262875410 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe834120310 con 0x7fe83411c640 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe8327fc640 1 --2- 172.21.15.191:0/3262875410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe83411c640 0x7fe83411ea60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240c3ea82f9abcd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe831ffb640 1 -- 172.21.15.191:0/3262875410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe824009e50 con 0x7fe83411c640 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe831ffb640 1 -- 172.21.15.191:0/3262875410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe82400e230 con 0x7fe83411c640 2024-04-23T01:38:39.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe831ffb640 1 -- 172.21.15.191:0/3262875410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe82400e4d0 con 0x7fe83411c640 2024-04-23T01:38:39.241 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe83939d640 1 -- 172.21.15.191:0/3262875410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe83411c640 msgr2=0x7fe83411ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.241 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe83939d640 1 --2- 172.21.15.191:0/3262875410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe83411c640 0x7fe83411ea60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.242 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe83939d640 1 -- 172.21.15.191:0/3262875410 shutdown_connections 2024-04-23T01:38:39.242 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe83939d640 1 --2- 172.21.15.191:0/3262875410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe83411c640 0x7fe83411ea60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.242 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.242+0000 7fe83939d640 1 -- 172.21.15.191:0/3262875410 >> 172.21.15.191:0/3262875410 conn(0x7fe83406eda0 msgr2=0x7fe834111d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:39.242 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.243+0000 7fe83939d640 1 -- 172.21.15.191:0/3262875410 shutdown_connections 2024-04-23T01:38:39.242 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.243+0000 7fe83939d640 1 -- 172.21.15.191:0/3262875410 wait complete. 2024-04-23T01:38:39.242 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.243+0000 7fe83939d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:39.242 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:39.243+0000 7fc956571000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T01:38:39.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.243+0000 7fe83939d640 1 Processor -- start 2024-04-23T01:38:39.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.244+0000 7fe83939d640 1 -- start start 2024-04-23T01:38:39.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.244+0000 7fe83939d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe834113990 0x7fe8341ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:39.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.244+0000 7fe83939d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8341ae6d0 con 0x7fe834113990 2024-04-23T01:38:39.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.244+0000 7fe832ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe834113990 0x7fe8341ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:39.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.244+0000 7fe832ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe834113990 0x7fe8341ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.191:57456/0 (socket says 172.21.15.191:57456) 2024-04-23T01:38:39.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.244+0000 7fe832ffd640 1 -- 172.21.15.191:0/308470134 learned_addr learned my addr 172.21.15.191:0/308470134 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe832ffd640 1 -- 172.21.15.191:0/308470134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8341ae810 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe832ffd640 1 --2- 172.21.15.191:0/308470134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe834113990 0x7fe8341ae100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe82b7fe640 1 -- 172.21.15.191:0/308470134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe81c0059a0 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe82b7fe640 1 -- 172.21.15.191:0/308470134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe81c005b00 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8341aea60 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe82b7fe640 1 -- 172.21.15.191:0/308470134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe81c005da0 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8341a84e0 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe82b7fe640 1 -- 172.21.15.191:0/308470134 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fe81c007440 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.245+0000 7fe82b7fe640 1 -- 172.21.15.191:0/308470134 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7fe81c00faf0 con 0x7fe834113990 2024-04-23T01:38:39.245 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.246+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe834063880 con 0x7fe834113990 2024-04-23T01:38:39.246 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.249+0000 7fe82b7fe640 1 -- 172.21.15.191:0/308470134 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fe81c00fcb0 con 0x7fe834113990 2024-04-23T01:38:39.319 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.321+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e191d386-d82b-47ee-b6c7-5154e1d630c4", "id": 3} v 0) -- 0x7fe83411c710 con 0x7fe834113990 2024-04-23T01:38:39.322 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.325+0000 7fe82b7fe640 1 -- 172.21.15.191:0/308470134 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e191d386-d82b-47ee-b6c7-5154e1d630c4", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7fe81c00f640 con 0x7fe834113990 2024-04-23T01:38:39.323 INFO:teuthology.orchestra.run.smithi191.stdout:3 2024-04-23T01:38:39.324 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.326+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe834113990 msgr2=0x7fe8341ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.324 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.326+0000 7fe83939d640 1 --2- 172.21.15.191:0/308470134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe834113990 0x7fe8341ae100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.324 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.326+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 shutdown_connections 2024-04-23T01:38:39.324 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.326+0000 7fe83939d640 1 --2- 172.21.15.191:0/308470134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe834113990 0x7fe8341ae100 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.324 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.326+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 >> 172.21.15.191:0/308470134 conn(0x7fe83406eda0 msgr2=0x7fe83411dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:39.324 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.326+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 shutdown_connections 2024-04-23T01:38:39.324 INFO:teuthology.orchestra.run.smithi191.stderr:2024-04-23T01:38:39.326+0000 7fe83939d640 1 -- 172.21.15.191:0/308470134 wait complete. 2024-04-23T01:38:39.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-04-23T01:38:39.370 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-23T01:38:39.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-04-23T01:38:39.413 INFO:tasks.ceph.osd.0:Started 2024-04-23T01:38:39.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-04-23T01:38:39.446 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-23T01:38:39.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-04-23T01:38:39.489 INFO:tasks.ceph.osd.1:Started 2024-04-23T01:38:39.489 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-04-23T01:38:39.518 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-23T01:38:39.519 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-04-23T01:38:39.561 INFO:tasks.ceph.osd.2:Started 2024-04-23T01:38:39.561 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-04-23T01:38:39.590 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T01:38:39.591 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-04-23T01:38:39.633 INFO:tasks.ceph.osd.3:Started 2024-04-23T01:38:39.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T01:38:39.641 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:39.643+0000 7fc956571000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T01:38:39.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.750+0000 7f7d01a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.755+0000 7f7d01a6d640 1 Processor -- start 2024-04-23T01:38:39.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.755+0000 7f7d01a6d640 1 -- start start 2024-04-23T01:38:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7d01a6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7cfc0a11e0 0x7f7cfc06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7d01a6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cfc1321e0 con 0x7f7cfc09fe50 2024-04-23T01:38:39.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7d01a6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7cfc0a0d90 con 0x7f7cfc0a11e0 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7cfc0a11e0 0x7f7cfc06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7cfc09fe50 0x7f7cfc134e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36742/0 (socket says 172.21.15.37:36742) 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfaffd640 1 -- 172.21.15.37:0/1736699096 learned_addr learned my addr 172.21.15.37:0/1736699096 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfb7fe640 1 -- 172.21.15.37:0/1736699096 >> v1:172.21.15.37:6789/0 conn(0x7f7cfc09fe50 legacy=0x7f7cfc134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfb7fe640 1 -- 172.21.15.37:0/1736699096 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc131ed0 con 0x7f7cfc0a11e0 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfa7fc640 1 -- 172.21.15.37:0/1736699096 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345331922 0 0) 0x7f7cfc1321e0 con 0x7f7cfc09fe50 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfb7fe640 1 --2- 172.21.15.37:0/1736699096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc0a11e0 0x7f7cfc06ec40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc53b092c3901874 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfa7fc640 1 -- 172.21.15.37:0/1736699096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec009d90 con 0x7f7cfc0a11e0 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfa7fc640 1 -- 172.21.15.37:0/1736699096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7cec00e230 con 0x7f7cfc0a11e0 2024-04-23T01:38:39.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.757+0000 7f7cfa7fc640 1 -- 172.21.15.37:0/1736699096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec00e4d0 con 0x7f7cfc0a11e0 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 1 -- 172.21.15.37:0/1736699096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc0a11e0 msgr2=0x7f7cfc06ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 1 --2- 172.21.15.37:0/1736699096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc0a11e0 0x7f7cfc06ec40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 1 -- 172.21.15.37:0/1736699096 shutdown_connections 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 1 --2- 172.21.15.37:0/1736699096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc0a11e0 0x7f7cfc06ec40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 1 -- 172.21.15.37:0/1736699096 >> 172.21.15.37:0/1736699096 conn(0x7f7cfc0a5050 msgr2=0x7f7cfc0a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 1 -- 172.21.15.37:0/1736699096 shutdown_connections 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 1 -- 172.21.15.37:0/1736699096 wait complete. 2024-04-23T01:38:39.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.758+0000 7f7d01a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.760+0000 7f7d01a6d640 1 Processor -- start 2024-04-23T01:38:39.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.760+0000 7f7d01a6d640 1 -- start start 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.762+0000 7f7d01a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc09fe50 0x7f7cfc11e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.762+0000 7f7d01a6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc121bd0 con 0x7f7cfc09fe50 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.762+0000 7f7cfb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc09fe50 0x7f7cfc11e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.762+0000 7f7cfb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc09fe50 0x7f7cfc11e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43726/0 (socket says 172.21.15.37:43726) 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.762+0000 7f7cfb7fe640 1 -- 172.21.15.37:0/3698153628 learned_addr learned my addr 172.21.15.37:0/3698153628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7cfb7fe640 1 -- 172.21.15.37:0/3698153628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc120970 con 0x7f7cfc09fe50 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7cfb7fe640 1 --2- 172.21.15.37:0/3698153628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc09fe50 0x7f7cfc11e190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7ce3fff640 1 -- 172.21.15.37:0/3698153628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec013610 con 0x7f7cfc09fe50 2024-04-23T01:38:39.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7ce3fff640 1 -- 172.21.15.37:0/3698153628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7cec013770 con 0x7f7cfc09fe50 2024-04-23T01:38:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cfc120fe0 con 0x7f7cfc09fe50 2024-04-23T01:38:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7ce3fff640 1 -- 172.21.15.37:0/3698153628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cec013a10 con 0x7f7cfc09fe50 2024-04-23T01:38:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cfc120650 con 0x7f7cfc09fe50 2024-04-23T01:38:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7ce3fff640 1 -- 172.21.15.37:0/3698153628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f7cec0123f0 con 0x7f7cfc09fe50 2024-04-23T01:38:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.763+0000 7f7ce3fff640 1 -- 172.21.15.37:0/3698153628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f7cec018040 con 0x7f7cfc09fe50 2024-04-23T01:38:39.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.764+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cfc122340 con 0x7f7cfc09fe50 2024-04-23T01:38:39.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.767+0000 7f7ce3fff640 1 -- 172.21.15.37:0/3698153628 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f7cec011bc0 con 0x7f7cfc09fe50 2024-04-23T01:38:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.849+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cfc063880 con 0x7f7cfc09fe50 2024-04-23T01:38:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.849+0000 7f7ce3fff640 1 -- 172.21.15.37:0/3698153628 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f7cec011e10 con 0x7f7cfc09fe50 2024-04-23T01:38:39.847 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:39.847 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"fsid":"e132a9f8-f5c5-4318-805c-a5b188312643","created":"2024-04-23T01:38:37.200203+0000","modified":"2024-04-23T01:38:39.323031+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T01:38:39.323031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"9aacf45a-9611-4f14-9dea-50f0fc0f3a3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ed271568-29f8-4d1b-a810-ca3b16b2682d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d9c96632-2efd-4fc2-8d5a-896bbe7a5204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e191d386-d82b-47ee-b6c7-5154e1d630c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T01:38:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.850+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc09fe50 msgr2=0x7f7cfc11e190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.850+0000 7f7d01a6d640 1 --2- 172.21.15.37:0/3698153628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc09fe50 0x7f7cfc11e190 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.850+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 shutdown_connections 2024-04-23T01:38:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.850+0000 7f7d01a6d640 1 --2- 172.21.15.37:0/3698153628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cfc09fe50 0x7f7cfc11e190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.850+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 >> 172.21.15.37:0/3698153628 conn(0x7f7cfc0a5050 msgr2=0x7f7cfc130e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.850+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 shutdown_connections 2024-04-23T01:38:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:39.850+0000 7f7d01a6d640 1 -- 172.21.15.37:0/3698153628 wait complete. 2024-04-23T01:38:39.859 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-23T01:38:39.859 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-23T01:38:39.929 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:39.932+0000 7fc956571000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T01:38:39.985 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:39.987+0000 7fc956571000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T01:38:40.108 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.110+0000 7fc956571000 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T01:38:40.262 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T01:38:40.368 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.366+0000 7f2c212ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:40.369 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.372+0000 7f2c212ed640 1 Processor -- start 2024-04-23T01:38:40.369 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.372+0000 7f2c212ed640 1 -- start start 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.373+0000 7f2c212ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c1c137d90 0x7f2c1c13a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.373+0000 7f2c212ed640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1c0a1260 con 0x7f2c1c0a2130 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.373+0000 7f2c212ed640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1c0a2c50 con 0x7f2c1c137d90 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c13fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c1c137d90 0x7f2c1c13a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c1affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c1c0a2130 0x7f2c1c0a2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36754/0 (socket says 172.21.15.37:36754) 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c1affd640 1 -- 172.21.15.37:0/715967921 learned_addr learned my addr 172.21.15.37:0/715967921 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c13fff640 1 -- 172.21.15.37:0/715967921 >> v1:172.21.15.37:6789/0 conn(0x7f2c1c0a2130 legacy=0x7f2c1c0a2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:40.372 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c13fff640 1 -- 172.21.15.37:0/715967921 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c09bb80 con 0x7f2c1c137d90 2024-04-23T01:38:40.373 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c13fff640 1 --2- 172.21.15.37:0/715967921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c137d90 0x7f2c1c13a1b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2271fa1147e9a28b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:40.373 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c1a7fc640 1 -- 172.21.15.37:0/715967921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c04009d90 con 0x7f2c1c137d90 2024-04-23T01:38:40.373 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c1a7fc640 1 -- 172.21.15.37:0/715967921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c0400e230 con 0x7f2c1c137d90 2024-04-23T01:38:40.373 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.374+0000 7f2c1a7fc640 1 -- 172.21.15.37:0/715967921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c0400e4d0 con 0x7f2c1c137d90 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.375+0000 7f2c212ed640 1 -- 172.21.15.37:0/715967921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c137d90 msgr2=0x7f2c1c13a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.375+0000 7f2c212ed640 1 --2- 172.21.15.37:0/715967921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c137d90 0x7f2c1c13a1b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.375+0000 7f2c212ed640 1 -- 172.21.15.37:0/715967921 shutdown_connections 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.375+0000 7f2c212ed640 1 --2- 172.21.15.37:0/715967921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c137d90 0x7f2c1c13a1b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.375+0000 7f2c212ed640 1 -- 172.21.15.37:0/715967921 >> 172.21.15.37:0/715967921 conn(0x7f2c1c0a3b00 msgr2=0x7f2c1c0a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.375+0000 7f2c212ed640 1 -- 172.21.15.37:0/715967921 shutdown_connections 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.375+0000 7f2c212ed640 1 -- 172.21.15.37:0/715967921 wait complete. 2024-04-23T01:38:40.374 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.376+0000 7f2c212ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:40.375 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.377+0000 7f2c212ed640 1 Processor -- start 2024-04-23T01:38:40.375 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.377+0000 7f2c212ed640 1 -- start start 2024-04-23T01:38:40.377 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.379+0000 7f2c212ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c0a2130 0x7f2c1c1c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:40.377 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.379+0000 7f2c212ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c120b50 con 0x7f2c1c0a2130 2024-04-23T01:38:40.377 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.379+0000 7f2c1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c0a2130 0x7f2c1c1c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:40.377 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.379+0000 7f2c1affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c0a2130 0x7f2c1c1c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43748/0 (socket says 172.21.15.37:43748) 2024-04-23T01:38:40.377 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.379+0000 7f2c1affd640 1 -- 172.21.15.37:0/2351239403 learned_addr learned my addr 172.21.15.37:0/2351239403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:40.377 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c1affd640 1 -- 172.21.15.37:0/2351239403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c1c6230 con 0x7f2c1c0a2130 2024-04-23T01:38:40.378 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c1affd640 1 --2- 172.21.15.37:0/2351239403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c0a2130 0x7f2c1c1c65d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:40.378 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c137fe640 1 -- 172.21.15.37:0/2351239403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c0c005a60 con 0x7f2c1c0a2130 2024-04-23T01:38:40.379 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c137fe640 1 -- 172.21.15.37:0/2351239403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2c0c005bc0 con 0x7f2c1c0a2130 2024-04-23T01:38:40.379 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c137fe640 1 -- 172.21.15.37:0/2351239403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2c0c005e60 con 0x7f2c1c0a2130 2024-04-23T01:38:40.379 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c122f20 con 0x7f2c1c0a2130 2024-04-23T01:38:40.379 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c121ba0 con 0x7f2c1c0a2130 2024-04-23T01:38:40.379 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c137fe640 1 -- 172.21.15.37:0/2351239403 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f2c0c00cb10 con 0x7f2c1c0a2130 2024-04-23T01:38:40.379 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.380+0000 7f2c137fe640 1 -- 172.21.15.37:0/2351239403 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f2c0c00fb60 con 0x7f2c1c0a2130 2024-04-23T01:38:40.379 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.381+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c063880 con 0x7f2c1c0a2130 2024-04-23T01:38:40.381 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.384+0000 7f2c137fe640 1 -- 172.21.15.37:0/2351239403 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f2c0c00fdc0 con 0x7f2c1c0a2130 2024-04-23T01:38:40.409 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.411+0000 7fc956571000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T01:38:40.444 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.446+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c1c121380 con 0x7f2c1c0a2130 2024-04-23T01:38:40.444 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.447+0000 7f2c137fe640 1 -- 172.21.15.37:0/2351239403 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f2c0c00f640 con 0x7f2c1c0a2130 2024-04-23T01:38:40.445 INFO:teuthology.misc.health.smithi037.stdout: 2024-04-23T01:38:40.445 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":7,"fsid":"e132a9f8-f5c5-4318-805c-a5b188312643","created":"2024-04-23T01:38:37.200203+0000","modified":"2024-04-23T01:38:39.323031+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T01:38:39.323031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"9aacf45a-9611-4f14-9dea-50f0fc0f3a3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ed271568-29f8-4d1b-a810-ca3b16b2682d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d9c96632-2efd-4fc2-8d5a-896bbe7a5204","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e191d386-d82b-47ee-b6c7-5154e1d630c4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T01:38:40.446 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.448+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c0a2130 msgr2=0x7f2c1c1c65d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:40.446 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.448+0000 7f2c212ed640 1 --2- 172.21.15.37:0/2351239403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c0a2130 0x7f2c1c1c65d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:40.446 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.448+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 shutdown_connections 2024-04-23T01:38:40.447 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.448+0000 7f2c212ed640 1 --2- 172.21.15.37:0/2351239403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c1c0a2130 0x7f2c1c1c65d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:40.447 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.448+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 >> 172.21.15.37:0/2351239403 conn(0x7f2c1c0a3b00 msgr2=0x7f2c1c134890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:40.447 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.448+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 shutdown_connections 2024-04-23T01:38:40.447 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:40.448+0000 7f2c212ed640 1 -- 172.21.15.37:0/2351239403 wait complete. 2024-04-23T01:38:40.459 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-23T01:38:40.461 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.463+0000 7fc956571000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T01:38:40.631 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.634+0000 7fc956571000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T01:38:40.767 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.769+0000 7fc956571000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T01:38:40.818 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.821+0000 7fc956571000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T01:38:40.891 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.893+0000 7fc956571000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T01:38:40.938 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:40.940+0000 7fc956571000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T01:38:41.577 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:41.579+0000 7fc956571000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T01:38:41.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:41.741+0000 7fc956571000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T01:38:42.754 INFO:tasks.ceph.mgr.x.smithi191.stderr:2024-04-23T01:38:42.756+0000 7fc8f57d0640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-23T01:38:46.863 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T01:38:46.974 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.972+0000 7f0e33aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:46.975 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.977+0000 7f0e33aad640 1 Processor -- start 2024-04-23T01:38:46.975 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.978+0000 7f0e33aad640 1 -- start start 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.979+0000 7f0e33aad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e2c0a2130 0x7f0e2c0a2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.979+0000 7f0e33aad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e2c0a1260 con 0x7f0e2c134a80 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.979+0000 7f0e33aad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0e2c0a3450 con 0x7f0e2c0a2130 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.979+0000 7f0e31849640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0e2c0a2130 0x7f0e2c0a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.979+0000 7f0e31048640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0e2c134a80 0x7f0e2c134e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36766/0 (socket says 172.21.15.37:36766) 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.979+0000 7f0e31048640 1 -- 172.21.15.37:0/1241670884 learned_addr learned my addr 172.21.15.37:0/1241670884 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.980+0000 7f0e31849640 1 -- 172.21.15.37:0/1241670884 >> v1:172.21.15.37:6789/0 conn(0x7f0e2c134a80 legacy=0x7f0e2c134e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.980+0000 7f0e31849640 1 -- 172.21.15.37:0/1241670884 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c09bb80 con 0x7f0e2c0a2130 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.980+0000 7f0e31849640 1 --2- 172.21.15.37:0/1241670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c0a2540 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2527151bbf1347 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.980+0000 7f0e30847640 1 -- 172.21.15.37:0/1241670884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e2800e040 con 0x7f0e2c0a2130 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.980+0000 7f0e30847640 1 -- 172.21.15.37:0/1241670884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0e28007670 con 0x7f0e2c0a2130 2024-04-23T01:38:46.978 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.980+0000 7f0e30847640 1 -- 172.21.15.37:0/1241670884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e28007910 con 0x7f0e2c0a2130 2024-04-23T01:38:46.979 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 1 -- 172.21.15.37:0/1241670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 msgr2=0x7f0e2c0a2540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:46.980 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 1 --2- 172.21.15.37:0/1241670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c0a2540 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:46.980 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 1 -- 172.21.15.37:0/1241670884 shutdown_connections 2024-04-23T01:38:46.980 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 1 --2- 172.21.15.37:0/1241670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c0a2540 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:46.980 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 1 -- 172.21.15.37:0/1241670884 >> 172.21.15.37:0/1241670884 conn(0x7f0e2c0a3b00 msgr2=0x7f0e2c0a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:46.980 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 1 -- 172.21.15.37:0/1241670884 shutdown_connections 2024-04-23T01:38:46.980 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 1 -- 172.21.15.37:0/1241670884 wait complete. 2024-04-23T01:38:46.980 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.981+0000 7f0e33aad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:46.981 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.983+0000 7f0e33aad640 1 Processor -- start 2024-04-23T01:38:46.981 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.983+0000 7f0e33aad640 1 -- start start 2024-04-23T01:38:46.983 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.985+0000 7f0e33aad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:46.983 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.985+0000 7f0e33aad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c11e3e0 con 0x7f0e2c0a2130 2024-04-23T01:38:46.983 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.985+0000 7f0e31849640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.985+0000 7f0e31849640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c11e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43772/0 (socket says 172.21.15.37:43772) 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.985+0000 7f0e31849640 1 -- 172.21.15.37:0/3836559473 learned_addr learned my addr 172.21.15.37:0/3836559473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.985+0000 7f0e31849640 1 -- 172.21.15.37:0/3836559473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c120360 con 0x7f0e2c0a2130 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.985+0000 7f0e31849640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c11e7a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.986+0000 7f0e227fc640 1 -- 172.21.15.37:0/3836559473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e2800e040 con 0x7f0e2c0a2130 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.986+0000 7f0e227fc640 1 -- 172.21.15.37:0/3836559473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0e28012a20 con 0x7f0e2c0a2130 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.986+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c11e040 con 0x7f0e2c0a2130 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.986+0000 7f0e227fc640 1 -- 172.21.15.37:0/3836559473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0e28012cc0 con 0x7f0e2c0a2130 2024-04-23T01:38:46.984 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.986+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c121470 con 0x7f0e2c0a2130 2024-04-23T01:38:46.985 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.987+0000 7f0e227fc640 1 -- 172.21.15.37:0/3836559473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7f0e280153f0 con 0x7f0e2c0a2130 2024-04-23T01:38:46.985 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.987+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2c063880 con 0x7f0e2c0a2130 2024-04-23T01:38:46.985 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.987+0000 7f0e227fc640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0e100388a0 0x7f0e1003adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:46.985 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.987+0000 7f0e227fc640 1 -- 172.21.15.37:0/3836559473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f0e28049970 con 0x7f0e2c0a2130 2024-04-23T01:38:46.986 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.987+0000 7f0e31048640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0e100388a0 0x7f0e1003adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:46.986 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.988+0000 7f0e31048640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0e100388a0 0x7f0e1003adb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:46.991 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:46.993+0000 7f0e227fc640 1 -- 172.21.15.37:0/3836559473 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f0e2800fc80 con 0x7f0e2c0a2130 2024-04-23T01:38:47.178 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.181+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e2c06cc30 con 0x7f0e2c0a2130 2024-04-23T01:38:47.179 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.182+0000 7f0e227fc640 1 -- 172.21.15.37:0/3836559473 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6947 (crc 0 0 0) 0x7f0e28012100 con 0x7f0e2c0a2130 2024-04-23T01:38:47.179 INFO:teuthology.misc.health.smithi037.stdout: 2024-04-23T01:38:47.179 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":11,"fsid":"e132a9f8-f5c5-4318-805c-a5b188312643","created":"2024-04-23T01:38:37.200203+0000","modified":"2024-04-23T01:38:46.788528+0000","last_up_change":"2024-04-23T01:38:43.779753+0000","last_in_change":"2024-04-23T01:38:39.323031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T01:38:45.767564+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9aacf45a-9611-4f14-9dea-50f0fc0f3a3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1949701083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":1949701083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1949701083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":1949701083}]},"public_addr":"172.21.15.37:6802/1949701083","cluster_addr":"172.21.15.37:6801/1949701083","heartbeat_back_addr":"172.21.15.37:6800/1949701083","heartbeat_front_addr":"172.21.15.37:6803/1949701083","state":["exists","up"]},{"osd":1,"uuid":"ed271568-29f8-4d1b-a810-ca3b16b2682d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1977556410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1977556410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1977556410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1977556410}]},"public_addr":"172.21.15.37:6805/1977556410","cluster_addr":"172.21.15.37:6804/1977556410","heartbeat_back_addr":"172.21.15.37:6808/1977556410","heartbeat_front_addr":"172.21.15.37:6807/1977556410","state":["exists","up"]},{"osd":2,"uuid":"d9c96632-2efd-4fc2-8d5a-896bbe7a5204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6805","nonce":3894758024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3894758024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":3894758024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3894758024}]},"public_addr":"172.21.15.191:6805/3894758024","cluster_addr":"172.21.15.191:6804/3894758024","heartbeat_back_addr":"172.21.15.191:6807/3894758024","heartbeat_front_addr":"172.21.15.191:6812/3894758024","state":["exists","up"]},{"osd":3,"uuid":"e191d386-d82b-47ee-b6c7-5154e1d630c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1018833307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":1018833307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1018833307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":1018833307}]},"public_addr":"172.21.15.191:6808/1018833307","cluster_addr":"172.21.15.191:6809/1018833307","heartbeat_back_addr":"172.21.15.191:6810/1018833307","heartbeat_front_addr":"172.21.15.191:6811/1018833307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T01:38:47.182 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0e100388a0 msgr2=0x7f0e1003adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.182 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0e100388a0 0x7f0e1003adb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.182 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 msgr2=0x7f0e2c11e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.182 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c11e7a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.182 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 shutdown_connections 2024-04-23T01:38:47.183 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0e100388a0 0x7f0e1003adb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.183 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 --2- 172.21.15.37:0/3836559473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e2c0a2130 0x7f0e2c11e7a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.183 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 >> 172.21.15.37:0/3836559473 conn(0x7f0e2c0a3b00 msgr2=0x7f0e2c1bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:47.183 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 shutdown_connections 2024-04-23T01:38:47.183 INFO:teuthology.misc.health.smithi037.stderr:2024-04-23T01:38:47.184+0000 7f0e33aad640 1 -- 172.21.15.37:0/3836559473 wait complete. 2024-04-23T01:38:47.192 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-23T01:38:47.193 INFO:tasks.ceph:Creating RBD pool 2024-04-23T01:38:47.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-23T01:38:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.302+0000 7f13af82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:47.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.311+0000 7f13af82d640 1 Processor -- start 2024-04-23T01:38:47.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.311+0000 7f13af82d640 1 -- start start 2024-04-23T01:38:47.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13af82d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13a80a1100 0x7f13a8131dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13af82d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13a8132720 con 0x7f13a8132310 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13af82d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f13a80a0440 con 0x7f13a80a1100 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13ad5c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13a80a1100 0x7f13a8131dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13acdc8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f13a8132310 0x7f13a8134d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36772/0 (socket says 172.21.15.37:36772) 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13acdc8640 1 -- 172.21.15.37:0/2077713081 learned_addr learned my addr 172.21.15.37:0/2077713081 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13ad5c9640 1 -- 172.21.15.37:0/2077713081 >> v1:172.21.15.37:6789/0 conn(0x7f13a8132310 legacy=0x7f13a8134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.313+0000 7f13ad5c9640 1 -- 172.21.15.37:0/2077713081 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a8131820 con 0x7f13a80a1100 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.314+0000 7f13ad5c9640 1 --2- 172.21.15.37:0/2077713081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8131dd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fb82de6eb118a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.314+0000 7f139ffff640 1 -- 172.21.15.37:0/2077713081 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1398009d90 con 0x7f13a80a1100 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.314+0000 7f139ffff640 1 -- 172.21.15.37:0/2077713081 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f139800e230 con 0x7f13a80a1100 2024-04-23T01:38:47.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.314+0000 7f139ffff640 1 -- 172.21.15.37:0/2077713081 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f139800e4d0 con 0x7f13a80a1100 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 1 -- 172.21.15.37:0/2077713081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 msgr2=0x7f13a8131dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 1 --2- 172.21.15.37:0/2077713081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8131dd0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 1 -- 172.21.15.37:0/2077713081 shutdown_connections 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 1 --2- 172.21.15.37:0/2077713081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8131dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 1 -- 172.21.15.37:0/2077713081 >> 172.21.15.37:0/2077713081 conn(0x7f13a80a4eb0 msgr2=0x7f13a80a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 1 -- 172.21.15.37:0/2077713081 shutdown_connections 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 1 -- 172.21.15.37:0/2077713081 wait complete. 2024-04-23T01:38:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.315+0000 7f13af82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.317+0000 7f13af82d640 1 Processor -- start 2024-04-23T01:38:47.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.317+0000 7f13af82d640 1 -- start start 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.318+0000 7f13af82d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8120410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.318+0000 7f13af82d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13a8131610 con 0x7f13a80a1100 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f13ad5c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8120410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f13ad5c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8120410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43790/0 (socket says 172.21.15.37:43790) 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f13ad5c9640 1 -- 172.21.15.37:0/3048064556 learned_addr learned my addr 172.21.15.37:0/3048064556 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f13ad5c9640 1 -- 172.21.15.37:0/3048064556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a8121230 con 0x7f13a80a1100 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f13ad5c9640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8120410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:47.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1398014620 con 0x7f13a80a1100 2024-04-23T01:38:47.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1398014780 con 0x7f13a80a1100 2024-04-23T01:38:47.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a8120cb0 con 0x7f13a80a1100 2024-04-23T01:38:47.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.319+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1398014a20 con 0x7f13a80a1100 2024-04-23T01:38:47.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.320+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a811fc80 con 0x7f13a80a1100 2024-04-23T01:38:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.321+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7f1398014bd0 con 0x7f13a80a1100 2024-04-23T01:38:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.321+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13a8120ea0 con 0x7f13a80a1100 2024-04-23T01:38:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.321+0000 7f139dffb640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f138c0388f0 0x7f138c03ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.321+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f1398019040 con 0x7f13a80a1100 2024-04-23T01:38:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.321+0000 7f13acdc8640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f138c0388f0 0x7f138c03ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.322+0000 7f13acdc8640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f138c0388f0 0x7f138c03ae00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:47.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.327+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f13980185a0 con 0x7f13a80a1100 2024-04-23T01:38:47.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.514+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f13a811fed0 con 0x7f13a80a1100 2024-04-23T01:38:47.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.797+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f139800a0d0 con 0x7f13a80a1100 2024-04-23T01:38:47.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.801+0000 7f139dffb640 1 -- 172.21.15.37:0/3048064556 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7f13980104d0 con 0x7f13a80a1100 2024-04-23T01:38:47.799 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2024-04-23T01:38:47.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f138c0388f0 msgr2=0x7f138c03ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f138c0388f0 0x7f138c03ae00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 msgr2=0x7f13a8120410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8120410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 shutdown_connections 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f138c0388f0 0x7f138c03ae00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 --2- 172.21.15.37:0/3048064556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a80a1100 0x7f13a8120410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 >> 172.21.15.37:0/3048064556 conn(0x7f13a80a4eb0 msgr2=0x7f13a81bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 shutdown_connections 2024-04-23T01:38:47.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.803+0000 7f13af82d640 1 -- 172.21.15.37:0/3048064556 wait complete. 2024-04-23T01:38:47.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-23T01:38:47.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.954+0000 7f4a5e59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:47.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.965+0000 7f4a5e59d640 1 Processor -- start 2024-04-23T01:38:47.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.965+0000 7f4a5e59d640 1 -- start start 2024-04-23T01:38:47.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a5e59d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a58137eb0 0x7f4a5813a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a5e59d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a580a1090 con 0x7f4a58131b30 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a5e59d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4a580a07a0 con 0x7f4a58137eb0 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a58137eb0 0x7f4a5813a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a57fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a58131b30 0x7f4a58131f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36784/0 (socket says 172.21.15.37:36784) 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a58137eb0 0x7f4a5813a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43802/0 (socket says 172.21.15.37:43802) 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a57fff640 1 -- 172.21.15.37:0/3329791248 learned_addr learned my addr 172.21.15.37:0/3329791248 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a577fe640 1 -- 172.21.15.37:0/3329791248 >> v1:172.21.15.37:6789/0 conn(0x7f4a58131b30 legacy=0x7f4a58131f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a577fe640 1 -- 172.21.15.37:0/3329791248 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a58131700 con 0x7f4a58137eb0 2024-04-23T01:38:47.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.967+0000 7f4a577fe640 1 --2- 172.21.15.37:0/3329791248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58137eb0 0x7f4a5813a2d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723e29dfd567782e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:47.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.968+0000 7f4a56ffd640 1 -- 172.21.15.37:0/3329791248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a48009d90 con 0x7f4a58137eb0 2024-04-23T01:38:47.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.968+0000 7f4a56ffd640 1 -- 172.21.15.37:0/3329791248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a4800e230 con 0x7f4a58137eb0 2024-04-23T01:38:47.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.968+0000 7f4a56ffd640 1 -- 172.21.15.37:0/3329791248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a4800e4d0 con 0x7f4a58137eb0 2024-04-23T01:38:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.968+0000 7f4a5e59d640 1 -- 172.21.15.37:0/3329791248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58137eb0 msgr2=0x7f4a5813a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.968+0000 7f4a5e59d640 1 --2- 172.21.15.37:0/3329791248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58137eb0 0x7f4a5813a2d0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.969+0000 7f4a5e59d640 1 -- 172.21.15.37:0/3329791248 shutdown_connections 2024-04-23T01:38:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.969+0000 7f4a5e59d640 1 --2- 172.21.15.37:0/3329791248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58137eb0 0x7f4a5813a2d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:47.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.969+0000 7f4a5e59d640 1 -- 172.21.15.37:0/3329791248 >> 172.21.15.37:0/3329791248 conn(0x7f4a580a3b00 msgr2=0x7f4a580a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:47.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.969+0000 7f4a5e59d640 1 -- 172.21.15.37:0/3329791248 shutdown_connections 2024-04-23T01:38:47.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.969+0000 7f4a5e59d640 1 -- 172.21.15.37:0/3329791248 wait complete. 2024-04-23T01:38:47.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.969+0000 7f4a5e59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:47.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.971+0000 7f4a5e59d640 1 Processor -- start 2024-04-23T01:38:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.971+0000 7f4a5e59d640 1 -- start start 2024-04-23T01:38:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.972+0000 7f4a5e59d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58131b30 0x7f4a5811d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.972+0000 7f4a5e59d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a58074f30 con 0x7f4a58131b30 2024-04-23T01:38:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.972+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58131b30 0x7f4a5811d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a57fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58131b30 0x7f4a5811d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43818/0 (socket says 172.21.15.37:43818) 2024-04-23T01:38:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a57fff640 1 -- 172.21.15.37:0/2643957325 learned_addr learned my addr 172.21.15.37:0/2643957325 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a57fff640 1 -- 172.21.15.37:0/2643957325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a581313b0 con 0x7f4a58131b30 2024-04-23T01:38:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a57fff640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58131b30 0x7f4a5811d4b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a54ff9640 1 -- 172.21.15.37:0/2643957325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a4c005a60 con 0x7f4a58131b30 2024-04-23T01:38:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a54ff9640 1 -- 172.21.15.37:0/2643957325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a4c005bc0 con 0x7f4a58131b30 2024-04-23T01:38:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a54ff9640 1 -- 172.21.15.37:0/2643957325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a4c005e60 con 0x7f4a58131b30 2024-04-23T01:38:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a581310c0 con 0x7f4a58131b30 2024-04-23T01:38:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.973+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a58121190 con 0x7f4a58131b30 2024-04-23T01:38:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.974+0000 7f4a54ff9640 1 -- 172.21.15.37:0/2643957325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4a4c0070b0 con 0x7f4a58131b30 2024-04-23T01:38:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.974+0000 7f4a54ff9640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4a44038930 0x7f4a4403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.975+0000 7f4a54ff9640 1 -- 172.21.15.37:0/2643957325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7f4a4c048150 con 0x7f4a58131b30 2024-04-23T01:38:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.975+0000 7f4a577fe640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4a44038930 0x7f4a4403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.975+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a58063880 con 0x7f4a58131b30 2024-04-23T01:38:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.975+0000 7f4a577fe640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4a44038930 0x7f4a4403ae40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:47.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:47.981+0000 7f4a54ff9640 1 -- 172.21.15.37:0/2643957325 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4a4c00d710 con 0x7f4a58131b30 2024-04-23T01:38:48.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.170+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f4a5811f930 con 0x7f4a58131b30 2024-04-23T01:38:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.802+0000 7f4a54ff9640 1 -- 172.21.15.37:0/2643957325 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 173+0+0 (crc 0 0 0) 0x7f4a4c00d150 con 0x7f4a58131b30 2024-04-23T01:38:48.800 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-23T01:38:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4a44038930 msgr2=0x7f4a4403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4a44038930 0x7f4a4403ae40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58131b30 msgr2=0x7f4a5811d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58131b30 0x7f4a5811d4b0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 shutdown_connections 2024-04-23T01:38:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4a44038930 0x7f4a4403ae40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:48.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 --2- 172.21.15.37:0/2643957325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a58131b30 0x7f4a5811d4b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 >> 172.21.15.37:0/2643957325 conn(0x7f4a580a3b00 msgr2=0x7f4a581bcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 shutdown_connections 2024-04-23T01:38:48.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.805+0000 7f4a5e59d640 1 -- 172.21.15.37:0/2643957325 wait complete. 2024-04-23T01:38:48.818 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-23T01:38:48.819 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T01:38:48.819 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-23T01:38:48.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-23T01:38:48.820 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-23T01:38:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.959+0000 7f4d8d26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.964+0000 7f4d8d26d640 1 Processor -- start 2024-04-23T01:38:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.964+0000 7f4d8d26d640 1 -- start start 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d8d26d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d880713b0 0x7f4d880717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d8d26d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d88074210 con 0x7f4d88071d00 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d8d26d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4d88073810 con 0x7f4d880713b0 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d86ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d880713b0 0x7f4d880717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d867fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4d88071d00 0x7f4d88137470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36788/0 (socket says 172.21.15.37:36788) 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d867fc640 1 -- 172.21.15.37:0/1701949008 learned_addr learned my addr 172.21.15.37:0/1701949008 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d86ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d880713b0 0x7f4d880717c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43824/0 (socket says 172.21.15.37:43824) 2024-04-23T01:38:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d86ffd640 1 -- 172.21.15.37:0/1701949008 >> v1:172.21.15.37:6789/0 conn(0x7f4d88071d00 legacy=0x7f4d88137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d86ffd640 1 -- 172.21.15.37:0/1701949008 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8809d3e0 con 0x7f4d880713b0 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d85ffb640 1 -- 172.21.15.37:0/1701949008 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463328354 0 0) 0x7f4d88074210 con 0x7f4d88071d00 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d86ffd640 1 --2- 172.21.15.37:0/1701949008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d880717c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e290641163ab89 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d85ffb640 1 -- 172.21.15.37:0/1701949008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d78009d90 con 0x7f4d880713b0 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d85ffb640 1 -- 172.21.15.37:0/1701949008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d7800e230 con 0x7f4d880713b0 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.966+0000 7f4d85ffb640 1 -- 172.21.15.37:0/1701949008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d7800e4d0 con 0x7f4d880713b0 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 1 -- 172.21.15.37:0/1701949008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 msgr2=0x7f4d880717c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 1 --2- 172.21.15.37:0/1701949008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d880717c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 1 -- 172.21.15.37:0/1701949008 shutdown_connections 2024-04-23T01:38:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 1 --2- 172.21.15.37:0/1701949008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d880717c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 1 -- 172.21.15.37:0/1701949008 >> 172.21.15.37:0/1701949008 conn(0x7f4d880a1580 msgr2=0x7f4d880a1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 1 -- 172.21.15.37:0/1701949008 shutdown_connections 2024-04-23T01:38:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 1 -- 172.21.15.37:0/1701949008 wait complete. 2024-04-23T01:38:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.967+0000 7f4d8d26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.969+0000 7f4d8d26d640 1 Processor -- start 2024-04-23T01:38:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.969+0000 7f4d8d26d640 1 -- start start 2024-04-23T01:38:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.971+0000 7f4d8d26d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d881b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.971+0000 7f4d8d26d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881b7c10 con 0x7f4d880713b0 2024-04-23T01:38:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.971+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d881b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.971+0000 7f4d86ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d881b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43834/0 (socket says 172.21.15.37:43834) 2024-04-23T01:38:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.971+0000 7f4d86ffd640 1 -- 172.21.15.37:0/81919075 learned_addr learned my addr 172.21.15.37:0/81919075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:48.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.971+0000 7f4d86ffd640 1 -- 172.21.15.37:0/81919075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d881b26d0 con 0x7f4d880713b0 2024-04-23T01:38:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.972+0000 7f4d86ffd640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d881b6730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.972+0000 7f4d6f7fe640 1 -- 172.21.15.37:0/81919075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d78013610 con 0x7f4d880713b0 2024-04-23T01:38:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.972+0000 7f4d6f7fe640 1 -- 172.21.15.37:0/81919075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d78013770 con 0x7f4d880713b0 2024-04-23T01:38:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.972+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d881b4330 con 0x7f4d880713b0 2024-04-23T01:38:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.972+0000 7f4d6f7fe640 1 -- 172.21.15.37:0/81919075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d78013a10 con 0x7f4d880713b0 2024-04-23T01:38:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.972+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d881b7e40 con 0x7f4d880713b0 2024-04-23T01:38:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.973+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d880692b0 con 0x7f4d880713b0 2024-04-23T01:38:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.973+0000 7f4d6f7fe640 1 -- 172.21.15.37:0/81919075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4d78013bc0 con 0x7f4d880713b0 2024-04-23T01:38:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.973+0000 7f4d6f7fe640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d74038980 0x7f4d7403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:48.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.973+0000 7f4d6f7fe640 1 -- 172.21.15.37:0/81919075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7f4d78018040 con 0x7f4d880713b0 2024-04-23T01:38:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.974+0000 7f4d867fc640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d74038980 0x7f4d7403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:48.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.974+0000 7f4d867fc640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d74038980 0x7f4d7403ae90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:48.978+0000 7f4d6f7fe640 1 -- 172.21.15.37:0/81919075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4d78017190 con 0x7f4d880713b0 2024-04-23T01:38:49.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.219+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4d881b4330 con 0x7f4d880713b0 2024-04-23T01:38:49.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.221+0000 7f4d6f7fe640 1 -- 172.21.15.37:0/81919075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87801 (crc 0 0 0) 0x7f4d881b4330 con 0x7f4d880713b0 2024-04-23T01:38:49.220 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d74038980 msgr2=0x7f4d7403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d74038980 0x7f4d7403ae90 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 msgr2=0x7f4d881b6730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d881b6730 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 shutdown_connections 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d74038980 0x7f4d7403ae90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 --2- 172.21.15.37:0/81919075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d880713b0 0x7f4d881b6730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 >> 172.21.15.37:0/81919075 conn(0x7f4d880a1580 msgr2=0x7f4d881ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 shutdown_connections 2024-04-23T01:38:49.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.224+0000 7f4d8d26d640 1 -- 172.21.15.37:0/81919075 wait complete. 2024-04-23T01:38:49.232 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":790915015},{"type":"v1","addr":"172.21.15.191:6801","nonce":790915015}]},"active_addr":"172.21.15.191:6801/790915015","active_change":"2024-04-23T01:38:41.744288+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":2949306745}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":3182982697}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":1649444441}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":81334374}]}]} 2024-04-23T01:38:49.234 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-23T01:38:49.234 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T01:38:49.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T01:38:49.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.344+0000 7fec62ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.349+0000 7fec62ead640 1 Processor -- start 2024-04-23T01:38:49.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.349+0000 7fec62ead640 1 -- start start 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.350+0000 7fec62ead640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec5c09f6c0 0x7fec5c09fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.350+0000 7fec62ead640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5c070d80 con 0x7fec5c0a0010 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.350+0000 7fec62ead640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fec5c0717b0 con 0x7fec5c09f6c0 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.350+0000 7fec60c49640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec5c09f6c0 0x7fec5c09fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.350+0000 7fec5bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec5c0a0010 0x7fec5c1329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36804/0 (socket says 172.21.15.37:36804) 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.350+0000 7fec60c49640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fec5c09f6c0 0x7fec5c09fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43842/0 (socket says 172.21.15.37:43842) 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.350+0000 7fec5bfff640 1 -- 172.21.15.37:0/1635678945 learned_addr learned my addr 172.21.15.37:0/1635678945 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.351+0000 7fec60c49640 1 -- 172.21.15.37:0/1635678945 >> v1:172.21.15.37:6789/0 conn(0x7fec5c0a0010 legacy=0x7fec5c1329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.351+0000 7fec60c49640 1 -- 172.21.15.37:0/1635678945 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c072330 con 0x7fec5c09f6c0 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.351+0000 7fec5b7fe640 1 -- 172.21.15.37:0/1635678945 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868512240 0 0) 0x7fec5c070d80 con 0x7fec5c0a0010 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.351+0000 7fec60c49640 1 --2- 172.21.15.37:0/1635678945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c09fad0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3391edae95075de server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.351+0000 7fec5b7fe640 1 -- 172.21.15.37:0/1635678945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec54009d90 con 0x7fec5c09f6c0 2024-04-23T01:38:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.351+0000 7fec5b7fe640 1 -- 172.21.15.37:0/1635678945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec5400e230 con 0x7fec5c09f6c0 2024-04-23T01:38:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.351+0000 7fec5b7fe640 1 -- 172.21.15.37:0/1635678945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec5400e4d0 con 0x7fec5c09f6c0 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 1 -- 172.21.15.37:0/1635678945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 msgr2=0x7fec5c09fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 1 --2- 172.21.15.37:0/1635678945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c09fad0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 1 -- 172.21.15.37:0/1635678945 shutdown_connections 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 1 --2- 172.21.15.37:0/1635678945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c09fad0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 1 -- 172.21.15.37:0/1635678945 >> 172.21.15.37:0/1635678945 conn(0x7fec5c0a1960 msgr2=0x7fec5c0a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 1 -- 172.21.15.37:0/1635678945 shutdown_connections 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 1 -- 172.21.15.37:0/1635678945 wait complete. 2024-04-23T01:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.352+0000 7fec62ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.354+0000 7fec62ead640 1 Processor -- start 2024-04-23T01:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.354+0000 7fec62ead640 1 -- start start 2024-04-23T01:38:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.355+0000 7fec62ead640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c1c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.355+0000 7fec62ead640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c123d50 con 0x7fec5c09f6c0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec60c49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c1c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec60c49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c1c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43856/0 (socket says 172.21.15.37:43856) 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec60c49640 1 -- 172.21.15.37:0/2051104110 learned_addr learned my addr 172.21.15.37:0/2051104110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec60c49640 1 -- 172.21.15.37:0/2051104110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c06fc20 con 0x7fec5c09f6c0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec60c49640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c1c9a40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec597fa640 1 -- 172.21.15.37:0/2051104110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec54013610 con 0x7fec5c09f6c0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec597fa640 1 -- 172.21.15.37:0/2051104110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fec54013770 con 0x7fec5c09f6c0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c123f80 con 0x7fec5c09f6c0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec597fa640 1 -- 172.21.15.37:0/2051104110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fec54013a10 con 0x7fec5c09f6c0 2024-04-23T01:38:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.356+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c1252e0 con 0x7fec5c09f6c0 2024-04-23T01:38:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.357+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c0692b0 con 0x7fec5c09f6c0 2024-04-23T01:38:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.357+0000 7fec597fa640 1 -- 172.21.15.37:0/2051104110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fec54013bc0 con 0x7fec5c09f6c0 2024-04-23T01:38:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.358+0000 7fec597fa640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fec3c038980 0x7fec3c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.358+0000 7fec597fa640 1 -- 172.21.15.37:0/2051104110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7fec54018040 con 0x7fec5c09f6c0 2024-04-23T01:38:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.358+0000 7fec5bfff640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fec3c038980 0x7fec3c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.358+0000 7fec5bfff640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fec3c038980 0x7fec3c03ae90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:49.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.363+0000 7fec597fa640 1 -- 172.21.15.37:0/2051104110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fec54018c30 con 0x7fec5c09f6c0 2024-04-23T01:38:49.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.551+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec5c063880 con 0x7fec5c09f6c0 2024-04-23T01:38:49.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.552+0000 7fec597fa640 1 -- 172.21.15.37:0/2051104110 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8730 (crc 0 0 0) 0x7fec5400f2a0 con 0x7fec5c09f6c0 2024-04-23T01:38:49.550 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:49.550 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"fsid":"e132a9f8-f5c5-4318-805c-a5b188312643","created":"2024-04-23T01:38:37.200203+0000","modified":"2024-04-23T01:38:48.801915+0000","last_up_change":"2024-04-23T01:38:43.779753+0000","last_in_change":"2024-04-23T01:38:39.323031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T01:38:45.767564+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T01:38:47.518741+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9aacf45a-9611-4f14-9dea-50f0fc0f3a3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1949701083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":1949701083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1949701083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":1949701083}]},"public_addr":"172.21.15.37:6802/1949701083","cluster_addr":"172.21.15.37:6801/1949701083","heartbeat_back_addr":"172.21.15.37:6800/1949701083","heartbeat_front_addr":"172.21.15.37:6803/1949701083","state":["exists","up"]},{"osd":1,"uuid":"ed271568-29f8-4d1b-a810-ca3b16b2682d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1977556410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1977556410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1977556410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1977556410}]},"public_addr":"172.21.15.37:6805/1977556410","cluster_addr":"172.21.15.37:6804/1977556410","heartbeat_back_addr":"172.21.15.37:6808/1977556410","heartbeat_front_addr":"172.21.15.37:6807/1977556410","state":["exists","up"]},{"osd":2,"uuid":"d9c96632-2efd-4fc2-8d5a-896bbe7a5204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6805","nonce":3894758024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3894758024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":3894758024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3894758024}]},"public_addr":"172.21.15.191:6805/3894758024","cluster_addr":"172.21.15.191:6804/3894758024","heartbeat_back_addr":"172.21.15.191:6807/3894758024","heartbeat_front_addr":"172.21.15.191:6812/3894758024","state":["exists","up"]},{"osd":3,"uuid":"e191d386-d82b-47ee-b6c7-5154e1d630c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1018833307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":1018833307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1018833307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":1018833307}]},"public_addr":"172.21.15.191:6808/1018833307","cluster_addr":"172.21.15.191:6809/1018833307","heartbeat_back_addr":"172.21.15.191:6810/1018833307","heartbeat_front_addr":"172.21.15.191:6811/1018833307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T01:38:49.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fec3c038980 msgr2=0x7fec3c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fec3c038980 0x7fec3c03ae90 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 msgr2=0x7fec5c1c9a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c1c9a40 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 shutdown_connections 2024-04-23T01:38:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fec3c038980 0x7fec3c03ae90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 --2- 172.21.15.37:0/2051104110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec5c09f6c0 0x7fec5c1c9a40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 >> 172.21.15.37:0/2051104110 conn(0x7fec5c0a1960 msgr2=0x7fec5c09c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 shutdown_connections 2024-04-23T01:38:49.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.554+0000 7fec62ead640 1 -- 172.21.15.37:0/2051104110 wait complete. 2024-04-23T01:38:49.563 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T01:38:49.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T01:38:49.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.672+0000 7fa8aa62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.677+0000 7fa8aa62d640 1 Processor -- start 2024-04-23T01:38:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.677+0000 7fa8aa62d640 1 -- start start 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8aa62d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8a40a01e0 0x7fa8a4137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8aa62d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8a4070d80 con 0x7fa8a409f6c0 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8aa62d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa8a40717b0 con 0x7fa8a40a01e0 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8a40a01e0 0x7fa8a4137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8a40a01e0 0x7fa8a4137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56376/0 (socket says 172.21.15.37:56376) 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa8a409f6c0 0x7fa8a409fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33234/0 (socket says 172.21.15.37:33234) 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a37fe640 1 -- 172.21.15.37:0/1575081709 learned_addr learned my addr 172.21.15.37:0/1575081709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a37fe640 1 -- 172.21.15.37:0/1575081709 >> v1:172.21.15.37:6789/0 conn(0x7fa8a409f6c0 legacy=0x7fa8a409fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a37fe640 1 -- 172.21.15.37:0/1575081709 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a4072330 con 0x7fa8a40a01e0 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a37fe640 1 --2- 172.21.15.37:0/1575081709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a40a01e0 0x7fa8a4137c40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39de033b561370f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:49.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a2ffd640 1 -- 172.21.15.37:0/1575081709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa898009e50 con 0x7fa8a40a01e0 2024-04-23T01:38:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a2ffd640 1 -- 172.21.15.37:0/1575081709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa89800e230 con 0x7fa8a40a01e0 2024-04-23T01:38:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.679+0000 7fa8a2ffd640 1 -- 172.21.15.37:0/1575081709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa89800e4d0 con 0x7fa8a40a01e0 2024-04-23T01:38:49.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 1 -- 172.21.15.37:0/1575081709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a40a01e0 msgr2=0x7fa8a4137c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 1 --2- 172.21.15.37:0/1575081709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a40a01e0 0x7fa8a4137c40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 1 -- 172.21.15.37:0/1575081709 shutdown_connections 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 1 --2- 172.21.15.37:0/1575081709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a40a01e0 0x7fa8a4137c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 1 -- 172.21.15.37:0/1575081709 >> 172.21.15.37:0/1575081709 conn(0x7fa8a40a1960 msgr2=0x7fa8a40a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 1 -- 172.21.15.37:0/1575081709 shutdown_connections 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 1 -- 172.21.15.37:0/1575081709 wait complete. 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.680+0000 7fa8aa62d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:49.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.682+0000 7fa8aa62d640 1 Processor -- start 2024-04-23T01:38:49.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.682+0000 7fa8aa62d640 1 -- start start 2024-04-23T01:38:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.684+0000 7fa8aa62d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a409f6c0 0x7fa8a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.684+0000 7fa8aa62d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a406fea0 con 0x7fa8a409f6c0 2024-04-23T01:38:49.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.684+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a409f6c0 0x7fa8a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.684+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a409f6c0 0x7fa8a406e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56386/0 (socket says 172.21.15.37:56386) 2024-04-23T01:38:49.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.684+0000 7fa8a3fff640 1 -- 172.21.15.37:0/932914049 learned_addr learned my addr 172.21.15.37:0/932914049 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.684+0000 7fa8a3fff640 1 -- 172.21.15.37:0/932914049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a41213f0 con 0x7fa8a409f6c0 2024-04-23T01:38:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.684+0000 7fa8a3fff640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a409f6c0 0x7fa8a406e9f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.685+0000 7fa8a0ff9640 1 -- 172.21.15.37:0/932914049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa8940059a0 con 0x7fa8a409f6c0 2024-04-23T01:38:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.685+0000 7fa8a0ff9640 1 -- 172.21.15.37:0/932914049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa894005b00 con 0x7fa8a409f6c0 2024-04-23T01:38:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.685+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a4070600 con 0x7fa8a409f6c0 2024-04-23T01:38:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.685+0000 7fa8a0ff9640 1 -- 172.21.15.37:0/932914049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa894005da0 con 0x7fa8a409f6c0 2024-04-23T01:38:49.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.685+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a4120de0 con 0x7fa8a409f6c0 2024-04-23T01:38:49.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.686+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a40692b0 con 0x7fa8a409f6c0 2024-04-23T01:38:49.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.686+0000 7fa8a0ff9640 1 -- 172.21.15.37:0/932914049 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa8940070b0 con 0x7fa8a409f6c0 2024-04-23T01:38:49.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.686+0000 7fa8a0ff9640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa890038980 0x7fa89003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:49.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.686+0000 7fa8a0ff9640 1 -- 172.21.15.37:0/932914049 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7fa894048200 con 0x7fa8a409f6c0 2024-04-23T01:38:49.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.686+0000 7fa8a37fe640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa890038980 0x7fa89003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:49.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.687+0000 7fa8a37fe640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa890038980 0x7fa89003ae90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.691+0000 7fa8a0ff9640 1 -- 172.21.15.37:0/932914049 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fa89400d330 con 0x7fa8a409f6c0 2024-04-23T01:38:49.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.878+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8a4063880 con 0x7fa8a409f6c0 2024-04-23T01:38:49.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.879+0000 7fa8a0ff9640 1 -- 172.21.15.37:0/932914049 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8721 (crc 0 0 0) 0x7fa89400d150 con 0x7fa8a409f6c0 2024-04-23T01:38:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:49.877 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":14,"fsid":"e132a9f8-f5c5-4318-805c-a5b188312643","created":"2024-04-23T01:38:37.200203+0000","modified":"2024-04-23T01:38:49.809683+0000","last_up_change":"2024-04-23T01:38:43.779753+0000","last_in_change":"2024-04-23T01:38:39.323031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T01:38:45.767564+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T01:38:47.518741+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9aacf45a-9611-4f14-9dea-50f0fc0f3a3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1949701083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":1949701083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1949701083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":1949701083}]},"public_addr":"172.21.15.37:6802/1949701083","cluster_addr":"172.21.15.37:6801/1949701083","heartbeat_back_addr":"172.21.15.37:6800/1949701083","heartbeat_front_addr":"172.21.15.37:6803/1949701083","state":["exists","up"]},{"osd":1,"uuid":"ed271568-29f8-4d1b-a810-ca3b16b2682d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1977556410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1977556410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1977556410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1977556410}]},"public_addr":"172.21.15.37:6805/1977556410","cluster_addr":"172.21.15.37:6804/1977556410","heartbeat_back_addr":"172.21.15.37:6808/1977556410","heartbeat_front_addr":"172.21.15.37:6807/1977556410","state":["exists","up"]},{"osd":2,"uuid":"d9c96632-2efd-4fc2-8d5a-896bbe7a5204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6805","nonce":3894758024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3894758024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":3894758024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3894758024}]},"public_addr":"172.21.15.191:6805/3894758024","cluster_addr":"172.21.15.191:6804/3894758024","heartbeat_back_addr":"172.21.15.191:6807/3894758024","heartbeat_front_addr":"172.21.15.191:6812/3894758024","state":["exists","up"]},{"osd":3,"uuid":"e191d386-d82b-47ee-b6c7-5154e1d630c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1018833307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":1018833307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1018833307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":1018833307}]},"public_addr":"172.21.15.191:6808/1018833307","cluster_addr":"172.21.15.191:6809/1018833307","heartbeat_back_addr":"172.21.15.191:6810/1018833307","heartbeat_front_addr":"172.21.15.191:6811/1018833307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa890038980 msgr2=0x7fa89003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa890038980 0x7fa89003ae90 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a409f6c0 msgr2=0x7fa8a406e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a409f6c0 0x7fa8a406e9f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 shutdown_connections 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa890038980 0x7fa89003ae90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 --2- 172.21.15.37:0/932914049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8a409f6c0 0x7fa8a406e9f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 >> 172.21.15.37:0/932914049 conn(0x7fa8a40a1960 msgr2=0x7fa8a41bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 shutdown_connections 2024-04-23T01:38:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:49.881+0000 7fa8aa62d640 1 -- 172.21.15.37:0/932914049 wait complete. 2024-04-23T01:38:49.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T01:38:49.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T01:38:49.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T01:38:49.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T01:38:50.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.011+0000 7f4d1a954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.011+0000 7f856aead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.011+0000 7fa83b82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.011+0000 7f5e8d3d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7fa83b82d640 1 Processor -- start 2024-04-23T01:38:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7f4d1a954640 1 Processor -- start 2024-04-23T01:38:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7f5e8d3d7640 1 Processor -- start 2024-04-23T01:38:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7f856aead640 1 Processor -- start 2024-04-23T01:38:50.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7f4d1a954640 1 -- start start 2024-04-23T01:38:50.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7fa83b82d640 1 -- start start 2024-04-23T01:38:50.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7f5e8d3d7640 1 -- start start 2024-04-23T01:38:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.018+0000 7f856aead640 1 -- start start 2024-04-23T01:38:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.019+0000 7f5e8d3d7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e88132e70 0x7f5e88133280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.019+0000 7f5e8d3d7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e88074070 con 0x7f5e880714d0 2024-04-23T01:38:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.019+0000 7f4d1a954640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d1406ec40 0x7f4d1413a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f4d1a954640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d141321e0 con 0x7f4d140a11e0 2024-04-23T01:38:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.019+0000 7f856aead640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8564072af0 0x7f8564071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f856aead640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8564068ff0 con 0x7f85640715c0 2024-04-23T01:38:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f856aead640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f85640a2c80 con 0x7f8564072af0 2024-04-23T01:38:50.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.019+0000 7fa83b82d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa834134270 0x7fa834136690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7fa83b82d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83409c340 con 0x7fa83409cd50 2024-04-23T01:38:50.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7fa838dc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa834134270 0x7fa834136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f4d1a954640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f4d140a0d90 con 0x7f4d1406ec40 2024-04-23T01:38:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7fa83b82d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa83412dd50 con 0x7fa834134270 2024-04-23T01:38:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f5e86ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e88132e70 0x7f5e88133280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f5e8d3d7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5e880681f0 con 0x7f5e88132e70 2024-04-23T01:38:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f5e86ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5e88132e70 0x7f5e88133280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56392/0 (socket says 172.21.15.37:56392) 2024-04-23T01:38:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f5e86ffd640 1 -- 172.21.15.37:0/2886997602 learned_addr learned my addr 172.21.15.37:0/2886997602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7fa8395c9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa83409cd50 0x7fa83412e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33264/0 (socket says 172.21.15.37:33264) 2024-04-23T01:38:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f4d137fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d1406ec40 0x7f4d1413a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f4d137fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d1406ec40 0x7f4d1413a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56416/0 (socket says 172.21.15.37:56416) 2024-04-23T01:38:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f4d137fe640 1 -- 172.21.15.37:0/1251843658 learned_addr learned my addr 172.21.15.37:0/1251843658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f8563fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85640715c0 0x7f8564133170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33258/0 (socket says 172.21.15.37:33258) 2024-04-23T01:38:50.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f8563fff640 1 -- 172.21.15.37:0/144162022 learned_addr learned my addr 172.21.15.37:0/144162022 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:50.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f8568c49640 1 --2- 172.21.15.37:0/144162022 >> v2:172.21.15.37:3300/0 conn(0x7f8564072af0 0x7f8564071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7fa8395c9640 1 -- 172.21.15.37:0/1931289630 learned_addr learned my addr 172.21.15.37:0/1931289630 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:50.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f5e85ffb640 1 -- 172.21.15.37:0/2886997602 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481564412 0 0) 0x7f5e88074070 con 0x7f5e880714d0 2024-04-23T01:38:50.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f5e85ffb640 1 -- 172.21.15.37:0/2886997602 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e70003580 con 0x7f5e880714d0 2024-04-23T01:38:50.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.020+0000 7f8568c49640 1 -- 172.21.15.37:0/144162022 >> v1:172.21.15.37:6789/0 conn(0x7f85640715c0 legacy=0x7f8564133170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f5e86ffd640 1 -- 172.21.15.37:0/2886997602 >> v1:172.21.15.37:6789/0 conn(0x7f5e880714d0 legacy=0x7f5e880718e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7fa82bfff640 1 -- 172.21.15.37:0/1931289630 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492498985 0 0) 0x7fa830001110 con 0x7fa83409cd50 2024-04-23T01:38:50.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f8568c49640 1 -- 172.21.15.37:0/144162022 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85640733c0 con 0x7f8564072af0 2024-04-23T01:38:50.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f5e86ffd640 1 -- 172.21.15.37:0/2886997602 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e88132a20 con 0x7f5e88132e70 2024-04-23T01:38:50.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7fa82bfff640 1 -- 172.21.15.37:0/1931289630 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa820003580 con 0x7fa83409cd50 2024-04-23T01:38:50.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7fa838dc8640 1 -- 172.21.15.37:0/1931289630 >> v1:172.21.15.37:6789/0 conn(0x7fa83409cd50 legacy=0x7fa83412e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7fa838dc8640 1 -- 172.21.15.37:0/1931289630 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83412e8b0 con 0x7fa834134270 2024-04-23T01:38:50.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f4d137fe640 1 -- 172.21.15.37:0/1251843658 >> v1:172.21.15.37:6789/0 conn(0x7f4d140a11e0 legacy=0x7f4d1409fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f4d137fe640 1 -- 172.21.15.37:0/1251843658 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1406f050 con 0x7f4d1406ec40 2024-04-23T01:38:50.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f8568c49640 1 --2- 172.21.15.37:0/144162022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8564072af0 0x7f8564071080 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7742682974ac31 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f5e86ffd640 1 --2- 172.21.15.37:0/2886997602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e88132e70 0x7f5e88133280 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e949ba2c2c4486 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f4d137fe640 1 --2- 172.21.15.37:0/1251843658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d1413a140 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1d7279d21a4301 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7fa838dc8640 1 --2- 172.21.15.37:0/1931289630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa834134270 0x7fa834136690 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888cca78845087f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f85637fe640 1 -- 172.21.15.37:0/144162022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8558009d90 con 0x7f8564072af0 2024-04-23T01:38:50.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f5e85ffb640 1 -- 172.21.15.37:0/2886997602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e78012040 con 0x7f5e88132e70 2024-04-23T01:38:50.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7fa82bfff640 1 -- 172.21.15.37:0/1931289630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa82400ace0 con 0x7fa834134270 2024-04-23T01:38:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f5e85ffb640 1 -- 172.21.15.37:0/2886997602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5e7800d1e0 con 0x7f5e88132e70 2024-04-23T01:38:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f5e85ffb640 1 -- 172.21.15.37:0/2886997602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e7800b790 con 0x7f5e88132e70 2024-04-23T01:38:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f85637fe640 1 -- 172.21.15.37:0/144162022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f855800e230 con 0x7f8564072af0 2024-04-23T01:38:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.021+0000 7f85637fe640 1 -- 172.21.15.37:0/144162022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f855800e4d0 con 0x7f8564072af0 2024-04-23T01:38:50.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f4d12ffd640 1 -- 172.21.15.37:0/1251843658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d08009e50 con 0x7f4d1406ec40 2024-04-23T01:38:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7fa82bfff640 1 -- 172.21.15.37:0/1931289630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa82400ae40 con 0x7fa834134270 2024-04-23T01:38:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7fa82bfff640 1 -- 172.21.15.37:0/1931289630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa82400f5a0 con 0x7fa834134270 2024-04-23T01:38:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f4d12ffd640 1 -- 172.21.15.37:0/1251843658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d0800e230 con 0x7f4d1406ec40 2024-04-23T01:38:50.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f4d12ffd640 1 -- 172.21.15.37:0/1251843658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d0800e4d0 con 0x7f4d1406ec40 2024-04-23T01:38:50.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2886997602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e88132e70 msgr2=0x7f5e88133280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2886997602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e88132e70 0x7f5e88133280 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f856aead640 1 -- 172.21.15.37:0/144162022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8564072af0 msgr2=0x7f8564071080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.022+0000 7f856aead640 1 --2- 172.21.15.37:0/144162022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8564072af0 0x7f8564071080 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f856aead640 1 -- 172.21.15.37:0/144162022 shutdown_connections 2024-04-23T01:38:50.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2886997602 shutdown_connections 2024-04-23T01:38:50.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2886997602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e88132e70 0x7f5e88133280 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2886997602 >> 172.21.15.37:0/2886997602 conn(0x7f5e880a0350 msgr2=0x7f5e880a0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f856aead640 1 --2- 172.21.15.37:0/144162022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8564072af0 0x7f8564071080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f856aead640 1 -- 172.21.15.37:0/144162022 >> 172.21.15.37:0/144162022 conn(0x7f85640a0db0 msgr2=0x7f85640a11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f856aead640 1 -- 172.21.15.37:0/144162022 shutdown_connections 2024-04-23T01:38:50.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2886997602 shutdown_connections 2024-04-23T01:38:50.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f856aead640 1 -- 172.21.15.37:0/144162022 wait complete. 2024-04-23T01:38:50.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2886997602 wait complete. 2024-04-23T01:38:50.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f856aead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7fa83b82d640 1 -- 172.21.15.37:0/1931289630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa834134270 msgr2=0x7fa834136690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7fa83b82d640 1 --2- 172.21.15.37:0/1931289630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa834134270 0x7fa834136690 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f5e8d3d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f4d1a954640 1 -- 172.21.15.37:0/1251843658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 msgr2=0x7f4d1413a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7fa83b82d640 1 -- 172.21.15.37:0/1931289630 shutdown_connections 2024-04-23T01:38:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f4d1a954640 1 --2- 172.21.15.37:0/1251843658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d1413a140 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7fa83b82d640 1 --2- 172.21.15.37:0/1931289630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa834134270 0x7fa834136690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7fa83b82d640 1 -- 172.21.15.37:0/1931289630 >> 172.21.15.37:0/1931289630 conn(0x7fa83409f6a0 msgr2=0x7fa83409fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f4d1a954640 1 -- 172.21.15.37:0/1251843658 shutdown_connections 2024-04-23T01:38:50.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f4d1a954640 1 --2- 172.21.15.37:0/1251843658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d1413a140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7fa83b82d640 1 -- 172.21.15.37:0/1931289630 shutdown_connections 2024-04-23T01:38:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7f4d1a954640 1 -- 172.21.15.37:0/1251843658 >> 172.21.15.37:0/1251843658 conn(0x7f4d140a5050 msgr2=0x7f4d140a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.023+0000 7fa83b82d640 1 -- 172.21.15.37:0/1931289630 wait complete. 2024-04-23T01:38:50.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.024+0000 7f4d1a954640 1 -- 172.21.15.37:0/1251843658 shutdown_connections 2024-04-23T01:38:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.024+0000 7fa83b82d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.024+0000 7f4d1a954640 1 -- 172.21.15.37:0/1251843658 wait complete. 2024-04-23T01:38:50.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.024+0000 7f4d1a954640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.025+0000 7f856aead640 1 Processor -- start 2024-04-23T01:38:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.025+0000 7f856aead640 1 -- start start 2024-04-23T01:38:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.025+0000 7f5e8d3d7640 1 Processor -- start 2024-04-23T01:38:50.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.025+0000 7f5e8d3d7640 1 -- start start 2024-04-23T01:38:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.025+0000 7fa83b82d640 1 Processor -- start 2024-04-23T01:38:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.025+0000 7fa83b82d640 1 -- start start 2024-04-23T01:38:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.026+0000 7f4d1a954640 1 Processor -- start 2024-04-23T01:38:50.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.026+0000 7f4d1a954640 1 -- start start 2024-04-23T01:38:50.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f5e8d3d7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e880714d0 0x7f5e8812a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f5e8d3d7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e88129ee0 con 0x7f5e880714d0 2024-04-23T01:38:50.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f856aead640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85640715c0 0x7f856408c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f856aead640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85640741e0 con 0x7f85640715c0 2024-04-23T01:38:50.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f5e86ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e880714d0 0x7f5e8812a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f5e86ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e880714d0 0x7f5e8812a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56428/0 (socket says 172.21.15.37:56428) 2024-04-23T01:38:50.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f5e86ffd640 1 -- 172.21.15.37:0/2080229480 learned_addr learned my addr 172.21.15.37:0/2080229480 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f8568c49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85640715c0 0x7f856408c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f8568c49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85640715c0 0x7f856408c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56436/0 (socket says 172.21.15.37:56436) 2024-04-23T01:38:50.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f8568c49640 1 -- 172.21.15.37:0/555614761 learned_addr learned my addr 172.21.15.37:0/555614761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7fa83b82d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83409cd50 0x7fa83406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7fa83b82d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8340732e0 con 0x7fa83409cd50 2024-04-23T01:38:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7fa8395c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83409cd50 0x7fa83406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7f5e86ffd640 1 -- 172.21.15.37:0/2080229480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8812a4b0 con 0x7f5e880714d0 2024-04-23T01:38:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7fa8395c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83409cd50 0x7fa83406fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56452/0 (socket says 172.21.15.37:56452) 2024-04-23T01:38:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.027+0000 7fa8395c9640 1 -- 172.21.15.37:0/2390266561 learned_addr learned my addr 172.21.15.37:0/2390266561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f4d1a954640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d141c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f8568c49640 1 -- 172.21.15.37:0/555614761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856408da20 con 0x7f85640715c0 2024-04-23T01:38:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f4d1a954640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d140700a0 con 0x7f4d1406ec40 2024-04-23T01:38:50.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f5e86ffd640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e880714d0 0x7f5e8812a870 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f4d13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d141c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f4d13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d141c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56466/0 (socket says 172.21.15.37:56466) 2024-04-23T01:38:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f4d13fff640 1 -- 172.21.15.37:0/4214274474 learned_addr learned my addr 172.21.15.37:0/4214274474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f8568c49640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85640715c0 0x7f856408c1e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7fa8395c9640 1 -- 172.21.15.37:0/2390266561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa834070d40 con 0x7fa83409cd50 2024-04-23T01:38:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e78012040 con 0x7f5e880714d0 2024-04-23T01:38:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5e780174c0 con 0x7f5e880714d0 2024-04-23T01:38:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e78017760 con 0x7f5e880714d0 2024-04-23T01:38:50.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7fa8395c9640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83409cd50 0x7fa83406fba0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8558014620 con 0x7f85640715c0 2024-04-23T01:38:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8558014780 con 0x7f85640715c0 2024-04-23T01:38:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8558014a20 con 0x7f85640715c0 2024-04-23T01:38:50.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e8812df60 con 0x7f5e880714d0 2024-04-23T01:38:50.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f4d13fff640 1 -- 172.21.15.37:0/4214274474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d14072170 con 0x7f4d1406ec40 2024-04-23T01:38:50.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e8812d330 con 0x7f5e880714d0 2024-04-23T01:38:50.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa830005930 con 0x7fa83409cd50 2024-04-23T01:38:50.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa834071490 con 0x7fa83409cd50 2024-04-23T01:38:50.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa830005a90 con 0x7fa83409cd50 2024-04-23T01:38:50.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.029+0000 7f4d13fff640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d141c98a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.029+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa830005930 con 0x7fa83409cd50 2024-04-23T01:38:50.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856408e3b0 con 0x7f85640715c0 2024-04-23T01:38:50.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.028+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8564099e50 con 0x7f85640715c0 2024-04-23T01:38:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.029+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d0400c870 con 0x7f4d1406ec40 2024-04-23T01:38:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.029+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d14072490 con 0x7f4d1406ec40 2024-04-23T01:38:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.029+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e8812a2b0 con 0x7f5e880714d0 2024-04-23T01:38:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1406fd00 con 0x7f4d1406ec40 2024-04-23T01:38:50.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d0400c9d0 con 0x7f4d1406ec40 2024-04-23T01:38:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d0400cc70 con 0x7f4d1406ec40 2024-04-23T01:38:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.029+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa834073960 con 0x7fa83409cd50 2024-04-23T01:38:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa83406f930 con 0x7fa83409cd50 2024-04-23T01:38:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5e78017910 con 0x7f5e880714d0 2024-04-23T01:38:50.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f856409ef60 con 0x7f85640715c0 2024-04-23T01:38:50.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7f5e6f7fe640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5e740389d0 0x7f5e7403aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cf4000f80 con 0x7f4d1406ec40 2024-04-23T01:38:50.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f5e7804d790 con 0x7f5e880714d0 2024-04-23T01:38:50.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f5e6f7fe640 1 --2- 172.21.15.37:0/2080229480 >> v2:172.21.15.191:6805/3894758024 conn(0x7f5e7403d9d0 0x7f5e7403fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 --> v2:172.21.15.191:6805/3894758024 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e740404f0 con 0x7f5e7403d9d0 2024-04-23T01:38:50.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f5e78014ba0 con 0x7f5e880714d0 2024-04-23T01:38:50.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f5e867fc640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5e740389d0 0x7f5e7403aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.030+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f8558014bd0 con 0x7f85640715c0 2024-04-23T01:38:50.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f85617fa640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f85480389d0 0x7f854803aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f8558019040 con 0x7f85640715c0 2024-04-23T01:38:50.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4d04011310 con 0x7f4d1406ec40 2024-04-23T01:38:50.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f85617fa640 1 --2- 172.21.15.37:0/555614761 >> v2:172.21.15.37:6805/1977556410 conn(0x7f854803d9d0 0x7f854803fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f8563fff640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f85480389d0 0x7f854803aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 --> v2:172.21.15.37:6805/1977556410 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85480404f0 con 0x7f854803d9d0 2024-04-23T01:38:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f8558049d30 con 0x7f85640715c0 2024-04-23T01:38:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f4d10ff9640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d00038980 0x7f4d0003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f4d04048810 con 0x7f4d1406ec40 2024-04-23T01:38:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f4d10ff9640 1 --2- 172.21.15.37:0/4214274474 >> v2:172.21.15.37:6802/1949701083 conn(0x7f4d0003d980 0x7f4d0003fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 --> v2:172.21.15.37:6802/1949701083 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d000404a0 con 0x7f4d0003d980 2024-04-23T01:38:50.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f4d04048c20 con 0x7f4d1406ec40 2024-04-23T01:38:50.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.031+0000 7f5e867fc640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5e740389d0 0x7f5e7403aee0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7f4d137fe640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d00038980 0x7f4d0003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa830005ce0 con 0x7fa83409cd50 2024-04-23T01:38:50.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7f4d137fe640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d00038980 0x7f4d0003ae90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7fa829ffb640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa818038a00 0x7fa81803af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7f5e877fe640 1 --2- 172.21.15.37:0/2080229480 >> v2:172.21.15.191:6805/3894758024 conn(0x7f5e7403d9d0 0x7f5e7403fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:38:50.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fa830048070 con 0x7fa83409cd50 2024-04-23T01:38:50.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7fa829ffb640 1 --2- 172.21.15.37:0/2390266561 >> v2:172.21.15.191:6808/1018833307 conn(0x7fa81803da00 0x7fa81803fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 --> v2:172.21.15.191:6808/1018833307 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa818040520 con 0x7fa81803da00 2024-04-23T01:38:50.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7fa830005930 con 0x7fa83409cd50 2024-04-23T01:38:50.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.033+0000 7f4d18ef1640 1 --2- 172.21.15.37:0/4214274474 >> v2:172.21.15.37:6802/1949701083 conn(0x7f4d0003d980 0x7f4d0003fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:38:50.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7f8563fff640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f85480389d0 0x7f854803aee0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.032+0000 7f856944a640 1 --2- 172.21.15.37:0/555614761 >> v2:172.21.15.37:6805/1977556410 conn(0x7f854803d9d0 0x7f854803fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:38:50.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.033+0000 7fa838dc8640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa818038a00 0x7fa81803af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.033+0000 7fa838dc8640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa818038a00 0x7fa81803af10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.034+0000 7fa839dca640 1 --2- 172.21.15.37:0/2390266561 >> v2:172.21.15.191:6808/1018833307 conn(0x7fa81803da00 0x7fa81803fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:38:50.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.035+0000 7f856944a640 1 --2- 172.21.15.37:0/555614761 >> v2:172.21.15.37:6805/1977556410 conn(0x7f854803d9d0 0x7f854803fe60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.036+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== osd.1 v2:172.21.15.37:6805/1977556410 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f85480404f0 con 0x7f854803d9d0 2024-04-23T01:38:50.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.036+0000 7f4d18ef1640 1 --2- 172.21.15.37:0/4214274474 >> v2:172.21.15.37:6802/1949701083 conn(0x7f4d0003d980 0x7f4d0003fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.038+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f4d000404a0 con 0x7f4d0003d980 2024-04-23T01:38:50.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.038+0000 7f5e877fe640 1 --2- 172.21.15.37:0/2080229480 >> v2:172.21.15.191:6805/3894758024 conn(0x7f5e7403d9d0 0x7f5e7403fe60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.039+0000 7fa839dca640 1 --2- 172.21.15.37:0/2390266561 >> v2:172.21.15.191:6808/1018833307 conn(0x7fa81803da00 0x7fa81803fe90 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.041+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f5e740404f0 con 0x7f5e7403d9d0 2024-04-23T01:38:50.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.041+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7fa818040520 con 0x7fa81803da00 2024-04-23T01:38:50.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.042+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 --> v2:172.21.15.37:6805/1977556410 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f856409b470 con 0x7f854803d9d0 2024-04-23T01:38:50.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.044+0000 7f85617fa640 1 -- 172.21.15.37:0/555614761 <== osd.1 v2:172.21.15.37:6805/1977556410 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f855c00a820 con 0x7f854803d9d0 2024-04-23T01:38:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 --> v2:172.21.15.37:6802/1949701083 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4cf4002c30 con 0x7f4d0003d980 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 >> v2:172.21.15.37:6805/1977556410 conn(0x7f854803d9d0 msgr2=0x7f854803fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 --2- 172.21.15.37:0/555614761 >> v2:172.21.15.37:6805/1977556410 conn(0x7f854803d9d0 0x7f854803fe60 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f85480389d0 msgr2=0x7f854803aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f85480389d0 0x7f854803aee0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85640715c0 msgr2=0x7f856408c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85640715c0 0x7f856408c1e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 shutdown_connections 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 --2- 172.21.15.37:0/555614761 >> v2:172.21.15.37:6805/1977556410 conn(0x7f854803d9d0 0x7f854803fe60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f85480389d0 0x7f854803aee0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 --2- 172.21.15.37:0/555614761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85640715c0 0x7f856408c1e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.045+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 >> 172.21.15.37:0/555614761 conn(0x7f85640a0db0 msgr2=0x7f856412c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.046+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 shutdown_connections 2024-04-23T01:38:50.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.046+0000 7f856aead640 1 -- 172.21.15.37:0/555614761 wait complete. 2024-04-23T01:38:50.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 --> v2:172.21.15.191:6808/1018833307 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa83409c340 con 0x7fa81803da00 2024-04-23T01:38:50.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 --> v2:172.21.15.191:6805/3894758024 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e881337c0 con 0x7f5e7403d9d0 2024-04-23T01:38:50.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f4d10ff9640 1 -- 172.21.15.37:0/4214274474 <== osd.0 v2:172.21.15.37:6802/1949701083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4cf4002c30 con 0x7f4d0003d980 2024-04-23T01:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 >> v2:172.21.15.37:6802/1949701083 conn(0x7f4d0003d980 msgr2=0x7f4d0003fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f4d1a954640 1 --2- 172.21.15.37:0/4214274474 >> v2:172.21.15.37:6802/1949701083 conn(0x7f4d0003d980 0x7f4d0003fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d00038980 msgr2=0x7f4d0003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f4d1a954640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d00038980 0x7f4d0003ae90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 msgr2=0x7f4d141c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.049+0000 7f4d1a954640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d141c98a0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.050+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 shutdown_connections 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.050+0000 7f4d1a954640 1 --2- 172.21.15.37:0/4214274474 >> v2:172.21.15.37:6802/1949701083 conn(0x7f4d0003d980 0x7f4d0003fe10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.050+0000 7f4d1a954640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4d00038980 0x7f4d0003ae90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.050+0000 7f4d1a954640 1 --2- 172.21.15.37:0/4214274474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d1406ec40 0x7f4d141c98a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.050+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 >> 172.21.15.37:0/4214274474 conn(0x7f4d140a5050 msgr2=0x7f4d140a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.050+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 shutdown_connections 2024-04-23T01:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e6f7fe640 1 -- 172.21.15.37:0/2080229480 <== osd.2 v2:172.21.15.191:6805/3894758024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5e8000a820 con 0x7f5e7403d9d0 2024-04-23T01:38:50.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f4d1a954640 1 -- 172.21.15.37:0/4214274474 wait complete. 2024-04-23T01:38:50.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7fa829ffb640 1 -- 172.21.15.37:0/2390266561 <== osd.3 v2:172.21.15.191:6808/1018833307 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa83409c340 con 0x7fa81803da00 2024-04-23T01:38:50.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 >> v2:172.21.15.191:6805/3894758024 conn(0x7f5e7403d9d0 msgr2=0x7f5e7403fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2080229480 >> v2:172.21.15.191:6805/3894758024 conn(0x7f5e7403d9d0 0x7f5e7403fe60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 >> v2:172.21.15.191:6808/1018833307 conn(0x7fa81803da00 msgr2=0x7fa81803fe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5e740389d0 msgr2=0x7f5e7403aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5e740389d0 0x7f5e7403aee0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7fa83b82d640 1 --2- 172.21.15.37:0/2390266561 >> v2:172.21.15.191:6808/1018833307 conn(0x7fa81803da00 0x7fa81803fe90 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e880714d0 msgr2=0x7f5e8812a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e880714d0 0x7f5e8812a870 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 shutdown_connections 2024-04-23T01:38:50.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2080229480 >> v2:172.21.15.191:6805/3894758024 conn(0x7f5e7403d9d0 0x7f5e7403fe60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5e740389d0 0x7f5e7403aee0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 --2- 172.21.15.37:0/2080229480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e880714d0 0x7f5e8812a870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 >> 172.21.15.37:0/2080229480 conn(0x7f5e880a0350 msgr2=0x7f5e880a1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa818038a00 msgr2=0x7fa81803af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.051+0000 7fa83b82d640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa818038a00 0x7fa81803af10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83409cd50 msgr2=0x7fa83406fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 shutdown_connections 2024-04-23T01:38:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83409cd50 0x7fa83406fba0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 shutdown_connections 2024-04-23T01:38:50.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7f5e8d3d7640 1 -- 172.21.15.37:0/2080229480 wait complete. 2024-04-23T01:38:50.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 --2- 172.21.15.37:0/2390266561 >> v2:172.21.15.191:6808/1018833307 conn(0x7fa81803da00 0x7fa81803fe90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa818038a00 0x7fa81803af10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 --2- 172.21.15.37:0/2390266561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83409cd50 0x7fa83406fba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 >> 172.21.15.37:0/2390266561 conn(0x7fa83409f6a0 msgr2=0x7fa83412a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 shutdown_connections 2024-04-23T01:38:50.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.052+0000 7fa83b82d640 1 -- 172.21.15.37:0/2390266561 wait complete. 2024-04-23T01:38:50.075 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:50.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T01:38:50.077 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:50.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T01:38:50.078 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:50.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T01:38:50.079 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:50.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T01:38:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.236+0000 7f597271d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.236+0000 7eff9dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.236+0000 7fb2b4064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.236+0000 7f7d11a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7eff9dc6d640 1 Processor -- start 2024-04-23T01:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7f7d11a24640 1 Processor -- start 2024-04-23T01:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7f597271d640 1 Processor -- start 2024-04-23T01:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7fb2b4064640 1 Processor -- start 2024-04-23T01:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7f7d11a24640 1 -- start start 2024-04-23T01:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7eff9dc6d640 1 -- start start 2024-04-23T01:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7f597271d640 1 -- start start 2024-04-23T01:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.243+0000 7fb2b4064640 1 -- start start 2024-04-23T01:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.244+0000 7f7d11a24640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d0c132e40 0x7f7d0c133250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.244+0000 7f597271d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f596c0a11e0 0x7f596c06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.244+0000 7eff9dc6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff9806f210 0x7eff98131570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7fb2b4064640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2ac132fb0 0x7fb2ac137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7fb2b4064640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac072330 con 0x7fb2ac0725f0 2024-04-23T01:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7fb2b4064640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac0a0ef0 con 0x7fb2ac132fb0 2024-04-23T01:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f7d11a24640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0c132a60 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f7d11a24640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7d0c09d120 con 0x7f7d0c132e40 2024-04-23T01:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f7d0affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d0c132e40 0x7f7d0c133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f7d0affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d0c132e40 0x7f7d0c133250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56478/0 (socket says 172.21.15.37:56478) 2024-04-23T01:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f7d0affd640 1 -- 172.21.15.37:0/4161610197 learned_addr learned my addr 172.21.15.37:0/4161610197 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.244+0000 7eff9dc6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff98130f10 con 0x7eff98131ab0 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.244+0000 7eff9dc6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7eff9809cfd0 con 0x7eff9806f210 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7eff977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff9806f210 0x7eff98131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7eff977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff9806f210 0x7eff98131570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56480/0 (socket says 172.21.15.37:56480) 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7eff977fe640 1 -- 172.21.15.37:0/1976221666 learned_addr learned my addr 172.21.15.37:0/1976221666 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f597271d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596c1321e0 con 0x7f596c09fe50 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f597271d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f596c0a0d90 con 0x7f596c0a11e0 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f596bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f596c0a11e0 0x7f596c06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f596bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f596c0a11e0 0x7f596c06ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56482/0 (socket says 172.21.15.37:56482) 2024-04-23T01:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f596bfff640 1 -- 172.21.15.37:0/2499161877 learned_addr learned my addr 172.21.15.37:0/2499161877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f596b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f596c09fe50 0x7f596c134e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33278/0 (socket says 172.21.15.37:33278) 2024-04-23T01:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7fb2b1e00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb2ac0725f0 0x7fb2ac1328a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33316/0 (socket says 172.21.15.37:33316) 2024-04-23T01:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7fb2b1e00640 1 -- 172.21.15.37:0/3878331597 learned_addr learned my addr 172.21.15.37:0/3878331597 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7fb2b15ff640 1 --2- 172.21.15.37:0/3878331597 >> v2:172.21.15.37:3300/0 conn(0x7fb2ac132fb0 0x7fb2ac137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7eff967fc640 1 -- 172.21.15.37:0/1976221666 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302780018 0 0) 0x7eff98130f10 con 0x7eff98131ab0 2024-04-23T01:38:50.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7eff967fc640 1 -- 172.21.15.37:0/1976221666 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff80003580 con 0x7eff98131ab0 2024-04-23T01:38:50.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7eff977fe640 1 -- 172.21.15.37:0/1976221666 >> v1:172.21.15.37:6789/0 conn(0x7eff98131ab0 legacy=0x7eff9806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f596bfff640 1 -- 172.21.15.37:0/2499161877 >> v1:172.21.15.37:6789/0 conn(0x7f596c09fe50 legacy=0x7f596c134e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7eff977fe640 1 -- 172.21.15.37:0/1976221666 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff9809c820 con 0x7eff9806f210 2024-04-23T01:38:50.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f596affd640 1 -- 172.21.15.37:0/2499161877 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742993796 0 0) 0x7f596c1321e0 con 0x7f596c09fe50 2024-04-23T01:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.245+0000 7f596bfff640 1 -- 172.21.15.37:0/2499161877 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c131ed0 con 0x7f596c0a11e0 2024-04-23T01:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f7d0affd640 1 -- 172.21.15.37:0/4161610197 >> v1:172.21.15.37:6789/0 conn(0x7f7d0c06d8b0 legacy=0x7f7d0c06dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7fb2b0dfe640 1 -- 172.21.15.37:0/3878331597 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3137368466 0 0) 0x7fb2ac072330 con 0x7fb2ac0725f0 2024-04-23T01:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7fb2b0dfe640 1 -- 172.21.15.37:0/3878331597 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb298003580 con 0x7fb2ac0725f0 2024-04-23T01:38:50.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7eff977fe640 1 --2- 172.21.15.37:0/1976221666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff98131570 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efa33f5bceaab02 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f596bfff640 1 --2- 172.21.15.37:0/2499161877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c0a11e0 0x7f596c06ec40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6769aa3776a74cdd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7fb2b15ff640 1 -- 172.21.15.37:0/3878331597 >> v1:172.21.15.37:6789/0 conn(0x7fb2ac0725f0 legacy=0x7fb2ac1328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7fb2b15ff640 1 -- 172.21.15.37:0/3878331597 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac0a0be0 con 0x7fb2ac132fb0 2024-04-23T01:38:50.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f7d0affd640 1 -- 172.21.15.37:0/4161610197 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c09ce00 con 0x7f7d0c132e40 2024-04-23T01:38:50.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f7d0affd640 1 --2- 172.21.15.37:0/4161610197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c132e40 0x7f7d0c133250 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b32c402173569c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7fb2b15ff640 1 --2- 172.21.15.37:0/3878331597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac137dd0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7182aadaadf544 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7eff967fc640 1 -- 172.21.15.37:0/1976221666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff88009e50 con 0x7eff9806f210 2024-04-23T01:38:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7eff967fc640 1 -- 172.21.15.37:0/1976221666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7eff8800e230 con 0x7eff9806f210 2024-04-23T01:38:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7eff967fc640 1 -- 172.21.15.37:0/1976221666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff8800e4d0 con 0x7eff9806f210 2024-04-23T01:38:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f596affd640 1 -- 172.21.15.37:0/2499161877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f596400e040 con 0x7f596c0a11e0 2024-04-23T01:38:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f596affd640 1 -- 172.21.15.37:0/2499161877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59640091e0 con 0x7f596c0a11e0 2024-04-23T01:38:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f7d09ffb640 1 -- 172.21.15.37:0/4161610197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cfc009d40 con 0x7f7d0c132e40 2024-04-23T01:38:50.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7fb2b0dfe640 1 -- 172.21.15.37:0/3878331597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb2a8009d90 con 0x7fb2ac132fb0 2024-04-23T01:38:50.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f596affd640 1 -- 172.21.15.37:0/2499161877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5964007730 con 0x7f596c0a11e0 2024-04-23T01:38:50.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7fb2b0dfe640 1 -- 172.21.15.37:0/3878331597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb2a800e230 con 0x7fb2ac132fb0 2024-04-23T01:38:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.246+0000 7f7d09ffb640 1 -- 172.21.15.37:0/4161610197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7cfc00e230 con 0x7f7d0c132e40 2024-04-23T01:38:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7f7d09ffb640 1 -- 172.21.15.37:0/4161610197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cfc009ea0 con 0x7f7d0c132e40 2024-04-23T01:38:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7fb2b0dfe640 1 -- 172.21.15.37:0/3878331597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb2a8009d90 con 0x7fb2ac132fb0 2024-04-23T01:38:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7eff9dc6d640 1 -- 172.21.15.37:0/1976221666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 msgr2=0x7eff98131570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7eff9dc6d640 1 --2- 172.21.15.37:0/1976221666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff98131570 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7f7d11a24640 1 -- 172.21.15.37:0/4161610197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c132e40 msgr2=0x7f7d0c133250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7f7d11a24640 1 --2- 172.21.15.37:0/4161610197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c132e40 0x7f7d0c133250 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7eff9dc6d640 1 -- 172.21.15.37:0/1976221666 shutdown_connections 2024-04-23T01:38:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7eff9dc6d640 1 --2- 172.21.15.37:0/1976221666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff98131570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7eff9dc6d640 1 -- 172.21.15.37:0/1976221666 >> 172.21.15.37:0/1976221666 conn(0x7eff9809f6a0 msgr2=0x7eff9809fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.247+0000 7f7d11a24640 1 -- 172.21.15.37:0/4161610197 shutdown_connections 2024-04-23T01:38:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f7d11a24640 1 --2- 172.21.15.37:0/4161610197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c132e40 0x7f7d0c133250 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f7d11a24640 1 -- 172.21.15.37:0/4161610197 >> 172.21.15.37:0/4161610197 conn(0x7f7d0c0a06b0 msgr2=0x7f7d0c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7eff9dc6d640 1 -- 172.21.15.37:0/1976221666 shutdown_connections 2024-04-23T01:38:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f7d11a24640 1 -- 172.21.15.37:0/4161610197 shutdown_connections 2024-04-23T01:38:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f7d11a24640 1 -- 172.21.15.37:0/4161610197 wait complete. 2024-04-23T01:38:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7eff9dc6d640 1 -- 172.21.15.37:0/1976221666 wait complete. 2024-04-23T01:38:50.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 1 -- 172.21.15.37:0/2499161877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c0a11e0 msgr2=0x7f596c06ec40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 1 --2- 172.21.15.37:0/2499161877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c0a11e0 0x7f596c06ec40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 1 -- 172.21.15.37:0/3878331597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 msgr2=0x7fb2ac137dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 1 --2- 172.21.15.37:0/3878331597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac137dd0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 1 -- 172.21.15.37:0/2499161877 shutdown_connections 2024-04-23T01:38:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 1 -- 172.21.15.37:0/3878331597 shutdown_connections 2024-04-23T01:38:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 1 --2- 172.21.15.37:0/3878331597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac137dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 1 -- 172.21.15.37:0/3878331597 >> 172.21.15.37:0/3878331597 conn(0x7fb2ac0a1c00 msgr2=0x7fb2ac0a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f7d11a24640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 1 --2- 172.21.15.37:0/2499161877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c0a11e0 0x7f596c06ec40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 1 -- 172.21.15.37:0/2499161877 >> 172.21.15.37:0/2499161877 conn(0x7f596c0a5050 msgr2=0x7f596c0a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7eff9dc6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 1 -- 172.21.15.37:0/2499161877 shutdown_connections 2024-04-23T01:38:50.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 1 -- 172.21.15.37:0/3878331597 shutdown_connections 2024-04-23T01:38:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 1 -- 172.21.15.37:0/2499161877 wait complete. 2024-04-23T01:38:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 1 -- 172.21.15.37:0/3878331597 wait complete. 2024-04-23T01:38:50.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7f597271d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.248+0000 7fb2b4064640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:50.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.250+0000 7f7d11a24640 1 Processor -- start 2024-04-23T01:38:50.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.250+0000 7eff9dc6d640 1 Processor -- start 2024-04-23T01:38:50.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.250+0000 7f7d11a24640 1 -- start start 2024-04-23T01:38:50.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.250+0000 7eff9dc6d640 1 -- start start 2024-04-23T01:38:50.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.251+0000 7f597271d640 1 Processor -- start 2024-04-23T01:38:50.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.251+0000 7fb2b4064640 1 Processor -- start 2024-04-23T01:38:50.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.251+0000 7fb2b4064640 1 -- start start 2024-04-23T01:38:50.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.251+0000 7f7d11a24640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c06d8b0 0x7f7d0c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.251+0000 7f7d11a24640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0c121ee0 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff9dc6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff9812a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff9dc6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff9813b430 con 0x7eff9806f210 2024-04-23T01:38:50.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7f7d0affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c06d8b0 0x7f7d0c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7f7d0affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c06d8b0 0x7f7d0c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56520/0 (socket says 172.21.15.37:56520) 2024-04-23T01:38:50.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff9812a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7f7d0affd640 1 -- 172.21.15.37:0/74445152 learned_addr learned my addr 172.21.15.37:0/74445152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff9812a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56526/0 (socket says 172.21.15.37:56526) 2024-04-23T01:38:50.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff977fe640 1 -- 172.21.15.37:0/3959672421 learned_addr learned my addr 172.21.15.37:0/3959672421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7f597271d640 1 -- start start 2024-04-23T01:38:50.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff977fe640 1 -- 172.21.15.37:0/3959672421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff98138630 con 0x7eff9806f210 2024-04-23T01:38:50.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7f7d0affd640 1 -- 172.21.15.37:0/74445152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0c09be60 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff977fe640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff9812a390 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7f7d0affd640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c06d8b0 0x7f7d0c09aa30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.252+0000 7eff7ffff640 1 -- 172.21.15.37:0/3959672421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff8800edb0 con 0x7eff9806f210 2024-04-23T01:38:50.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff98138da0 con 0x7eff9806f210 2024-04-23T01:38:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7f7cf3fff640 1 -- 172.21.15.37:0/74445152 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cfc009ea0 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7f7cf3fff640 1 -- 172.21.15.37:0/74445152 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7cfc0135b0 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7f7cf3fff640 1 -- 172.21.15.37:0/74445152 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7cfc013850 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0c09bb50 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d0c1219a0 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7eff7ffff640 1 -- 172.21.15.37:0/3959672421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7eff88015420 con 0x7eff9806f210 2024-04-23T01:38:50.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7eff7ffff640 1 -- 172.21.15.37:0/3959672421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7eff88015590 con 0x7eff9806f210 2024-04-23T01:38:50.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.253+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff9813aa40 con 0x7eff9806f210 2024-04-23T01:38:50.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d0c121780 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7fb2b4064640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac09d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7f597271d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c09fe50 0x7f596c11e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7fb2b4064640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac09d1a0 con 0x7fb2ac132fb0 2024-04-23T01:38:50.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7f597271d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f596c121700 con 0x7f596c09fe50 2024-04-23T01:38:50.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7f7cf3fff640 1 -- 172.21.15.37:0/74445152 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7cfc013a00 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7fb2b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac09d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7fb2b1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac09d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56542/0 (socket says 172.21.15.37:56542) 2024-04-23T01:38:50.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7fb2b1e00640 1 -- 172.21.15.37:0/1853490769 learned_addr learned my addr 172.21.15.37:0/1853490769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7f596bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c09fe50 0x7f596c11e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7f596bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c09fe50 0x7f596c11e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56554/0 (socket says 172.21.15.37:56554) 2024-04-23T01:38:50.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.254+0000 7f596bfff640 1 -- 172.21.15.37:0/2284048346 learned_addr learned my addr 172.21.15.37:0/2284048346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:50.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7fb2b1e00640 1 -- 172.21.15.37:0/1853490769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac09e840 con 0x7fb2ac132fb0 2024-04-23T01:38:50.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7f7cf3fff640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7cf80389d0 0x7f7cf803aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7f7cf3fff640 1 -- 172.21.15.37:0/74445152 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f7cfc049920 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7f596bfff640 1 -- 172.21.15.37:0/2284048346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f596c120d50 con 0x7f596c09fe50 2024-04-23T01:38:50.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff98137be0 con 0x7eff9806f210 2024-04-23T01:38:50.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7fb2b1e00640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac09d5d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7eff7ffff640 1 -- 172.21.15.37:0/3959672421 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7eff880156f0 con 0x7eff9806f210 2024-04-23T01:38:50.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7f596bfff640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c09fe50 0x7f596c11e570 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7eff7ffff640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7eff840389d0 0x7eff8403aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7f7d0a7fc640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7cf80389d0 0x7f7cf803aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.255+0000 7eff7ffff640 1 -- 172.21.15.37:0/3959672421 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7eff88049940 con 0x7eff9806f210 2024-04-23T01:38:50.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.256+0000 7eff96ffd640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7eff840389d0 0x7eff8403aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.256+0000 7f7d0a7fc640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7cf80389d0 0x7f7cf803aee0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.256+0000 7eff96ffd640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7eff840389d0 0x7eff8403aee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.260+0000 7f7cf3fff640 1 -- 172.21.15.37:0/74445152 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f7cfc00d1c0 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.260+0000 7f5968ff9640 1 -- 172.21.15.37:0/2284048346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f596400e040 con 0x7f596c09fe50 2024-04-23T01:38:50.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.260+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596c1224b0 con 0x7f596c09fe50 2024-04-23T01:38:50.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.260+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596c121180 con 0x7f596c09fe50 2024-04-23T01:38:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.260+0000 7fb2a27fc640 1 -- 172.21.15.37:0/1853490769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb29c005a60 con 0x7fb2ac132fb0 2024-04-23T01:38:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.260+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac12bf70 con 0x7fb2ac132fb0 2024-04-23T01:38:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.260+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac12cf50 con 0x7fb2ac132fb0 2024-04-23T01:38:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.261+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac132370 con 0x7fb2ac132fb0 2024-04-23T01:38:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.262+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f596c063880 con 0x7f596c09fe50 2024-04-23T01:38:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.266+0000 7fb2a27fc640 1 -- 172.21.15.37:0/1853490769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb29c005bc0 con 0x7fb2ac132fb0 2024-04-23T01:38:50.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.266+0000 7fb2a27fc640 1 -- 172.21.15.37:0/1853490769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb29c005e60 con 0x7fb2ac132fb0 2024-04-23T01:38:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.266+0000 7eff7ffff640 1 -- 172.21.15.37:0/3959672421 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7eff98137be0 con 0x7eff9806f210 2024-04-23T01:38:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.266+0000 7f5968ff9640 1 -- 172.21.15.37:0/2284048346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5964012720 con 0x7f596c09fe50 2024-04-23T01:38:50.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.266+0000 7f5968ff9640 1 -- 172.21.15.37:0/2284048346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59640129c0 con 0x7f596c09fe50 2024-04-23T01:38:50.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7fb2a27fc640 1 -- 172.21.15.37:0/1853490769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb29c00c770 con 0x7fb2ac132fb0 2024-04-23T01:38:50.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7f5968ff9640 1 -- 172.21.15.37:0/2284048346 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5964012b20 con 0x7f596c09fe50 2024-04-23T01:38:50.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7fb2a27fc640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb290038980 0x7fb29003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7fb2a27fc640 1 -- 172.21.15.37:0/1853490769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fb29c048470 con 0x7fb2ac132fb0 2024-04-23T01:38:50.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7f5968ff9640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5958038980 0x7f595803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:50.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7fb2b15ff640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb290038980 0x7fb29003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7f5968ff9640 1 -- 172.21.15.37:0/2284048346 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f5964049840 con 0x7f596c09fe50 2024-04-23T01:38:50.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.268+0000 7f596b7fe640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5958038980 0x7f595803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:50.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.269+0000 7f596b7fe640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5958038980 0x7f595803ae90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.269+0000 7fb2b15ff640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb290038980 0x7fb29003ae90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:50.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.273+0000 7fb2a27fc640 1 -- 172.21.15.37:0/1853490769 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb29c00da20 con 0x7fb2ac132fb0 2024-04-23T01:38:50.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.279+0000 7f5968ff9640 1 -- 172.21.15.37:0/2284048346 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f59640143e0 con 0x7f596c09fe50 2024-04-23T01:38:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.451+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7d0c122020 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.452+0000 7f7cf3fff640 1 -- 172.21.15.37:0/74445152 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f7cfc011320 con 0x7f7d0c06d8b0 2024-04-23T01:38:50.450 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7cf80389d0 msgr2=0x7f7cf803aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7cf80389d0 0x7f7cf803aee0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c06d8b0 msgr2=0x7f7d0c09aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c06d8b0 0x7f7d0c09aa30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 shutdown_connections 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7cf80389d0 0x7f7cf803aee0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 --2- 172.21.15.37:0/74445152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c06d8b0 0x7f7d0c09aa30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 >> 172.21.15.37:0/74445152 conn(0x7f7d0c0a06b0 msgr2=0x7f7d0c1bac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 shutdown_connections 2024-04-23T01:38:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.455+0000 7f7d11a24640 1 -- 172.21.15.37:0/74445152 wait complete. 2024-04-23T01:38:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.458+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7eff98138f30 con 0x7eff9806f210 2024-04-23T01:38:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.458+0000 7eff7ffff640 1 -- 172.21.15.37:0/3959672421 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7eff88010820 con 0x7eff9806f210 2024-04-23T01:38:50.456 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-04-23T01:38:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7eff840389d0 msgr2=0x7eff8403aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7eff840389d0 0x7eff8403aee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 msgr2=0x7eff9812a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff9812a390 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 shutdown_connections 2024-04-23T01:38:50.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7eff840389d0 0x7eff8403aee0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 --2- 172.21.15.37:0/3959672421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9806f210 0x7eff9812a390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 >> 172.21.15.37:0/3959672421 conn(0x7eff9809f6a0 msgr2=0x7eff9806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 shutdown_connections 2024-04-23T01:38:50.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.460+0000 7eff9dc6d640 1 -- 172.21.15.37:0/3959672421 wait complete. 2024-04-23T01:38:50.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.463+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb2ac063880 con 0x7fb2ac132fb0 2024-04-23T01:38:50.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.463+0000 7fb2a27fc640 1 -- 172.21.15.37:0/1853490769 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fb29c00d150 con 0x7fb2ac132fb0 2024-04-23T01:38:50.461 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.465+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb290038980 msgr2=0x7fb29003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.465+0000 7fb2b4064640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb290038980 0x7fb29003ae90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.465+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 msgr2=0x7fb2ac09d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.465+0000 7fb2b4064640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac09d5d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.466+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 shutdown_connections 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.466+0000 7fb2b4064640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb290038980 0x7fb29003ae90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.466+0000 7fb2b4064640 1 --2- 172.21.15.37:0/1853490769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac132fb0 0x7fb2ac09d5d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.466+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 >> 172.21.15.37:0/1853490769 conn(0x7fb2ac0a1c00 msgr2=0x7fb2ac1309e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.466+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 shutdown_connections 2024-04-23T01:38:50.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.466+0000 7fb2b4064640 1 -- 172.21.15.37:0/1853490769 wait complete. 2024-04-23T01:38:50.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.3 2024-04-23T01:38:50.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2024-04-23T01:38:50.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.475+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f596c069220 con 0x7f596c09fe50 2024-04-23T01:38:50.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.476+0000 7f5968ff9640 1 -- 172.21.15.37:0/2284048346 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f5964010320 con 0x7f596c09fe50 2024-04-23T01:38:50.473 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-04-23T01:38:50.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2024-04-23T01:38:50.476 DEBUG:teuthology.parallel:result is None 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5958038980 msgr2=0x7f595803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5958038980 0x7f595803ae90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c09fe50 msgr2=0x7f596c11e570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c09fe50 0x7f596c11e570 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 shutdown_connections 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5958038980 0x7f595803ae90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 --2- 172.21.15.37:0/2284048346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f596c09fe50 0x7f596c11e570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 >> 172.21.15.37:0/2284048346 conn(0x7f596c0a5050 msgr2=0x7f596c130e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 shutdown_connections 2024-04-23T01:38:50.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:50.478+0000 7f597271d640 1 -- 172.21.15.37:0/2284048346 wait complete. 2024-04-23T01:38:50.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2024-04-23T01:38:51.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T01:38:51.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T01:38:51.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T01:38:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.597+0000 7f0fa7a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.597+0000 7f07090ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.605+0000 7f0fa7a6d640 1 Processor -- start 2024-04-23T01:38:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.605+0000 7f07090ad640 1 Processor -- start 2024-04-23T01:38:51.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.605+0000 7f07090ad640 1 -- start start 2024-04-23T01:38:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.605+0000 7f0fa7a6d640 1 -- start start 2024-04-23T01:38:51.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f07090ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f070409f6c0 0x7f070409fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f0fa7a6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0fa009ee40 0x7f0fa009f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f07090ad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0704070d80 con 0x7f07040a0010 2024-04-23T01:38:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f0fa7a6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa006f0b0 con 0x7f0fa009f790 2024-04-23T01:38:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f07090ad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f07040717b0 con 0x7f070409f6c0 2024-04-23T01:38:51.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f0fa7a6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa0073c50 con 0x7f0fa009ee40 2024-04-23T01:38:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f070259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07040a0010 0x7f07041329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33322/0 (socket says 172.21.15.37:33322) 2024-04-23T01:38:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f0fa5809640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0fa009ee40 0x7f0fa009f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f0fa5008640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0fa009f790 0x7f0fa01316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33330/0 (socket says 172.21.15.37:33330) 2024-04-23T01:38:51.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f0fa5008640 1 -- 172.21.15.37:0/610427558 learned_addr learned my addr 172.21.15.37:0/610427558 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f070259c640 1 -- 172.21.15.37:0/1243551849 learned_addr learned my addr 172.21.15.37:0/1243551849 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.607+0000 7f0702d9d640 1 --2- 172.21.15.37:0/1243551849 >> v2:172.21.15.37:3300/0 conn(0x7f070409f6c0 0x7f070409fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0fa5809640 1 -- 172.21.15.37:0/610427558 >> v1:172.21.15.37:6789/0 conn(0x7f0fa009f790 legacy=0x7f0fa01316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0fa4807640 1 -- 172.21.15.37:0/610427558 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989678633 0 0) 0x7f0fa006f0b0 con 0x7f0fa009f790 2024-04-23T01:38:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0fa5809640 1 -- 172.21.15.37:0/610427558 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa00a1120 con 0x7f0fa009ee40 2024-04-23T01:38:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0702d9d640 1 -- 172.21.15.37:0/1243551849 >> v1:172.21.15.37:6789/0 conn(0x7f07040a0010 legacy=0x7f07041329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0702d9d640 1 -- 172.21.15.37:0/1243551849 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0704072330 con 0x7f070409f6c0 2024-04-23T01:38:51.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0fa5809640 1 --2- 172.21.15.37:0/610427558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa009f250 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdd50f0ee6568f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0fa4807640 1 -- 172.21.15.37:0/610427558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f98009d90 con 0x7f0fa009ee40 2024-04-23T01:38:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0702d9d640 1 --2- 172.21.15.37:0/1243551849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070409fad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fca2d99a5c96bf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0fa4807640 1 -- 172.21.15.37:0/610427558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f9800e230 con 0x7f0fa009ee40 2024-04-23T01:38:51.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0fa4807640 1 -- 172.21.15.37:0/610427558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f9800e4d0 con 0x7f0fa009ee40 2024-04-23T01:38:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0701d9b640 1 -- 172.21.15.37:0/1243551849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f06f4009d90 con 0x7f070409f6c0 2024-04-23T01:38:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0701d9b640 1 -- 172.21.15.37:0/1243551849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f06f400e230 con 0x7f070409f6c0 2024-04-23T01:38:51.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.608+0000 7f0701d9b640 1 -- 172.21.15.37:0/1243551849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f06f400e4d0 con 0x7f070409f6c0 2024-04-23T01:38:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/610427558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 msgr2=0x7f0fa009f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f0fa7a6d640 1 --2- 172.21.15.37:0/610427558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa009f250 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/610427558 shutdown_connections 2024-04-23T01:38:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f0fa7a6d640 1 --2- 172.21.15.37:0/610427558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa009f250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/610427558 >> 172.21.15.37:0/610427558 conn(0x7f0fa00a3be0 msgr2=0x7f0fa00a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f07090ad640 1 -- 172.21.15.37:0/1243551849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 msgr2=0x7f070409fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f07090ad640 1 --2- 172.21.15.37:0/1243551849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070409fad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/610427558 shutdown_connections 2024-04-23T01:38:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f07090ad640 1 -- 172.21.15.37:0/1243551849 shutdown_connections 2024-04-23T01:38:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/610427558 wait complete. 2024-04-23T01:38:51.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f07090ad640 1 --2- 172.21.15.37:0/1243551849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070409fad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.609+0000 7f07090ad640 1 -- 172.21.15.37:0/1243551849 >> 172.21.15.37:0/1243551849 conn(0x7f07040a1960 msgr2=0x7f07040a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.610+0000 7f07090ad640 1 -- 172.21.15.37:0/1243551849 shutdown_connections 2024-04-23T01:38:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.610+0000 7f07090ad640 1 -- 172.21.15.37:0/1243551849 wait complete. 2024-04-23T01:38:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.610+0000 7f0fa7a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:51.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.610+0000 7f07090ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.611+0000 7f0fa7a6d640 1 Processor -- start 2024-04-23T01:38:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.612+0000 7f0fa7a6d640 1 -- start start 2024-04-23T01:38:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.612+0000 7f07090ad640 1 Processor -- start 2024-04-23T01:38:51.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.612+0000 7f07090ad640 1 -- start start 2024-04-23T01:38:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.613+0000 7f0fa7a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa011e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.613+0000 7f0fa7a6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa0120740 con 0x7f0fa009ee40 2024-04-23T01:38:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.613+0000 7f0fa5809640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa011e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.613+0000 7f0fa5809640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa011e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56574/0 (socket says 172.21.15.37:56574) 2024-04-23T01:38:51.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.613+0000 7f0fa5809640 1 -- 172.21.15.37:0/3997091397 learned_addr learned my addr 172.21.15.37:0/3997091397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0fa5809640 1 -- 172.21.15.37:0/3997091397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa011f700 con 0x7f0fa009ee40 2024-04-23T01:38:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f07090ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070411be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f07090ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f070411e370 con 0x7f070409f6c0 2024-04-23T01:38:51.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070411be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0fa5809640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa011e5e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0702d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070411be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56580/0 (socket says 172.21.15.37:56580) 2024-04-23T01:38:51.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0702d9d640 1 -- 172.21.15.37:0/2616098447 learned_addr learned my addr 172.21.15.37:0/2616098447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:51.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0f9e7fc640 1 -- 172.21.15.37:0/3997091397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f98014620 con 0x7f0fa009ee40 2024-04-23T01:38:51.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0f9e7fc640 1 -- 172.21.15.37:0/3997091397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f98014780 con 0x7f0fa009ee40 2024-04-23T01:38:51.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0f9e7fc640 1 -- 172.21.15.37:0/3997091397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f98014a20 con 0x7f0fa009ee40 2024-04-23T01:38:51.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa0122230 con 0x7f0fa009ee40 2024-04-23T01:38:51.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0702d9d640 1 -- 172.21.15.37:0/2616098447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070411fe60 con 0x7f070409f6c0 2024-04-23T01:38:51.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.614+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa0120e90 con 0x7f0fa009ee40 2024-04-23T01:38:51.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.615+0000 7f0702d9d640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070411be80 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.615+0000 7f06eb7fe640 1 -- 172.21.15.37:0/2616098447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f06f4014540 con 0x7f070409f6c0 2024-04-23T01:38:51.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.615+0000 7f06eb7fe640 1 -- 172.21.15.37:0/2616098447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f06f40146a0 con 0x7f070409f6c0 2024-04-23T01:38:51.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.615+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0704130320 con 0x7f070409f6c0 2024-04-23T01:38:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.615+0000 7f06eb7fe640 1 -- 172.21.15.37:0/2616098447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f06f4014940 con 0x7f070409f6c0 2024-04-23T01:38:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.616+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070411d970 con 0x7f070409f6c0 2024-04-23T01:38:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.616+0000 7f0f9e7fc640 1 -- 172.21.15.37:0/3997091397 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0f98014c20 con 0x7f0fa009ee40 2024-04-23T01:38:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.616+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa0120a70 con 0x7f0fa009ee40 2024-04-23T01:38:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.616+0000 7f0f9e7fc640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f8c038930 0x7f0f8c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.616+0000 7f0f9e7fc640 1 -- 172.21.15.37:0/3997091397 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f0f98019040 con 0x7f0fa009ee40 2024-04-23T01:38:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.617+0000 7f0fa5008640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f8c038930 0x7f0f8c03ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.617+0000 7f06eb7fe640 1 -- 172.21.15.37:0/2616098447 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f06f4014af0 con 0x7f070409f6c0 2024-04-23T01:38:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.617+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07040692b0 con 0x7f070409f6c0 2024-04-23T01:38:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.617+0000 7f06eb7fe640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f06f0038980 0x7f06f003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.617+0000 7f0fa5008640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f8c038930 0x7f0f8c03ae40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.617+0000 7f070259c640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f06f0038980 0x7f06f003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.618+0000 7f070259c640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f06f0038980 0x7f06f003ae90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.622+0000 7f06eb7fe640 1 -- 172.21.15.37:0/2616098447 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f06f4019040 con 0x7f070409f6c0 2024-04-23T01:38:51.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.622+0000 7f0f9e7fc640 1 -- 172.21.15.37:0/3997091397 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f0f98013e40 con 0x7f0fa009ee40 2024-04-23T01:38:51.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.632+0000 7f06eb7fe640 1 -- 172.21.15.37:0/2616098447 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f06f4018190 con 0x7f070409f6c0 2024-04-23T01:38:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.639+0000 7f6a7d420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:51.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.646+0000 7f6a7d420640 1 Processor -- start 2024-04-23T01:38:51.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.646+0000 7f6a7d420640 1 -- start start 2024-04-23T01:38:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.647+0000 7f6a7d420640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a7809f960 0x7f6a7813a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.647+0000 7f6a7d420640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a7806f0b0 con 0x7f6a7809ee40 2024-04-23T01:38:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.647+0000 7f6a7d420640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6a78073c50 con 0x7f6a7809f960 2024-04-23T01:38:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.647+0000 7f6a767fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a7809f960 0x7f6a7813a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.647+0000 7f6a767fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a7809f960 0x7f6a7813a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56590/0 (socket says 172.21.15.37:56590) 2024-04-23T01:38:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.647+0000 7f6a767fc640 1 -- 172.21.15.37:0/987155110 learned_addr learned my addr 172.21.15.37:0/987155110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.647+0000 7f6a76ffd640 1 --1- 172.21.15.37:0/987155110 >> v1:172.21.15.37:6789/0 conn(0x7f6a7809ee40 0x7f6a7809f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33340/0 (socket says 172.21.15.37:33340) 2024-04-23T01:38:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.648+0000 7f6a767fc640 1 -- 172.21.15.37:0/987155110 >> v1:172.21.15.37:6789/0 conn(0x7f6a7809ee40 legacy=0x7f6a7809f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.648+0000 7f6a767fc640 1 -- 172.21.15.37:0/987155110 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a780a1120 con 0x7f6a7809f960 2024-04-23T01:38:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.648+0000 7f6a767fc640 1 --2- 172.21.15.37:0/987155110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809f960 0x7f6a7813a090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b4ec03f11498d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.648+0000 7f6a75ffb640 1 -- 172.21.15.37:0/987155110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6a6c009e50 con 0x7f6a7809f960 2024-04-23T01:38:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.648+0000 7f6a75ffb640 1 -- 172.21.15.37:0/987155110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6a6c00e230 con 0x7f6a7809f960 2024-04-23T01:38:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.648+0000 7f6a75ffb640 1 -- 172.21.15.37:0/987155110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6a6c00e4d0 con 0x7f6a7809f960 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 1 -- 172.21.15.37:0/987155110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809f960 msgr2=0x7f6a7813a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 1 --2- 172.21.15.37:0/987155110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809f960 0x7f6a7813a090 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 1 -- 172.21.15.37:0/987155110 shutdown_connections 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 1 --2- 172.21.15.37:0/987155110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809f960 0x7f6a7813a090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 1 -- 172.21.15.37:0/987155110 >> 172.21.15.37:0/987155110 conn(0x7f6a780a3be0 msgr2=0x7f6a780a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 1 -- 172.21.15.37:0/987155110 shutdown_connections 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 1 -- 172.21.15.37:0/987155110 wait complete. 2024-04-23T01:38:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.649+0000 7f6a7d420640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:51.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.651+0000 7f6a7d420640 1 Processor -- start 2024-04-23T01:38:51.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.651+0000 7f6a7d420640 1 -- start start 2024-04-23T01:38:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a7d420640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809ee40 0x7f6a781c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a7d420640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a78120860 con 0x7f6a7809ee40 2024-04-23T01:38:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809ee40 0x7f6a781c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809ee40 0x7f6a781c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56596/0 (socket says 172.21.15.37:56596) 2024-04-23T01:38:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a76ffd640 1 -- 172.21.15.37:0/889899043 learned_addr learned my addr 172.21.15.37:0/889899043 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:51.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a76ffd640 1 -- 172.21.15.37:0/889899043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a78120cc0 con 0x7f6a7809ee40 2024-04-23T01:38:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a76ffd640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809ee40 0x7f6a781c9c60 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.653+0000 7f6a5f7fe640 1 -- 172.21.15.37:0/889899043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6a680059a0 con 0x7f6a7809ee40 2024-04-23T01:38:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.654+0000 7f6a5f7fe640 1 -- 172.21.15.37:0/889899043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6a68005b00 con 0x7f6a7809ee40 2024-04-23T01:38:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.654+0000 7f6a5f7fe640 1 -- 172.21.15.37:0/889899043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6a68005da0 con 0x7f6a7809ee40 2024-04-23T01:38:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.654+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a781c95b0 con 0x7f6a7809ee40 2024-04-23T01:38:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.654+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a78122090 con 0x7f6a7809ee40 2024-04-23T01:38:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.655+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a781c9a60 con 0x7f6a7809ee40 2024-04-23T01:38:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.655+0000 7f6a5f7fe640 1 -- 172.21.15.37:0/889899043 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f6a680070b0 con 0x7f6a7809ee40 2024-04-23T01:38:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.655+0000 7f6a5f7fe640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6a64038930 0x7f6a6403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.655+0000 7f6a5f7fe640 1 -- 172.21.15.37:0/889899043 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f6a680482a0 con 0x7f6a7809ee40 2024-04-23T01:38:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.656+0000 7f6a767fc640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6a64038930 0x7f6a6403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.656+0000 7f6a767fc640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6a64038930 0x7f6a6403ae40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.666+0000 7f6a5f7fe640 1 -- 172.21.15.37:0/889899043 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f6a6800d330 con 0x7f6a7809ee40 2024-04-23T01:38:51.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.821+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0fa0063880 con 0x7f0fa009ee40 2024-04-23T01:38:51.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.821+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f0704063880 con 0x7f070409f6c0 2024-04-23T01:38:51.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.821+0000 7f06eb7fe640 1 -- 172.21.15.37:0/2616098447 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f06f4001d40 con 0x7f070409f6c0 2024-04-23T01:38:51.820 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:51.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.822+0000 7f0f9e7fc640 1 -- 172.21.15.37:0/3997091397 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f0f98010310 con 0x7f0fa009ee40 2024-04-23T01:38:51.820 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f06f0038980 msgr2=0x7f06f003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f06f0038980 0x7f06f003ae90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 msgr2=0x7f070411be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070411be80 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 shutdown_connections 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f06f0038980 0x7f06f003ae90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 --2- 172.21.15.37:0/2616098447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070409f6c0 0x7f070411be80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 >> 172.21.15.37:0/2616098447 conn(0x7f07040a1960 msgr2=0x7f07041bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 shutdown_connections 2024-04-23T01:38:51.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f07090ad640 1 -- 172.21.15.37:0/2616098447 wait complete. 2024-04-23T01:38:51.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f8c038930 msgr2=0x7f0f8c03ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f8c038930 0x7f0f8c03ae40 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 msgr2=0x7f0fa011e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa011e5e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 shutdown_connections 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f8c038930 0x7f0f8c03ae40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 --2- 172.21.15.37:0/3997091397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa009ee40 0x7f0fa011e5e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 >> 172.21.15.37:0/3997091397 conn(0x7f0fa00a3be0 msgr2=0x7f0fa01bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 shutdown_connections 2024-04-23T01:38:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.824+0000 7f0fa7a6d640 1 -- 172.21.15.37:0/3997091397 wait complete. 2024-04-23T01:38:51.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-04-23T01:38:51.834 DEBUG:teuthology.parallel:result is None 2024-04-23T01:38:51.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-04-23T01:38:51.834 DEBUG:teuthology.parallel:result is None 2024-04-23T01:38:51.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.857+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6a78063880 con 0x7f6a7809ee40 2024-04-23T01:38:51.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.857+0000 7f6a5f7fe640 1 -- 172.21.15.37:0/889899043 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f6a6800d150 con 0x7f6a7809ee40 2024-04-23T01:38:51.855 INFO:teuthology.orchestra.run.smithi037.stdout:38654705670 2024-04-23T01:38:51.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6a64038930 msgr2=0x7f6a6403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6a64038930 0x7f6a6403ae40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809ee40 msgr2=0x7f6a781c9c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:51.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809ee40 0x7f6a781c9c60 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 shutdown_connections 2024-04-23T01:38:51.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6a64038930 0x7f6a6403ae40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 --2- 172.21.15.37:0/889899043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a7809ee40 0x7f6a781c9c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:51.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 >> 172.21.15.37:0/889899043 conn(0x7f6a780a3be0 msgr2=0x7f6a781bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:51.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 shutdown_connections 2024-04-23T01:38:51.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:51.859+0000 7f6a7d420640 1 -- 172.21.15.37:0/889899043 wait complete. 2024-04-23T01:38:51.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-04-23T01:38:51.868 DEBUG:teuthology.parallel:result is None 2024-04-23T01:38:51.868 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T01:38:51.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T01:38:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.017+0000 7f39d34ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.022+0000 7f39d34ad640 1 Processor -- start 2024-04-23T01:38:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.023+0000 7f39d34ad640 1 -- start start 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.024+0000 7f39d34ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39cc09f6c0 0x7f39cc09fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.024+0000 7f39d34ad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39cc06dda0 con 0x7f39cc0a0010 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.024+0000 7f39d34ad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f39cc06e2e0 con 0x7f39cc09f6c0 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.024+0000 7f39d1249640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39cc09f6c0 0x7f39cc09fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.024+0000 7f39d0a48640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f39cc0a0010 0x7f39cc12c420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33344/0 (socket says 172.21.15.37:33344) 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.024+0000 7f39d1249640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39cc09f6c0 0x7f39cc09fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56598/0 (socket says 172.21.15.37:56598) 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.024+0000 7f39d0a48640 1 -- 172.21.15.37:0/3518200056 learned_addr learned my addr 172.21.15.37:0/3518200056 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.025+0000 7f39d1249640 1 -- 172.21.15.37:0/3518200056 >> v1:172.21.15.37:6789/0 conn(0x7f39cc0a0010 legacy=0x7f39cc12c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.025+0000 7f39d1249640 1 -- 172.21.15.37:0/3518200056 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc06d920 con 0x7f39cc09f6c0 2024-04-23T01:38:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.025+0000 7f39d1249640 1 --2- 172.21.15.37:0/3518200056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc09fad0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670af5e1e4ff6b45 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.025+0000 7f39cbfff640 1 -- 172.21.15.37:0/3518200056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39bc00e040 con 0x7f39cc09f6c0 2024-04-23T01:38:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.025+0000 7f39cbfff640 1 -- 172.21.15.37:0/3518200056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39bc007670 con 0x7f39cc09f6c0 2024-04-23T01:38:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.025+0000 7f39cbfff640 1 -- 172.21.15.37:0/3518200056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39bc007910 con 0x7f39cc09f6c0 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 1 -- 172.21.15.37:0/3518200056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 msgr2=0x7f39cc09fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 1 --2- 172.21.15.37:0/3518200056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc09fad0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 1 -- 172.21.15.37:0/3518200056 shutdown_connections 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 1 --2- 172.21.15.37:0/3518200056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc09fad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 1 -- 172.21.15.37:0/3518200056 >> 172.21.15.37:0/3518200056 conn(0x7f39cc0a0950 msgr2=0x7f39cc0a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 1 -- 172.21.15.37:0/3518200056 shutdown_connections 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 1 -- 172.21.15.37:0/3518200056 wait complete. 2024-04-23T01:38:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.026+0000 7f39d34ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.028+0000 7f39d34ad640 1 Processor -- start 2024-04-23T01:38:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.028+0000 7f39d34ad640 1 -- start start 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.029+0000 7f39d34ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc1c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.029+0000 7f39d34ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39cc11d1b0 con 0x7f39cc09f6c0 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.029+0000 7f39d1249640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc1c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39d1249640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc1c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56600/0 (socket says 172.21.15.37:56600) 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39d1249640 1 -- 172.21.15.37:0/3277884926 learned_addr learned my addr 172.21.15.37:0/3277884926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39d1249640 1 -- 172.21.15.37:0/3277884926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39cc1c4120 con 0x7f39cc09f6c0 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39d1249640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc1c44c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39c9ffb640 1 -- 172.21.15.37:0/3277884926 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39bc00e040 con 0x7f39cc09f6c0 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39c9ffb640 1 -- 172.21.15.37:0/3277884926 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f39bc012a10 con 0x7f39cc09f6c0 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39cc11e530 con 0x7f39cc09f6c0 2024-04-23T01:38:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39c9ffb640 1 -- 172.21.15.37:0/3277884926 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f39bc012cb0 con 0x7f39cc09f6c0 2024-04-23T01:38:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.030+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39cc11e9d0 con 0x7f39cc09f6c0 2024-04-23T01:38:52.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.031+0000 7f39c9ffb640 1 -- 172.21.15.37:0/3277884926 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f39bc0153f0 con 0x7f39cc09f6c0 2024-04-23T01:38:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.031+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39cc063880 con 0x7f39cc09f6c0 2024-04-23T01:38:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.032+0000 7f39c9ffb640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f39b8038980 0x7f39b803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.032+0000 7f39c9ffb640 1 -- 172.21.15.37:0/3277884926 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f39bc049c10 con 0x7f39cc09f6c0 2024-04-23T01:38:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.032+0000 7f39d0a48640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f39b8038980 0x7f39b803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.033+0000 7f39d0a48640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f39b8038980 0x7f39b803ae90 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.037+0000 7f39c9ffb640 1 -- 172.21.15.37:0/3277884926 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f39bc00fe60 con 0x7f39cc09f6c0 2024-04-23T01:38:52.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.219+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f39cc06dfd0 con 0x7f39b8038980 2024-04-23T01:38:52.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.221+0000 7f39c9ffb640 1 -- 172.21.15.37:0/3277884926 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+30852 (crc 0 0 0) 0x7f39c0001250 con 0x7f39b8038980 2024-04-23T01:38:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:52.220 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-23T01:38:52.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f39b8038980 msgr2=0x7f39b803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f39b8038980 0x7f39b803ae90 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 msgr2=0x7f39cc1c44c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc1c44c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 shutdown_connections 2024-04-23T01:38:52.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f39b8038980 0x7f39b803ae90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 --2- 172.21.15.37:0/3277884926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39cc09f6c0 0x7f39cc1c44c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 >> 172.21.15.37:0/3277884926 conn(0x7f39cc0a0950 msgr2=0x7f39cc0a1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:52.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 shutdown_connections 2024-04-23T01:38:52.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.223+0000 7f39d34ad640 1 -- 172.21.15.37:0/3277884926 wait complete. 2024-04-23T01:38:52.231 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-23T01:38:51.751607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109776,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320624,"statfs":{"total":429496729600,"available":429384318976,"internally_reserved":0,"allocated":1630208,"data_stored":1289700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.705190"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.827118+0000","last_change":"2024-04-23T01:38:48.861947+0000","last_active":"2024-04-23T01:38:49.827118+0000","last_peered":"2024-04-23T01:38:49.827118+0000","last_clean":"2024-04-23T01:38:49.827118+0000","last_became_active":"2024-04-23T01:38:48.855491+0000","last_became_peered":"2024-04-23T01:38:48.855491+0000","last_unstale":"2024-04-23T01:38:49.827118+0000","last_undegraded":"2024-04-23T01:38:49.827118+0000","last_fullsized":"2024-04-23T01:38:49.827118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.863645+0000","last_change":"2024-04-23T01:38:48.864893+0000","last_active":"2024-04-23T01:38:48.863645+0000","last_peered":"2024-04-23T01:38:48.863645+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.859341+0000","last_became_peered":"2024-04-23T01:38:48.859341+0000","last_unstale":"2024-04-23T01:38:48.863645+0000","last_undegraded":"2024-04-23T01:38:48.863645+0000","last_fullsized":"2024-04-23T01:38:48.863645+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.876017+0000","last_change":"2024-04-23T01:38:48.878113+0000","last_active":"2024-04-23T01:38:48.876017+0000","last_peered":"2024-04-23T01:38:48.876017+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.868717+0000","last_became_peered":"2024-04-23T01:38:48.868717+0000","last_unstale":"2024-04-23T01:38:48.876017+0000","last_undegraded":"2024-04-23T01:38:48.876017+0000","last_fullsized":"2024-04-23T01:38:48.876017+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.865101+0000","last_change":"2024-04-23T01:38:48.865866+0000","last_active":"2024-04-23T01:38:48.865101+0000","last_peered":"2024-04-23T01:38:48.865101+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.860354+0000","last_became_peered":"2024-04-23T01:38:48.860354+0000","last_unstale":"2024-04-23T01:38:48.865101+0000","last_undegraded":"2024-04-23T01:38:48.865101+0000","last_fullsized":"2024-04-23T01:38:48.865101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.829950+0000","last_change":"2024-04-23T01:38:48.884633+0000","last_active":"2024-04-23T01:38:49.829950+0000","last_peered":"2024-04-23T01:38:49.829950+0000","last_clean":"2024-04-23T01:38:49.829950+0000","last_became_active":"2024-04-23T01:38:48.879351+0000","last_became_peered":"2024-04-23T01:38:48.879351+0000","last_unstale":"2024-04-23T01:38:49.829950+0000","last_undegraded":"2024-04-23T01:38:49.829950+0000","last_fullsized":"2024-04-23T01:38:49.829950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.886862+0000","last_change":"2024-04-23T01:38:48.887592+0000","last_active":"2024-04-23T01:38:48.886862+0000","last_peered":"2024-04-23T01:38:48.886862+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.883647+0000","last_became_peered":"2024-04-23T01:38:48.883647+0000","last_unstale":"2024-04-23T01:38:48.886862+0000","last_undegraded":"2024-04-23T01:38:48.886862+0000","last_fullsized":"2024-04-23T01:38:48.886862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.826188+0000","last_change":"2024-04-23T01:38:48.858269+0000","last_active":"2024-04-23T01:38:49.826188+0000","last_peered":"2024-04-23T01:38:49.826188+0000","last_clean":"2024-04-23T01:38:49.826188+0000","last_became_active":"2024-04-23T01:38:48.849449+0000","last_became_peered":"2024-04-23T01:38:48.849449+0000","last_unstale":"2024-04-23T01:38:49.826188+0000","last_undegraded":"2024-04-23T01:38:49.826188+0000","last_fullsized":"2024-04-23T01:38:49.826188+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.829962+0000","last_change":"2024-04-23T01:38:48.872508+0000","last_active":"2024-04-23T01:38:49.829962+0000","last_peered":"2024-04-23T01:38:49.829962+0000","last_clean":"2024-04-23T01:38:49.829962+0000","last_became_active":"2024-04-23T01:38:48.866529+0000","last_became_peered":"2024-04-23T01:38:48.866529+0000","last_unstale":"2024-04-23T01:38:49.829962+0000","last_undegraded":"2024-04-23T01:38:49.829962+0000","last_fullsized":"2024-04-23T01:38:49.829962+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":141,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.823713+0000","last_change":"2024-04-23T01:38:46.833335+0000","last_active":"2024-04-23T01:38:48.823713+0000","last_peered":"2024-04-23T01:38:48.823713+0000","last_clean":"2024-04-23T01:38:48.823713+0000","last_became_active":"2024-04-23T01:38:46.827916+0000","last_became_peered":"2024-04-23T01:38:46.827916+0000","last_unstale":"2024-04-23T01:38:48.823713+0000","last_undegraded":"2024-04-23T01:38:48.823713+0000","last_fullsized":"2024-04-23T01:38:48.823713+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_clean_scrub_stamp":"2024-04-23T01:38:45.784723+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T01:38:52.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T01:38:52.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.341+0000 7f5a509f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:52.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.345+0000 7f5a509f5640 1 Processor -- start 2024-04-23T01:38:52.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.346+0000 7f5a509f5640 1 -- start start 2024-04-23T01:38:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.347+0000 7f5a509f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a4c0a01e0 0x7f5a4c137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.347+0000 7f5a509f5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4c070d80 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.347+0000 7f5a509f5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5a4c0717b0 con 0x7f5a4c0a01e0 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.347+0000 7f5a4a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5a4c09f6c0 0x7f5a4c09fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33356/0 (socket says 172.21.15.37:33356) 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.347+0000 7f5a4a59c640 1 -- 172.21.15.37:0/2520401396 learned_addr learned my addr 172.21.15.37:0/2520401396 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.347+0000 7f5a49d9b640 1 --2- 172.21.15.37:0/2520401396 >> v2:172.21.15.37:3300/0 conn(0x7f5a4c0a01e0 0x7f5a4c137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.348+0000 7f5a49d9b640 1 -- 172.21.15.37:0/2520401396 >> v1:172.21.15.37:6789/0 conn(0x7f5a4c09f6c0 legacy=0x7f5a4c09fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.348+0000 7f5a49d9b640 1 -- 172.21.15.37:0/2520401396 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c072330 con 0x7f5a4c0a01e0 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.348+0000 7f5a49d9b640 1 --2- 172.21.15.37:0/2520401396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0a01e0 0x7f5a4c137c40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5312f7a6ba7f93 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.348+0000 7f5a4959a640 1 -- 172.21.15.37:0/2520401396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a40009d90 con 0x7f5a4c0a01e0 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.348+0000 7f5a4959a640 1 -- 172.21.15.37:0/2520401396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a4000e230 con 0x7f5a4c0a01e0 2024-04-23T01:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.348+0000 7f5a4959a640 1 -- 172.21.15.37:0/2520401396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a4000e4d0 con 0x7f5a4c0a01e0 2024-04-23T01:38:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 1 -- 172.21.15.37:0/2520401396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0a01e0 msgr2=0x7f5a4c137c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 1 --2- 172.21.15.37:0/2520401396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0a01e0 0x7f5a4c137c40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 1 -- 172.21.15.37:0/2520401396 shutdown_connections 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 1 --2- 172.21.15.37:0/2520401396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0a01e0 0x7f5a4c137c40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 1 -- 172.21.15.37:0/2520401396 >> 172.21.15.37:0/2520401396 conn(0x7f5a4c0a1960 msgr2=0x7f5a4c0a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 1 -- 172.21.15.37:0/2520401396 shutdown_connections 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 1 -- 172.21.15.37:0/2520401396 wait complete. 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.349+0000 7f5a509f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.351+0000 7f5a509f5640 1 Processor -- start 2024-04-23T01:38:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.351+0000 7f5a509f5640 1 -- start start 2024-04-23T01:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.352+0000 7f5a509f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c09f6c0 0x7f5a4c11bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.352+0000 7f5a509f5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c11fd60 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a4a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c09f6c0 0x7f5a4c11bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a4a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c09f6c0 0x7f5a4c11bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56612/0 (socket says 172.21.15.37:56612) 2024-04-23T01:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a4a59c640 1 -- 172.21.15.37:0/2854732284 learned_addr learned my addr 172.21.15.37:0/2854732284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a4a59c640 1 -- 172.21.15.37:0/2854732284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c12ff10 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a4a59c640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c09f6c0 0x7f5a4c11bee0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a3affd640 1 -- 172.21.15.37:0/2854732284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a44005a60 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a3affd640 1 -- 172.21.15.37:0/2854732284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a44005bc0 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c130140 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a3affd640 1 -- 172.21.15.37:0/2854732284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a44005e60 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.353+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c11eac0 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.354+0000 7f5a3affd640 1 -- 172.21.15.37:0/2854732284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5a440070b0 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.354+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c0692b0 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.355+0000 7f5a3affd640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5a2c038980 0x7f5a2c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.355+0000 7f5a3affd640 1 -- 172.21.15.37:0/2854732284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f5a440481c0 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.355+0000 7f5a49d9b640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5a2c038980 0x7f5a2c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.355+0000 7f5a49d9b640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5a2c038980 0x7f5a2c03ae90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.360+0000 7f5a3affd640 1 -- 172.21.15.37:0/2854732284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f5a4400d510 con 0x7f5a4c09f6c0 2024-04-23T01:38:52.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.542+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a4c120100 con 0x7f5a2c038980 2024-04-23T01:38:52.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.544+0000 7f5a3affd640 1 -- 172.21.15.37:0/2854732284 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+30852 (crc 0 0 0) 0x7f5a4000e3a0 con 0x7f5a2c038980 2024-04-23T01:38:52.542 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:52.542 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5a2c038980 msgr2=0x7f5a2c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5a2c038980 0x7f5a2c03ae90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c09f6c0 msgr2=0x7f5a4c11bee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c09f6c0 0x7f5a4c11bee0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 shutdown_connections 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5a2c038980 0x7f5a2c03ae90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 --2- 172.21.15.37:0/2854732284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c09f6c0 0x7f5a4c11bee0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 >> 172.21.15.37:0/2854732284 conn(0x7f5a4c0a1960 msgr2=0x7f5a4c1bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 shutdown_connections 2024-04-23T01:38:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.546+0000 7f5a509f5640 1 -- 172.21.15.37:0/2854732284 wait complete. 2024-04-23T01:38:52.554 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-04-23T01:38:51.751607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109776,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320624,"statfs":{"total":429496729600,"available":429384318976,"internally_reserved":0,"allocated":1630208,"data_stored":1289700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.705190"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.827118+0000","last_change":"2024-04-23T01:38:48.861947+0000","last_active":"2024-04-23T01:38:49.827118+0000","last_peered":"2024-04-23T01:38:49.827118+0000","last_clean":"2024-04-23T01:38:49.827118+0000","last_became_active":"2024-04-23T01:38:48.855491+0000","last_became_peered":"2024-04-23T01:38:48.855491+0000","last_unstale":"2024-04-23T01:38:49.827118+0000","last_undegraded":"2024-04-23T01:38:49.827118+0000","last_fullsized":"2024-04-23T01:38:49.827118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.863645+0000","last_change":"2024-04-23T01:38:48.864893+0000","last_active":"2024-04-23T01:38:48.863645+0000","last_peered":"2024-04-23T01:38:48.863645+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.859341+0000","last_became_peered":"2024-04-23T01:38:48.859341+0000","last_unstale":"2024-04-23T01:38:48.863645+0000","last_undegraded":"2024-04-23T01:38:48.863645+0000","last_fullsized":"2024-04-23T01:38:48.863645+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.876017+0000","last_change":"2024-04-23T01:38:48.878113+0000","last_active":"2024-04-23T01:38:48.876017+0000","last_peered":"2024-04-23T01:38:48.876017+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.868717+0000","last_became_peered":"2024-04-23T01:38:48.868717+0000","last_unstale":"2024-04-23T01:38:48.876017+0000","last_undegraded":"2024-04-23T01:38:48.876017+0000","last_fullsized":"2024-04-23T01:38:48.876017+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.865101+0000","last_change":"2024-04-23T01:38:48.865866+0000","last_active":"2024-04-23T01:38:48.865101+0000","last_peered":"2024-04-23T01:38:48.865101+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.860354+0000","last_became_peered":"2024-04-23T01:38:48.860354+0000","last_unstale":"2024-04-23T01:38:48.865101+0000","last_undegraded":"2024-04-23T01:38:48.865101+0000","last_fullsized":"2024-04-23T01:38:48.865101+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.829950+0000","last_change":"2024-04-23T01:38:48.884633+0000","last_active":"2024-04-23T01:38:49.829950+0000","last_peered":"2024-04-23T01:38:49.829950+0000","last_clean":"2024-04-23T01:38:49.829950+0000","last_became_active":"2024-04-23T01:38:48.879351+0000","last_became_peered":"2024-04-23T01:38:48.879351+0000","last_unstale":"2024-04-23T01:38:49.829950+0000","last_undegraded":"2024-04-23T01:38:49.829950+0000","last_fullsized":"2024-04-23T01:38:49.829950+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.886862+0000","last_change":"2024-04-23T01:38:48.887592+0000","last_active":"2024-04-23T01:38:48.886862+0000","last_peered":"2024-04-23T01:38:48.886862+0000","last_clean":"2024-04-23T01:38:47.794323+0000","last_became_active":"2024-04-23T01:38:48.883647+0000","last_became_peered":"2024-04-23T01:38:48.883647+0000","last_unstale":"2024-04-23T01:38:48.886862+0000","last_undegraded":"2024-04-23T01:38:48.886862+0000","last_fullsized":"2024-04-23T01:38:48.886862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.826188+0000","last_change":"2024-04-23T01:38:48.858269+0000","last_active":"2024-04-23T01:38:49.826188+0000","last_peered":"2024-04-23T01:38:49.826188+0000","last_clean":"2024-04-23T01:38:49.826188+0000","last_became_active":"2024-04-23T01:38:48.849449+0000","last_became_peered":"2024-04-23T01:38:48.849449+0000","last_unstale":"2024-04-23T01:38:49.826188+0000","last_undegraded":"2024-04-23T01:38:49.826188+0000","last_fullsized":"2024-04-23T01:38:49.826188+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-23T01:38:49.829962+0000","last_change":"2024-04-23T01:38:48.872508+0000","last_active":"2024-04-23T01:38:49.829962+0000","last_peered":"2024-04-23T01:38:49.829962+0000","last_clean":"2024-04-23T01:38:49.829962+0000","last_became_active":"2024-04-23T01:38:48.866529+0000","last_became_peered":"2024-04-23T01:38:48.866529+0000","last_unstale":"2024-04-23T01:38:49.829962+0000","last_undegraded":"2024-04-23T01:38:49.829962+0000","last_fullsized":"2024-04-23T01:38:49.829962+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":141,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-23T01:38:48.823713+0000","last_change":"2024-04-23T01:38:46.833335+0000","last_active":"2024-04-23T01:38:48.823713+0000","last_peered":"2024-04-23T01:38:48.823713+0000","last_clean":"2024-04-23T01:38:48.823713+0000","last_became_active":"2024-04-23T01:38:46.827916+0000","last_became_peered":"2024-04-23T01:38:46.827916+0000","last_unstale":"2024-04-23T01:38:48.823713+0000","last_undegraded":"2024-04-23T01:38:48.823713+0000","last_fullsized":"2024-04-23T01:38:48.823713+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_clean_scrub_stamp":"2024-04-23T01:38:45.784723+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T01:38:52.555 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T01:38:52.555 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T01:38:52.555 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-23T01:38:52.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T01:38:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.665+0000 7fb2774ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.669+0000 7fb2774ad640 1 Processor -- start 2024-04-23T01:38:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.669+0000 7fb2774ad640 1 -- start start 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.670+0000 7fb2774ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb270137e70 0x7fb27013a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.670+0000 7fb2774ad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2700a0be0 con 0x7fb270134e70 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.670+0000 7fb2774ad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb27009d8b0 con 0x7fb270137e70 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.670+0000 7fb275249640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb270134e70 0x7fb270135280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33360/0 (socket says 172.21.15.37:33360) 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.670+0000 7fb274a48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb270137e70 0x7fb27013a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.670+0000 7fb275249640 1 -- 172.21.15.37:0/228298461 learned_addr learned my addr 172.21.15.37:0/228298461 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.671+0000 7fb274a48640 1 -- 172.21.15.37:0/228298461 >> v1:172.21.15.37:6789/0 conn(0x7fb270134e70 legacy=0x7fb270135280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.671+0000 7fb274a48640 1 -- 172.21.15.37:0/228298461 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27009c1c0 con 0x7fb270137e70 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.671+0000 7fb274a48640 1 --2- 172.21.15.37:0/228298461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270137e70 0x7fb27013a290 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf34f2975d76c68 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.671+0000 7fb26ffff640 1 -- 172.21.15.37:0/228298461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb264009d90 con 0x7fb270137e70 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.671+0000 7fb26ffff640 1 -- 172.21.15.37:0/228298461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb26400e230 con 0x7fb270137e70 2024-04-23T01:38:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.671+0000 7fb26ffff640 1 -- 172.21.15.37:0/228298461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb26400e4d0 con 0x7fb270137e70 2024-04-23T01:38:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 1 -- 172.21.15.37:0/228298461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270137e70 msgr2=0x7fb27013a290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 1 --2- 172.21.15.37:0/228298461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270137e70 0x7fb27013a290 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 1 -- 172.21.15.37:0/228298461 shutdown_connections 2024-04-23T01:38:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 1 --2- 172.21.15.37:0/228298461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270137e70 0x7fb27013a290 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 1 -- 172.21.15.37:0/228298461 >> 172.21.15.37:0/228298461 conn(0x7fb2700a1960 msgr2=0x7fb2700a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 1 -- 172.21.15.37:0/228298461 shutdown_connections 2024-04-23T01:38:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 1 -- 172.21.15.37:0/228298461 wait complete. 2024-04-23T01:38:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.672+0000 7fb2774ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:38:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.674+0000 7fb2774ad640 1 Processor -- start 2024-04-23T01:38:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.674+0000 7fb2774ad640 1 -- start start 2024-04-23T01:38:52.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb2774ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270134e70 0x7fb27011f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb2774ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb270123440 con 0x7fb270134e70 2024-04-23T01:38:52.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb275249640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270134e70 0x7fb27011f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb275249640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270134e70 0x7fb27011f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56622/0 (socket says 172.21.15.37:56622) 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb275249640 1 -- 172.21.15.37:0/912530025 learned_addr learned my addr 172.21.15.37:0/912530025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb275249640 1 -- 172.21.15.37:0/912530025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb270120f30 con 0x7fb270134e70 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb275249640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270134e70 0x7fb27011f720 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb26dffb640 1 -- 172.21.15.37:0/912530025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb268005a60 con 0x7fb270134e70 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2700767f0 con 0x7fb270134e70 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb26dffb640 1 -- 172.21.15.37:0/912530025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb268005bc0 con 0x7fb270134e70 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.676+0000 7fb26dffb640 1 -- 172.21.15.37:0/912530025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb268005e60 con 0x7fb270134e70 2024-04-23T01:38:52.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.677+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb270121e90 con 0x7fb270134e70 2024-04-23T01:38:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.678+0000 7fb26dffb640 1 -- 172.21.15.37:0/912530025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb2680070b0 con 0x7fb270134e70 2024-04-23T01:38:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.678+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb270063880 con 0x7fb270134e70 2024-04-23T01:38:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.678+0000 7fb26dffb640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb25c038930 0x7fb25c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:38:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.678+0000 7fb26dffb640 1 -- 172.21.15.37:0/912530025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fb2680481d0 con 0x7fb270134e70 2024-04-23T01:38:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.678+0000 7fb274a48640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb25c038930 0x7fb25c03ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:38:52.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.679+0000 7fb274a48640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb25c038930 0x7fb25c03ae40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:38:52.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.683+0000 7fb26dffb640 1 -- 172.21.15.37:0/912530025 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb26800d7f0 con 0x7fb270134e70 2024-04-23T01:38:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.908+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb270121810 con 0x7fb270134e70 2024-04-23T01:38:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.909+0000 7fb26dffb640 1 -- 172.21.15.37:0/912530025 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7fb26800d610 con 0x7fb270134e70 2024-04-23T01:38:52.907 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:38:52.907 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T01:38:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb25c038930 msgr2=0x7fb25c03ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb25c038930 0x7fb25c03ae40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270134e70 msgr2=0x7fb27011f720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:38:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270134e70 0x7fb27011f720 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 shutdown_connections 2024-04-23T01:38:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb25c038930 0x7fb25c03ae40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 --2- 172.21.15.37:0/912530025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb270134e70 0x7fb27011f720 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:38:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 >> 172.21.15.37:0/912530025 conn(0x7fb2700a1960 msgr2=0x7fb2700a2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:38:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 shutdown_connections 2024-04-23T01:38:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:38:52.911+0000 7fb2774ad640 1 -- 172.21.15.37:0/912530025 wait complete. 2024-04-23T01:38:52.920 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-23T01:38:52.920 INFO:teuthology.run_tasks:Running task workunit... 2024-04-23T01:38:52.936 INFO:tasks.workunit:Pulling workunits from ref a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 2024-04-23T01:38:52.936 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T01:38:52.936 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T01:38:52.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:38:52.952 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-23T01:38:52.952 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-23T01:38:53.007 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-23T01:38:53.008 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-23T01:38:53.062 INFO:tasks.workunit:timeout=3h 2024-04-23T01:38:53.062 INFO:tasks.workunit:cleanup=True 2024-04-23T01:38:53.063 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 2024-04-23T01:38:53.118 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T01:40:21.537 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 93% (11431/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-23T01:40:22.251 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4'. 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-04-23T01:40:22.252 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-23T01:40:22.253 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-04-23T01:40:22.253 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-23T01:40:22.253 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T01:40:22.253 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-23T01:40:22.253 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at a1f34943cf7 crimson/common/tri_mutex: make promotion atomic with func 2024-04-23T01:40:22.258 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T01:40:22.322 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T01:40:22.324 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T01:40:22.324 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T01:40:22.983 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T01:40:23.040 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T01:40:23.082 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T01:40:23.084 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T01:40:23.084 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T01:40:23.124 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T01:40:23.127 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-23T01:40:23.128 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T01:40:23.187 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-04-23T01:40:23.188 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-04-23T01:40:23.189 DEBUG:teuthology.orchestra.run.smithi037:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-04-23T01:40:23.249 INFO:tasks.workunit.client.0.smithi037.stderr:+ parallel=1 2024-04-23T01:40:23.249 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' --crimson = --serial ']' 2024-04-23T01:40:23.249 INFO:tasks.workunit.client.0.smithi037.stderr:+ crimson=0 2024-04-23T01:40:23.250 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' --crimson = --crimson ']' 2024-04-23T01:40:23.250 INFO:tasks.workunit.client.0.smithi037.stderr:+ parallel=0 2024-04-23T01:40:23.250 INFO:tasks.workunit.client.0.smithi037.stderr:+ crimson=1 2024-04-23T01:40:23.250 INFO:tasks.workunit.client.0.smithi037.stderr:+ color= 2024-04-23T01:40:23.251 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' -t 1 ']' 2024-04-23T01:40:23.251 INFO:tasks.workunit.client.0.smithi037.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-04-23T01:40:23.251 INFO:tasks.workunit.client.0.smithi037.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-23T01:40:23.251 INFO:tasks.workunit.client.0.smithi037.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-23T01:40:23.251 INFO:tasks.workunit.client.0.smithi037.stderr:+ declare -A pids 2024-04-23T01:40:23.251 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:40:23.251 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:40:23.252 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_aio 2024-04-23T01:40:23.265 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:40:23.266 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 42 tests from 2 test suites. 2024-04-23T01:40:23.266 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:40:23.266 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 26 tests from LibRadosAio 2024-04-23T01:40:23.266 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.TooBig 2024-04-23T01:40:26.245 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.TooBig (2978 ms) 2024-04-23T01:40:26.246 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-04-23T01:40:29.259 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.SimpleWrite (3016 ms) 2024-04-23T01:40:29.260 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-04-23T01:40:32.281 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.WaitForSafe (3022 ms) 2024-04-23T01:40:32.282 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-04-23T01:40:35.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTrip (3014 ms) 2024-04-23T01:40:35.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-04-23T01:40:38.312 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTrip2 (3016 ms) 2024-04-23T01:40:38.312 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-04-23T01:40:41.325 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTrip3 (3013 ms) 2024-04-23T01:40:41.325 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-04-23T01:40:44.336 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripAppend (3012 ms) 2024-04-23T01:40:44.337 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-04-23T01:40:47.352 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RemoveTest (3015 ms) 2024-04-23T01:40:47.352 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-04-23T01:40:50.369 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3017 ms) 2024-04-23T01:40:50.369 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RmXattr 2024-04-23T01:40:53.393 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RmXattr (3024 ms) 2024-04-23T01:40:53.393 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.XattrIter 2024-04-23T01:40:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.XattrIter (3016 ms) 2024-04-23T01:40:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.IsComplete 2024-04-23T01:40:59.418 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.IsComplete (3010 ms) 2024-04-23T01:40:59.419 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.IsSafe 2024-04-23T01:41:02.434 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.IsSafe (3015 ms) 2024-04-23T01:41:02.434 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-04-23T01:41:05.447 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.ReturnValue (3013 ms) 2024-04-23T01:41:05.447 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.Flush 2024-04-23T01:41:08.461 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.Flush (3014 ms) 2024-04-23T01:41:08.461 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-04-23T01:41:11.475 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.FlushAsync (3015 ms) 2024-04-23T01:41:11.476 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-04-23T01:41:14.496 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3020 ms) 2024-04-23T01:41:14.496 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-04-23T01:41:17.208 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (2713 ms) 2024-04-23T01:41:17.209 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-04-23T01:41:20.220 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.SimpleStat (3012 ms) 2024-04-23T01:41:20.221 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-04-23T01:41:23.236 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.OperateMtime (3015 ms) 2024-04-23T01:41:23.236 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-04-23T01:41:26.249 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.Operate2Mtime (3013 ms) 2024-04-23T01:41:26.249 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-04-23T01:41:29.252 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.SimpleStatNS (3003 ms) 2024-04-23T01:41:29.252 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.StatRemove 2024-04-23T01:41:32.265 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.StatRemove (3013 ms) 2024-04-23T01:41:32.265 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-04-23T01:41:35.276 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.ExecuteClass (3012 ms) 2024-04-23T01:41:35.277 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-04-23T01:41:38.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.MultiWrite (3011 ms) 2024-04-23T01:41:38.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-04-23T01:41:41.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.AioUnlock (3012 ms) 2024-04-23T01:41:41.301 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 26 tests from LibRadosAio (78034 ms total) 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 16 tests from LibRadosAioEC 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1100: Skipped 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1132: Skipped 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1149: Skipped 2024-04-23T01:41:41.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1182: Skipped 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1215: Skipped 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1286: Skipped 2024-04-23T01:41:41.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1326: Skipped 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1366: Skipped 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.Flush 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1385: Skipped 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-04-23T01:41:41.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1415: Skipped 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1454: Skipped 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1498: Skipped 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1532: Skipped 2024-04-23T01:41:41.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1593: Skipped 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1649: Skipped 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio.cc:1681: Skipped 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:41:41.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 42 tests from 2 test suites ran. (78034 ms total) 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 26 tests. 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 16 tests, listed below: 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-04-23T01:41:41.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:41:41.308 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:41:41.309 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_aio_pp 2024-04-23T01:41:41.325 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:41:41.325 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 57 tests from 4 test suites. 2024-04-23T01:41:41.325 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:41:41.325 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 32 tests from LibRadosAio 2024-04-23T01:41:41.325 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-04-23T01:41:44.310 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.TooBigPP (2985 ms) 2024-04-23T01:41:44.310 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-04-23T01:42:08.230 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.PoolQuotaPP (23920 ms) 2024-04-23T01:42:08.231 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-04-23T01:42:14.262 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.SimpleWritePP (6032 ms) 2024-04-23T01:42:14.263 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-04-23T01:42:17.281 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.WaitForSafePP (3018 ms) 2024-04-23T01:42:17.282 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-04-23T01:42:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripPP (3020 ms) 2024-04-23T01:42:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-04-23T01:42:23.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3023 ms) 2024-04-23T01:42:23.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-04-23T01:42:26.336 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripPP3 (3011 ms) 2024-04-23T01:42:26.336 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-04-23T01:42:29.345 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3010 ms) 2024-04-23T01:42:29.345 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-04-23T01:42:32.225 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.IsCompletePP (2880 ms) 2024-04-23T01:42:32.225 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-04-23T01:42:35.364 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.IsSafePP (3140 ms) 2024-04-23T01:42:35.365 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-04-23T01:42:38.387 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.ReturnValuePP (3023 ms) 2024-04-23T01:42:38.476 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.FlushPP 2024-04-23T01:42:41.404 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.FlushPP (3017 ms) 2024-04-23T01:42:41.405 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-04-23T01:42:44.229 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.FlushAsyncPP (2825 ms) 2024-04-23T01:42:44.230 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-04-23T01:42:47.247 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3017 ms) 2024-04-23T01:42:47.247 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-04-23T01:42:50.268 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3021 ms) 2024-04-23T01:42:50.268 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-04-23T01:42:53.284 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3016 ms) 2024-04-23T01:42:53.284 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-04-23T01:42:56.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (3020 ms) 2024-04-23T01:42:56.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-04-23T01:42:59.312 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3009 ms) 2024-04-23T01:42:59.313 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-04-23T01:43:02.231 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.SimpleStatPP (2918 ms) 2024-04-23T01:43:02.231 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-04-23T01:43:05.337 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.OperateMtime (3106 ms) 2024-04-23T01:43:05.337 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-04-23T01:43:08.351 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.OperateMtime2 (3014 ms) 2024-04-23T01:43:08.351 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-04-23T01:43:11.366 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.StatRemovePP (3015 ms) 2024-04-23T01:43:11.366 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-04-23T01:43:14.381 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3015 ms) 2024-04-23T01:43:14.381 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.OmapPP 2024-04-23T01:43:17.390 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.OmapPP (3009 ms) 2024-04-23T01:43:17.390 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-04-23T01:43:20.406 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.MultiWritePP (3016 ms) 2024-04-23T01:43:20.406 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-04-23T01:43:23.238 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.AioUnlockPP (2832 ms) 2024-04-23T01:43:23.238 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-04-23T01:43:26.254 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (3015 ms) 2024-04-23T01:43:26.254 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-04-23T01:43:29.261 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RacingRemovePP (3008 ms) 2024-04-23T01:43:29.261 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-04-23T01:43:32.239 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (2977 ms) 2024-04-23T01:43:32.239 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-04-23T01:43:35.283 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3045 ms) 2024-04-23T01:43:35.283 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-04-23T01:43:37.789 INFO:tasks.workunit.client.0.smithi037.stdout:setting pool EIO 2024-04-23T01:43:47.472 INFO:tasks.workunit.client.0.smithi037.stdout:waiting for 925 2024-04-23T01:43:48.472 INFO:tasks.workunit.client.0.smithi037.stdout:waiting for 925 2024-04-23T01:43:49.472 INFO:tasks.workunit.client.0.smithi037.stdout:waiting for 925 2024-04-23T01:43:50.473 INFO:tasks.workunit.client.0.smithi037.stdout:max_success 75, min_failed 76 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAio.PoolEIOFlag (16023 ms) 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAio.MultiReads 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:2427: Skipped 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 32 tests from LibRadosAio (129981 ms total) 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosAioPP 2024-04-23T01:43:51.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-04-23T01:43:54.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (3018 ms) 2024-04-23T01:43:54.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-04-23T01:44:03.357 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (9033 ms) 2024-04-23T01:44:03.357 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-04-23T01:44:18.252 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAioPP.RmXattrPP (14895 ms) 2024-04-23T01:44:18.252 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-04-23T01:44:21.264 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3012 ms) 2024-04-23T01:44:21.264 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosAioPP (29958 ms total) 2024-04-23T01:44:21.264 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:21.264 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosIoPP 2024-04-23T01:44:21.265 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-04-23T01:44:24.286 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.XattrListPP (3019 ms) 2024-04-23T01:44:24.286 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosIoPP (3020 ms total) 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 20 tests from LibRadosAioEC 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1384: Skipped 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1419: Skipped 2024-04-23T01:44:24.287 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1436: Skipped 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1467: Skipped 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-04-23T01:44:24.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1500: Skipped 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1605: Skipped 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1637: Skipped 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-04-23T01:44:24.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1705: Skipped 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1742: Skipped 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1780: Skipped 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-04-23T01:44:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1796: Skipped 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1824: Skipped 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1859: Skipped 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-04-23T01:44:24.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1904: Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1946: Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:1977: Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:2008: Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:2059: Skipped 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:2089: Skipped 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/aio_cxx.cc:2124: Skipped 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-04-23T01:44:24.293 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 57 tests from 4 test suites ran. (162959 ms total) 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 36 tests. 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 21 tests, listed below: 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-23T01:44:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-04-23T01:44:24.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-04-23T01:44:24.296 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:44:24.296 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:44:24.296 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_io 2024-04-23T01:44:24.308 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:44:24.309 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 24 tests from 2 test suites. 2024-04-23T01:44:24.309 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:44:24.309 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from LibRadosIo 2024-04-23T01:44:26.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-04-23T01:44:26.704 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.SimpleWrite (414 ms) 2024-04-23T01:44:26.704 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.TooBig 2024-04-23T01:44:26.704 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-04-23T01:44:26.705 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-04-23T01:44:26.769 INFO:tasks.workunit.client.0.smithi037.stdout:no timeout :/ 2024-04-23T01:44:26.770 INFO:tasks.workunit.client.0.smithi037.stdout:no timeout :/ 2024-04-23T01:44:26.770 INFO:tasks.workunit.client.0.smithi037.stdout:no timeout :/ 2024-04-23T01:44:26.770 INFO:tasks.workunit.client.0.smithi037.stdout:no timeout :/ 2024-04-23T01:44:26.770 INFO:tasks.workunit.client.0.smithi037.stdout:no timeout :/ 2024-04-23T01:44:26.770 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.ReadTimeout (64 ms) 2024-04-23T01:44:26.770 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-04-23T01:44:26.801 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.RoundTrip (33 ms) 2024-04-23T01:44:26.801 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.Checksum 2024-04-23T01:44:26.822 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.Checksum (20 ms) 2024-04-23T01:44:26.822 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-04-23T01:44:26.847 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (25 ms) 2024-04-23T01:44:26.847 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-04-23T01:44:26.872 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (25 ms) 2024-04-23T01:44:26.872 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-04-23T01:44:26.897 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.AppendRoundTrip (25 ms) 2024-04-23T01:44:26.897 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-04-23T01:44:26.901 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.ZeroLenZero (4 ms) 2024-04-23T01:44:26.902 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.TruncTest 2024-04-23T01:44:26.926 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.TruncTest (25 ms) 2024-04-23T01:44:26.926 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-04-23T01:44:26.949 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.RemoveTest (22 ms) 2024-04-23T01:44:26.949 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-04-23T01:44:26.977 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (29 ms) 2024-04-23T01:44:26.977 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.RmXattr 2024-04-23T01:44:27.049 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.RmXattr (72 ms) 2024-04-23T01:44:27.049 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIo.XattrIter 2024-04-23T01:44:27.082 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIo.XattrIter (33 ms) 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from LibRadosIo (792 ms total) 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from LibRadosIoEC 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:168: Skipped 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-04-23T01:44:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-04-23T01:44:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:176: Skipped 2024-04-23T01:44:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 24 tests from 2 test suites ran. (2992 ms total) 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 14 tests. 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 10 tests, listed below: 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-04-23T01:44:27.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-04-23T01:44:27.310 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-04-23T01:44:27.310 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-04-23T01:44:27.310 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:44:27.310 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:44:27.310 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_io_pp 2024-04-23T01:44:27.321 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:44:27.321 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 38 tests from 2 test suites. 2024-04-23T01:44:27.321 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:44:27.321 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 21 tests from LibRadosIoPP 2024-04-23T01:44:27.321 INFO:tasks.workunit.client.0.smithi037.stdout:seed 31619 2024-04-23T01:44:29.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-04-23T01:44:29.310 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-04-23T01:44:29.310 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-04-23T01:44:29.650 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (341 ms) 2024-04-23T01:44:29.650 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-04-23T01:44:29.715 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.ReadOpPP (65 ms) 2024-04-23T01:44:29.716 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-04-23T01:44:29.738 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (23 ms) 2024-04-23T01:44:29.738 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-04-23T01:44:31.908 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2170 ms) 2024-04-23T01:44:31.908 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-04-23T01:44:31.930 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.RoundTripPP (22 ms) 2024-04-23T01:44:31.930 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-04-23T01:44:31.949 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (18 ms) 2024-04-23T01:44:31.949 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-04-23T01:44:31.967 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.Checksum (19 ms) 2024-04-23T01:44:31.967 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-04-23T01:44:31.985 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (17 ms) 2024-04-23T01:44:31.985 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-04-23T01:44:32.017 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (33 ms) 2024-04-23T01:44:32.017 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-04-23T01:44:32.043 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (25 ms) 2024-04-23T01:44:32.043 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-04-23T01:44:32.059 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (16 ms) 2024-04-23T01:44:32.059 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-04-23T01:44:32.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (25 ms) 2024-04-23T01:44:32.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-04-23T01:44:32.107 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.TruncTestPP (24 ms) 2024-04-23T01:44:32.107 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-04-23T01:44:32.130 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (23 ms) 2024-04-23T01:44:32.130 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-04-23T01:44:32.159 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (29 ms) 2024-04-23T01:44:32.159 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-04-23T01:44:32.232 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.RmXattrPP (72 ms) 2024-04-23T01:44:32.232 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-04-23T01:44:32.268 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.XattrListPP (36 ms) 2024-04-23T01:44:32.268 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-04-23T01:44:32.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.CmpExtPP (26 ms) 2024-04-23T01:44:32.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-04-23T01:44:32.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (16 ms) 2024-04-23T01:44:32.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-04-23T01:44:32.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (22 ms) 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 21 tests from LibRadosIoPP (3022 ms total) 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 17 tests from LibRadosIoECPP 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.325 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-04-23T01:44:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 17 tests from LibRadosIoECPP (0 ms total) 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:44:33.332 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 38 tests from 2 test suites ran. (5999 ms total) 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 21 tests. 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 17 tests, listed below: 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-04-23T01:44:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-04-23T01:44:33.334 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-04-23T01:44:33.334 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-04-23T01:44:33.334 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-23T01:44:33.334 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:44:33.334 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:44:33.334 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_asio 2024-04-23T01:44:33.358 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.360+0000 7ff3920836c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:33.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.367+0000 7ff3920836c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:33.366 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.368+0000 7ff3920836c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:33.367 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 12 tests from 1 test suite. 2024-04-23T01:44:33.367 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:44:33.367 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 12 tests from AsioRados 2024-04-23T01:44:33.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.369+0000 7ff3920836c0 1 Processor -- start 2024-04-23T01:44:33.368 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.369+0000 7ff3920836c0 1 -- start start 2024-04-23T01:44:33.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.372+0000 7ff3920836c0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x11c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:44:33.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.372+0000 7ff3920836c0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x100e950 con 0x108f8f0 2024-04-23T01:44:33.370 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.372+0000 7ff38a39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x11c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:44:33.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.372+0000 7ff38a39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x11c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53966/0 (socket says 172.21.15.37:53966) 2024-04-23T01:44:33.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.372+0000 7ff38a39a640 1 -- 172.21.15.37:0/1173046690 learned_addr learned my addr 172.21.15.37:0/1173046690 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:44:33.371 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.372+0000 7ff38a39a640 1 -- 172.21.15.37:0/1173046690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xfad1e0 con 0x108f8f0 2024-04-23T01:44:33.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.373+0000 7ff38a39a640 1 --2- 172.21.15.37:0/1173046690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x11c7fd0 crc :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179f9e1a020b5b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:44:33.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.373+0000 7ff388b97640 1 -- 172.21.15.37:0/1173046690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff37402c520 con 0x108f8f0 2024-04-23T01:44:33.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.373+0000 7ff388b97640 1 -- 172.21.15.37:0/1173046690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff37402cb90 con 0x108f8f0 2024-04-23T01:44:33.372 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.373+0000 7ff388b97640 1 -- 172.21.15.37:0/1173046690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff37402ce30 con 0x108f8f0 2024-04-23T01:44:33.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.374+0000 7ff3920836c0 1 -- 172.21.15.37:0/1173046690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 msgr2=0x11c7fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:44:33.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.374+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1173046690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x11c7fd0 crc :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:33.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.374+0000 7ff3920836c0 1 -- 172.21.15.37:0/1173046690 shutdown_connections 2024-04-23T01:44:33.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.374+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1173046690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x11c7fd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:33.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.374+0000 7ff3920836c0 1 -- 172.21.15.37:0/1173046690 >> 172.21.15.37:0/1173046690 conn(0xfc5960 msgr2=0x10adb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:44:33.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.374+0000 7ff3920836c0 1 -- 172.21.15.37:0/1173046690 shutdown_connections 2024-04-23T01:44:33.373 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.374+0000 7ff3920836c0 1 -- 172.21.15.37:0/1173046690 wait complete. 2024-04-23T01:44:33.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.376+0000 7ff3920836c0 1 Processor -- start 2024-04-23T01:44:33.375 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.376+0000 7ff3920836c0 1 -- start start 2024-04-23T01:44:33.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.379+0000 7ff3920836c0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x1128c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:44:33.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.379+0000 7ff3920836c0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x100c3d0 con 0x108f8f0 2024-04-23T01:44:33.377 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.379+0000 7ff38a39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x1128c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:44:33.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.379+0000 7ff38a39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x1128c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53976/0 (socket says 172.21.15.37:53976) 2024-04-23T01:44:33.378 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.379+0000 7ff38a39a640 1 -- 172.21.15.37:0/1269622492 learned_addr learned my addr 172.21.15.37:0/1269622492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:44:33.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.379+0000 7ff38a39a640 1 -- 172.21.15.37:0/1269622492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf9fe30 con 0x108f8f0 2024-04-23T01:44:33.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.380+0000 7ff38a39a640 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x1128c60 crc :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:44:33.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.380+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff374038a40 con 0x108f8f0 2024-04-23T01:44:33.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.380+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff374038ba0 con 0x108f8f0 2024-04-23T01:44:33.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.380+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf9f890 con 0x108f8f0 2024-04-23T01:44:33.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.380+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff374038e40 con 0x108f8f0 2024-04-23T01:44:33.379 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.380+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1128710 con 0x108f8f0 2024-04-23T01:44:33.380 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.381+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff374039400 con 0x108f8f0 2024-04-23T01:44:33.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.382+0000 7ff37b7fe640 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff368037210 0x7ff368039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:44:33.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.382+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(235..235 src has 175..235) ==== 2672+0+0 (crc 0 0 0) 0x7ff37403e040 con 0x108f8f0 2024-04-23T01:44:33.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.382+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0xfc86a0 con 0x108f8f0 2024-04-23T01:44:33.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.382+0000 7ff389b99640 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff368037210 0x7ff368039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:44:33.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.382+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7ff374033850 con 0x108f8f0 2024-04-23T01:44:33.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.383+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x10147b0 con 0x108f8f0 2024-04-23T01:44:33.381 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:33.383+0000 7ff389b99640 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff368037210 0x7ff368039720 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:44:34.326 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:34.328+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7ff374033460 con 0x108f8f0 2024-04-23T01:44:34.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:34.328+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7ff36803bb90 con 0x108f8f0 2024-04-23T01:44:34.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:34.328+0000 7ff37b7fe640 1 -- 172.21.15.37:0/1269622492 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(236..236 src has 175..236) ==== 651+0+0 (crc 0 0 0) 0x7ff374031040 con 0x108f8f0 2024-04-23T01:44:34.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:34.329+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1269622492 >> v2:172.21.15.191:6808/1018833307 conn(0x1090240 0x11da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:44:34.327 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:34.329+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x112b3e0 con 0x1090240 2024-04-23T01:44:34.330 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:34.332+0000 7ff38ab9b640 1 --2- 172.21.15.37:0/1269622492 >> v2:172.21.15.191:6808/1018833307 conn(0x1090240 0x11da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:44:34.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:34.518+0000 7ff38ab9b640 1 --2- 172.21.15.37:0/1269622492 >> v2:172.21.15.191:6808/1018833307 conn(0x1090240 0x11da8d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:44:35.652 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-04-23T01:44:35.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.653+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.653+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11d55b0 con 0x1090240 2024-04-23T01:44:35.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.653+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11d5e00 con 0x1090240 2024-04-23T01:44:35.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.660+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.658 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.660+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.658 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncReadCallback (7 ms) 2024-04-23T01:44:35.659 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-04-23T01:44:35.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.660+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11d61b0 con 0x1090240 2024-04-23T01:44:35.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.660+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11dae10 con 0x1090240 2024-04-23T01:44:35.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.666+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.664 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.666+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.665 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncReadFuture (6 ms) 2024-04-23T01:44:35.665 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-04-23T01:44:35.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.666+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x112bba0 con 0x1090240 2024-04-23T01:44:35.665 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.666+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x121bcb0 con 0x1090240 2024-04-23T01:44:35.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.671+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.670 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.672+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.671 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncReadYield (6 ms) 2024-04-23T01:44:35.671 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-04-23T01:44:35.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.672+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x11d5a80 con 0x1090240 2024-04-23T01:44:35.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.683+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.681 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncWriteCallback (11 ms) 2024-04-23T01:44:35.682 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-04-23T01:44:35.682 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.683+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x11d5a80 con 0x1090240 2024-04-23T01:44:35.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.694+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.692 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncWriteFuture (11 ms) 2024-04-23T01:44:35.693 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-04-23T01:44:35.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.694+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x11fe9c0 con 0x1090240 2024-04-23T01:44:35.702 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.704+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.702 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncWriteYield (10 ms) 2024-04-23T01:44:35.703 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-04-23T01:44:35.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.704+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11db620 con 0x1090240 2024-04-23T01:44:35.703 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.704+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11dbf80 con 0x1090240 2024-04-23T01:44:35.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.710+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.709 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.710+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.709 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (6 ms) 2024-04-23T01:44:35.709 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-04-23T01:44:35.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.710+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11dbad0 con 0x1090240 2024-04-23T01:44:35.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.710+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11ff070 con 0x1090240 2024-04-23T01:44:35.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.717+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.717+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.715 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (7 ms) 2024-04-23T01:44:35.715 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-04-23T01:44:35.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.717+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11fe350 con 0x1090240 2024-04-23T01:44:35.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.717+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x11ff070 con 0x1090240 2024-04-23T01:44:35.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.722+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.723+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.721 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2024-04-23T01:44:35.722 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-04-23T01:44:35.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.723+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x11db2c0 con 0x1090240 2024-04-23T01:44:35.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.733+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.732 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (10 ms) 2024-04-23T01:44:35.732 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-04-23T01:44:35.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.733+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x11db2c0 con 0x1090240 2024-04-23T01:44:35.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.744+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.743 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (11 ms) 2024-04-23T01:44:35.743 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-04-23T01:44:35.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.744+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x11db2c0 con 0x1090240 2024-04-23T01:44:35.753 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff38ab9b640 1 -- 172.21.15.37:0/1269622492 <== osd.3 v2:172.21.15.191:6808/1018833307 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff37c00a430 con 0x1090240 2024-04-23T01:44:35.753 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (11 ms) 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 >> v2:172.21.15.191:6808/1018833307 conn(0x1090240 msgr2=0x11da8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1269622492 >> v2:172.21.15.191:6808/1018833307 conn(0x1090240 0x11da8d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff368037210 msgr2=0x7ff368039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff368037210 0x7ff368039720 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 msgr2=0x1128c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x1128c60 crc :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 shutdown_connections 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1269622492 >> v2:172.21.15.191:6808/1018833307 conn(0x1090240 0x11da8d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff368037210 0x7ff368039720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 --2- 172.21.15.37:0/1269622492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x108f8f0 0x1128c60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 >> 172.21.15.37:0/1269622492 conn(0xfc5960 msgr2=0x10adb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:44:35.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 shutdown_connections 2024-04-23T01:44:35.756 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.755+0000 7ff3920836c0 1 -- 172.21.15.37:0/1269622492 wait complete. 2024-04-23T01:44:35.756 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 12 tests from AsioRados (102 ms total) 2024-04-23T01:44:35.756 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:35.756 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:44:35.756 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 12 tests from 1 test suite ran. (2387 ms total) 2024-04-23T01:44:35.756 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 12 tests. 2024-04-23T01:44:35.757 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:44:35.757 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:44:35.757 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_list 2024-04-23T01:44:35.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.787+0000 7fe0378319c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:35.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.787+0000 7fe0378319c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:35.786 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:35.787+0000 7fe0378319c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:35.786 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 11 tests from 3 test suites. 2024-04-23T01:44:35.786 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:44:35.786 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from LibRadosList 2024-04-23T01:44:37.340 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosList.ListObjects 2024-04-23T01:44:37.950 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosList.ListObjects (610 ms) 2024-04-23T01:44:37.950 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-04-23T01:44:38.133 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (182 ms) 2024-04-23T01:44:38.133 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-04-23T01:44:38.214 INFO:tasks.workunit.client.0.smithi037.stdout:myset foo1,foo2,foo3 2024-04-23T01:44:38.297 INFO:tasks.workunit.client.0.smithi037.stdout:foo1 2024-04-23T01:44:38.297 INFO:tasks.workunit.client.0.smithi037.stdout:foo2 2024-04-23T01:44:38.297 INFO:tasks.workunit.client.0.smithi037.stdout:foo3 2024-04-23T01:44:38.297 INFO:tasks.workunit.client.0.smithi037.stdout:myset foo1,foo4,foo5 2024-04-23T01:44:38.438 INFO:tasks.workunit.client.0.smithi037.stdout:foo4 2024-04-23T01:44:38.439 INFO:tasks.workunit.client.0.smithi037.stdout:foo5 2024-04-23T01:44:38.439 INFO:tasks.workunit.client.0.smithi037.stdout:foo1 2024-04-23T01:44:38.439 INFO:tasks.workunit.client.0.smithi037.stdout:myset foo6,foo7 2024-04-23T01:44:38.521 INFO:tasks.workunit.client.0.smithi037.stdout:foo7 2024-04-23T01:44:38.521 INFO:tasks.workunit.client.0.smithi037.stdout:foo6 2024-04-23T01:44:38.521 INFO:tasks.workunit.client.0.smithi037.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout:ns1:foo4 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout:ns1:foo5 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout:ns2:foo7 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout:ns2:foo6 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout:ns1:foo1 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout::foo1 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout::foo2 2024-04-23T01:44:38.602 INFO:tasks.workunit.client.0.smithi037.stdout::foo3 2024-04-23T01:44:38.758 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosList.ListObjectsNS (626 ms) 2024-04-23T01:44:38.758 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:1 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:10 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:13 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:7 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:14 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:0 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:15 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:11 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:5 0 2024-04-23T01:44:39.090 INFO:tasks.workunit.client.0.smithi037.stdout:8 0 2024-04-23T01:44:39.091 INFO:tasks.workunit.client.0.smithi037.stdout:6 0 2024-04-23T01:44:39.091 INFO:tasks.workunit.client.0.smithi037.stdout:3 0 2024-04-23T01:44:39.091 INFO:tasks.workunit.client.0.smithi037.stdout:4 0 2024-04-23T01:44:39.091 INFO:tasks.workunit.client.0.smithi037.stdout:12 0 2024-04-23T01:44:39.091 INFO:tasks.workunit.client.0.smithi037.stdout:9 0 2024-04-23T01:44:39.091 INFO:tasks.workunit.client.0.smithi037.stdout:2 0 2024-04-23T01:44:39.171 INFO:tasks.workunit.client.0.smithi037.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-23T01:44:39.399 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosList.ListObjectsStart (641 ms) 2024-04-23T01:44:39.399 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-04-23T01:44:39.551 INFO:tasks.workunit.client.0.smithi037.stdout:x cursor=MIN 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-04-23T01:44:39.633 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-04-23T01:44:39.634 INFO:tasks.workunit.client.0.smithi037.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-04-23T01:44:39.716 INFO:tasks.workunit.client.0.smithi037.stdout:FIRST> seek to MIN oid=1 2024-04-23T01:44:39.799 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-04-23T01:44:39.799 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:02547ec2:::1:head 2024-04-23T01:44:39.882 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:02547ec2:::1:head -> 1 2024-04-23T01:44:39.882 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-04-23T01:44:39.882 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:52ea6a34:::10:head 2024-04-23T01:44:39.941 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:52ea6a34:::10:head -> 10 2024-04-23T01:44:39.941 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-04-23T01:44:39.941 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:566253c9:::13:head 2024-04-23T01:44:39.999 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:566253c9:::13:head -> 13 2024-04-23T01:44:39.999 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-04-23T01:44:39.999 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:5c6b0b28:::7:head 2024-04-23T01:44:40.056 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:5c6b0b28:::7:head -> 7 2024-04-23T01:44:40.056 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-04-23T01:44:40.056 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:62a1935d:::14:head 2024-04-23T01:44:40.110 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:62a1935d:::14:head -> 14 2024-04-23T01:44:40.111 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-04-23T01:44:40.111 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:6cac518f:::0:head 2024-04-23T01:44:40.161 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:6cac518f:::0:head -> 0 2024-04-23T01:44:40.161 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-04-23T01:44:40.161 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:863748b0:::15:head 2024-04-23T01:44:40.203 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:863748b0:::15:head -> 15 2024-04-23T01:44:40.203 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-04-23T01:44:40.203 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:89d3ae78:::11:head 2024-04-23T01:44:40.242 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:89d3ae78:::11:head -> 11 2024-04-23T01:44:40.243 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-04-23T01:44:40.243 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:b29083e3:::5:head 2024-04-23T01:44:40.268 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:b29083e3:::5:head -> 5 2024-04-23T01:44:40.268 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-04-23T01:44:40.269 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:bd63b0f1:::8:head 2024-04-23T01:44:40.292 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:bd63b0f1:::8:head -> 8 2024-04-23T01:44:40.292 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-04-23T01:44:40.293 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:c4fdafeb:::6:head 2024-04-23T01:44:40.314 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:c4fdafeb:::6:head -> 6 2024-04-23T01:44:40.314 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-04-23T01:44:40.314 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:cfc208b3:::3:head 2024-04-23T01:44:40.334 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:cfc208b3:::3:head -> 3 2024-04-23T01:44:40.334 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-04-23T01:44:40.334 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:d83876eb:::4:head 2024-04-23T01:44:40.347 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:d83876eb:::4:head -> 4 2024-04-23T01:44:40.348 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-04-23T01:44:40.348 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:de5d7c5f:::12:head 2024-04-23T01:44:40.362 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:de5d7c5f:::12:head -> 12 2024-04-23T01:44:40.362 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-04-23T01:44:40.362 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:e960b815:::9:head 2024-04-23T01:44:40.370 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:e960b815:::9:head -> 9 2024-04-23T01:44:40.370 INFO:tasks.workunit.client.0.smithi037.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-04-23T01:44:40.370 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:f905c69b:::2:head 2024-04-23T01:44:40.372 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:f905c69b:::2:head -> 2 2024-04-23T01:44:40.373 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:02547ec2:::1:head 2024-04-23T01:44:40.373 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-04-23T01:44:40.457 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:02547ec2:::1:head -> 1 2024-04-23T01:44:40.457 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=1 expected=1 2024-04-23T01:44:40.457 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:cfc208b3:::3:head 2024-04-23T01:44:40.457 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-04-23T01:44:40.477 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:cfc208b3:::3:head -> 3 2024-04-23T01:44:40.477 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=3 expected=3 2024-04-23T01:44:40.477 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:c4fdafeb:::6:head 2024-04-23T01:44:40.477 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-04-23T01:44:40.499 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:c4fdafeb:::6:head -> 6 2024-04-23T01:44:40.499 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=6 expected=6 2024-04-23T01:44:40.499 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:bd63b0f1:::8:head 2024-04-23T01:44:40.499 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-04-23T01:44:40.524 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:bd63b0f1:::8:head -> 8 2024-04-23T01:44:40.524 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=8 expected=8 2024-04-23T01:44:40.524 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:e960b815:::9:head 2024-04-23T01:44:40.524 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-04-23T01:44:40.532 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:e960b815:::9:head -> 9 2024-04-23T01:44:40.532 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=9 expected=9 2024-04-23T01:44:40.532 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:de5d7c5f:::12:head 2024-04-23T01:44:40.532 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-04-23T01:44:40.545 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:de5d7c5f:::12:head -> 12 2024-04-23T01:44:40.545 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=12 expected=12 2024-04-23T01:44:40.545 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:d83876eb:::4:head 2024-04-23T01:44:40.546 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-04-23T01:44:40.559 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:d83876eb:::4:head -> 4 2024-04-23T01:44:40.559 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=4 expected=4 2024-04-23T01:44:40.559 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:566253c9:::13:head 2024-04-23T01:44:40.559 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-04-23T01:44:40.618 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:566253c9:::13:head -> 13 2024-04-23T01:44:40.618 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=13 expected=13 2024-04-23T01:44:40.619 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:52ea6a34:::10:head 2024-04-23T01:44:40.619 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-04-23T01:44:40.681 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:52ea6a34:::10:head -> 10 2024-04-23T01:44:40.681 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=10 expected=10 2024-04-23T01:44:40.681 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:f905c69b:::2:head 2024-04-23T01:44:40.681 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-04-23T01:44:40.683 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:f905c69b:::2:head -> 2 2024-04-23T01:44:40.683 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=2 expected=2 2024-04-23T01:44:40.684 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:b29083e3:::5:head 2024-04-23T01:44:40.684 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-04-23T01:44:40.710 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:b29083e3:::5:head -> 5 2024-04-23T01:44:40.710 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=5 expected=5 2024-04-23T01:44:40.710 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:89d3ae78:::11:head 2024-04-23T01:44:40.710 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-04-23T01:44:40.753 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:89d3ae78:::11:head -> 11 2024-04-23T01:44:40.753 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=11 expected=11 2024-04-23T01:44:40.753 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:863748b0:::15:head 2024-04-23T01:44:40.753 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-04-23T01:44:40.796 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:863748b0:::15:head -> 15 2024-04-23T01:44:40.796 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=15 expected=15 2024-04-23T01:44:40.796 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:6cac518f:::0:head 2024-04-23T01:44:40.796 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-04-23T01:44:40.846 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:6cac518f:::0:head -> 0 2024-04-23T01:44:40.846 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=0 expected=0 2024-04-23T01:44:40.846 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:62a1935d:::14:head 2024-04-23T01:44:40.846 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-04-23T01:44:40.900 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:62a1935d:::14:head -> 14 2024-04-23T01:44:40.900 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=14 expected=14 2024-04-23T01:44:40.900 INFO:tasks.workunit.client.0.smithi037.stdout:: seek to 76:5c6b0b28:::7:head 2024-04-23T01:44:40.900 INFO:tasks.workunit.client.0.smithi037.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-04-23T01:44:41.061 INFO:tasks.workunit.client.0.smithi037.stdout:> 76:5c6b0b28:::7:head -> 7 2024-04-23T01:44:41.061 INFO:tasks.workunit.client.0.smithi037.stdout:: entry=7 expected=7 2024-04-23T01:44:41.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosList.ListObjectsCursor (1890 ms) 2024-04-23T01:44:41.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-04-23T01:44:41.805 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosList.EnumerateObjects (516 ms) 2024-04-23T01:44:41.805 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-04-23T01:44:41.990 INFO:tasks.workunit.client.0.smithi037.stdout:split 0/5 -> MIN 76:33333333::::head 2024-04-23T01:44:42.009 INFO:tasks.workunit.client.0.smithi037.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-04-23T01:44:42.028 INFO:tasks.workunit.client.0.smithi037.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-04-23T01:44:42.051 INFO:tasks.workunit.client.0.smithi037.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-04-23T01:44:42.068 INFO:tasks.workunit.client.0.smithi037.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-04-23T01:44:42.374 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (568 ms) 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from LibRadosList (5033 ms total) 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosListEC 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:70: Skipped 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:84: Skipped 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:96: Skipped 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-04-23T01:44:43.360 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:84: Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:96: Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:84: Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:96: Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:78: Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:43.361 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosListNP 2024-04-23T01:44:43.362 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-04-23T01:44:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosListNP.ListObjectsError (3016 ms) 2024-04-23T01:44:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosListNP (3016 ms total) 2024-04-23T01:44:46.378 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:44:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 11 tests from 3 test suites ran. (10589 ms total) 2024-04-23T01:44:46.378 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 8 tests. 2024-04-23T01:44:46.379 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 3 tests, listed below: 2024-04-23T01:44:46.379 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-04-23T01:44:46.379 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-04-23T01:44:46.379 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-04-23T01:44:46.379 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:44:46.379 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:44:46.379 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_lock 2024-04-23T01:44:46.399 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:44:46.399 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-23T01:44:46.399 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:44:46.399 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLock 2024-04-23T01:44:48.259 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-04-23T01:44:48.645 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.LockExclusive (387 ms) 2024-04-23T01:44:48.645 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.LockShared 2024-04-23T01:44:48.666 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.LockShared (21 ms) 2024-04-23T01:44:48.666 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-04-23T01:44:49.707 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1041 ms) 2024-04-23T01:44:49.708 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-04-23T01:44:50.749 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.LockSharedDur (1041 ms) 2024-04-23T01:44:50.749 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-04-23T01:44:50.785 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.LockMayRenew (37 ms) 2024-04-23T01:44:50.785 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.Unlock 2024-04-23T01:44:50.829 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.Unlock (43 ms) 2024-04-23T01:44:50.829 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.ListLockers 2024-04-23T01:44:50.885 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.ListLockers (54 ms) 2024-04-23T01:44:50.885 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLock.BreakLock 2024-04-23T01:44:50.912 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLock.BreakLock (29 ms) 2024-04-23T01:44:51.387 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLock (2653 ms total) 2024-04-23T01:44:51.387 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:51.387 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLockEC 2024-04-23T01:44:51.387 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:168: Skipped 2024-04-23T01:44:51.387 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.387 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-04-23T01:44:51.388 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.389 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:44:51.390 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:176: Skipped 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 16 tests from 2 test suites ran. (4986 ms total) 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 8 tests. 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 8 tests, listed below: 2024-04-23T01:44:51.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:44:51.392 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:44:51.393 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_lock_pp 2024-04-23T01:44:51.410 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:44:51.410 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-23T01:44:51.410 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:44:51.410 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLockPP 2024-04-23T01:44:51.410 INFO:tasks.workunit.client.0.smithi037.stdout:seed 31734 2024-04-23T01:44:53.257 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-04-23T01:44:53.542 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (285 ms) 2024-04-23T01:44:53.542 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-04-23T01:44:53.689 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.LockSharedPP (148 ms) 2024-04-23T01:44:53.689 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-04-23T01:44:54.720 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1030 ms) 2024-04-23T01:44:54.720 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-04-23T01:44:55.759 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1040 ms) 2024-04-23T01:44:55.760 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-04-23T01:44:55.797 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (37 ms) 2024-04-23T01:44:55.797 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-04-23T01:44:55.842 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.UnlockPP (46 ms) 2024-04-23T01:44:55.842 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-04-23T01:44:55.890 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.ListLockersPP (48 ms) 2024-04-23T01:44:55.890 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-04-23T01:44:55.923 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosLockPP.BreakLockPP (33 ms) 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLockPP (2667 ms total) 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLockECPP 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.407 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.408 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-04-23T01:44:56.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:44:56.410 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 16 tests from 2 test suites ran. (4997 ms total) 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 8 tests. 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 8 tests, listed below: 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-23T01:44:56.411 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-04-23T01:44:56.412 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-04-23T01:44:56.412 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-04-23T01:44:56.412 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-04-23T01:44:56.412 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-04-23T01:44:56.412 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:44:56.412 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:44:56.412 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_misc 2024-04-23T01:44:56.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:56.445+0000 7fdd3ce656c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:56.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:56.445+0000 7fdd3ce656c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:56.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:56.445+0000 7fdd3ce656c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:44:56.444 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 12 tests from 4 test suites. 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscVersion 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-04-23T01:44:56.445 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-04-23T01:44:56.479 INFO:tasks.workunit.client.0.smithi037.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-23T01:44:56.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:56.480+0000 7fdd3ce656c0 -1 failed for service _ceph-mon._tcp 2024-04-23T01:44:56.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:44:56.480+0000 7fdd3ce656c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-04-23T01:44:56.479 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (35 ms) 2024-04-23T01:44:56.479 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-04-23T01:44:58.486 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2007 ms) 2024-04-23T01:44:58.486 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (2042 ms total) 2024-04-23T01:44:58.486 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:44:58.486 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscPool 2024-04-23T01:44:58.486 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-04-23T01:45:01.415 INFO:tasks.workunit.client.0.smithi037.stdout:started 0x7fdd0c005d20 2024-04-23T01:45:02.415 INFO:tasks.workunit.client.0.smithi037.stdout:started 0x7fdd1c005de0 2024-04-23T01:45:02.415 INFO:tasks.workunit.client.0.smithi037.stdout: started 2 aios 2024-04-23T01:45:02.415 INFO:tasks.workunit.client.0.smithi037.stdout:waiting 0x7fdd0c005d20 2024-04-23T01:45:02.415 INFO:tasks.workunit.client.0.smithi037.stdout:waiting 0x7fdd1c005de0 2024-04-23T01:45:02.418 INFO:tasks.workunit.client.0.smithi037.stdout:done. 2024-04-23T01:45:04.435 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5950 ms) 2024-04-23T01:45:04.435 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscPool (5950 ms total) 2024-04-23T01:45:04.435 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:45:04.436 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosMisc 2024-04-23T01:45:06.447 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-04-23T01:45:06.447 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-04-23T01:45:06.447 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.Exec 2024-04-23T01:45:06.797 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.Exec (350 ms) 2024-04-23T01:45:06.797 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-04-23T01:45:06.895 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.WriteSame (98 ms) 2024-04-23T01:45:06.926 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-04-23T01:45:06.927 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.CmpExt (22 ms) 2024-04-23T01:45:06.927 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.Applications 2024-04-23T01:45:11.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.Applications (4559 ms) 2024-04-23T01:45:11.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-04-23T01:45:11.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-04-23T01:45:11.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-04-23T01:45:11.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-04-23T01:45:11.477 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-04-23T01:45:39.540 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMisc.ShutdownRace (28063 ms) 2024-04-23T01:45:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 8 tests from LibRadosMisc (33093 ms total) 2024-04-23T01:45:40.281 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:45:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:45:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 12 tests from 4 test suites ran. (43837 ms total) 2024-04-23T01:45:40.281 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 12 tests. 2024-04-23T01:45:40.293 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:45:40.293 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:45:40.293 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_misc_pp 2024-04-23T01:45:40.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:45:40.329+0000 7fcfdb635840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:45:40.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:45:40.329+0000 7fcfdb635840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:45:40.328 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:45:40.329+0000 7fcfdb635840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:45:40.328 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 31 tests from 7 test suites. 2024-04-23T01:45:40.328 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:45:40.328 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscVersion 2024-04-23T01:45:40.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-04-23T01:45:40.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-04-23T01:45:40.329 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-23T01:45:40.329 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:45:40.329 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 22 tests from LibRadosMiscPP 2024-04-23T01:45:40.329 INFO:tasks.workunit.client.0.smithi037.stdout:seed 93399 2024-04-23T01:45:42.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-04-23T01:45:42.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-04-23T01:45:42.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-04-23T01:45:42.773 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.LongNamePP (476 ms) 2024-04-23T01:45:42.774 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-04-23T01:45:42.774 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/misc_cxx.cc:53: Skipped 2024-04-23T01:45:42.774 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:45:42.774 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-04-23T01:45:42.774 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-04-23T01:45:42.832 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (59 ms) 2024-04-23T01:45:42.832 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-04-23T01:45:42.876 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (44 ms) 2024-04-23T01:45:42.876 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-04-23T01:45:42.892 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.ExecPP (17 ms) 2024-04-23T01:45:42.892 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-04-23T01:45:42.906 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (14 ms) 2024-04-23T01:45:42.906 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-04-23T01:45:42.932 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.Operate1PP (25 ms) 2024-04-23T01:45:42.932 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-04-23T01:45:42.947 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.Operate2PP (15 ms) 2024-04-23T01:45:42.947 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-04-23T01:45:42.994 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (47 ms) 2024-04-23T01:45:42.994 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-04-23T01:45:43.009 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (15 ms) 2024-04-23T01:45:43.009 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-04-23T01:45:43.031 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (23 ms) 2024-04-23T01:45:43.032 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-04-23T01:45:43.076 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (44 ms) 2024-04-23T01:45:43.076 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-04-23T01:45:43.086 INFO:tasks.workunit.client.0.smithi037.stdout:osd_max_attr_size = 0 2024-04-23T01:45:43.086 INFO:tasks.workunit.client.0.smithi037.stdout:osd_max_attr_size == 0; skipping test 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (16379 ms) 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/misc_cxx.cc:387: Skipped 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/misc_cxx.cc:550: Skipped 2024-04-23T01:45:59.456 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:45:59.457 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-04-23T01:45:59.457 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-04-23T01:45:59.492 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (37 ms) 2024-04-23T01:45:59.492 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-04-23T01:45:59.512 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (20 ms) 2024-04-23T01:45:59.512 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-04-23T01:46:04.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.Applications (4814 ms) 2024-04-23T01:46:04.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-04-23T01:46:04.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-04-23T01:46:04.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-04-23T01:46:04.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-04-23T01:46:04.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-04-23T01:46:04.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-04-23T01:46:05.328 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 22 tests from LibRadosMiscPP (22030 ms total) 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/misc_cxx.cc:477: Skipped 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/misc_cxx.cc:499: Skipped 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/misc_cxx.cc:505: Skipped 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/misc_cxx.cc:492: Skipped 2024-04-23T01:46:05.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:05.330 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-04-23T01:46:05.330 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:05.330 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-04-23T01:46:07.269 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-04-23T01:46:07.664 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosChecksum/0.Subset (395 ms) 2024-04-23T01:46:07.665 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-04-23T01:46:07.682 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosChecksum/0.Chunked (18 ms) 2024-04-23T01:46:08.343 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosChecksum/0 (413 ms total) 2024-04-23T01:46:08.343 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:08.343 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-04-23T01:46:10.353 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-04-23T01:46:10.737 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosChecksum/1.Subset (384 ms) 2024-04-23T01:46:10.737 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-04-23T01:46:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosChecksum/1.Chunked (17 ms) 2024-04-23T01:46:11.355 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosChecksum/1 (401 ms total) 2024-04-23T01:46:11.356 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:11.356 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-04-23T01:46:13.364 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-04-23T01:46:13.755 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosChecksum/2.Subset (391 ms) 2024-04-23T01:46:13.755 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-04-23T01:46:13.778 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosChecksum/2.Chunked (23 ms) 2024-04-23T01:46:14.370 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosChecksum/2 (414 ms total) 2024-04-23T01:46:14.370 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:14.370 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscECPP 2024-04-23T01:46:14.370 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:46:14.370 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:14.370 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 31 tests from 7 test suites ran. (34042 ms total) 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 26 tests. 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 5 tests, listed below: 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-04-23T01:46:14.371 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-04-23T01:46:14.372 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-04-23T01:46:14.372 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-23T01:46:14.372 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-04-23T01:46:14.373 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:46:14.373 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:46:14.373 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_tier_pp 2024-04-23T01:46:14.407 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:46:14.408+0000 7f60f1a349c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:46:14.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:46:14.408+0000 7f60f1a349c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:46:14.408 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:46:14.409+0000 7f60f1a349c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:46:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 77 tests from 4 test suites. 2024-04-23T01:46:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:46:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosTierPP 2024-04-23T01:46:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:seed 93471 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:287: Skipped 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:2182: Skipped 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-04-23T01:46:16.380 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:2561: Skipped 2024-04-23T01:46:16.381 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:16.381 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-04-23T01:46:17.271 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-04-23T01:46:17.272 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:17.272 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-04-23T01:46:19.285 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-04-23T01:46:19.286 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-04-23T01:46:19.287 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-04-23T01:46:19.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-04-23T01:46:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-23T01:46:19.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (1 ms) 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-23T01:46:19.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-23T01:46:19.300 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.301 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-23T01:46:19.303 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.304 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:19.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-04-23T01:46:20.287 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosTierECPP 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-04-23T01:46:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:46:20.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6267: Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.292 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (1 ms) 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.293 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-23T01:46:20.294 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.296 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-04-23T01:46:20.297 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.299 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/tier_cxx.cc:6272: Skipped 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 77 tests from 4 test suites ran. (5876 ms total) 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 0 tests. 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 77 tests, listed below: 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-04-23T01:46:20.300 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-04-23T01:46:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-23T01:46:20.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-23T01:46:20.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-23T01:46:20.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-23T01:46:20.306 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-04-23T01:46:20.307 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-23T01:46:20.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-23T01:46:20.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-23T01:46:20.308 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-23T01:46:20.308 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:46:20.308 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:46:20.308 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_pool 2024-04-23T01:46:20.309 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:46:20.309 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 9 tests from 1 test suite. 2024-04-23T01:46:20.309 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:46:20.309 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from LibRadosPools 2024-04-23T01:46:20.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolList 2024-04-23T01:46:23.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolList (2990 ms) 2024-04-23T01:46:23.298 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-04-23T01:46:26.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolLookup (3031 ms) 2024-04-23T01:46:26.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-04-23T01:46:29.284 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolLookup2 (2955 ms) 2024-04-23T01:46:29.284 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-04-23T01:46:32.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3019 ms) 2024-04-23T01:46:32.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-04-23T01:46:35.313 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3011 ms) 2024-04-23T01:46:35.313 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-04-23T01:46:40.294 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolDelete (4981 ms) 2024-04-23T01:46:40.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-04-23T01:46:45.319 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolCreateDelete (5025 ms) 2024-04-23T01:46:45.320 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (4975 ms) 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/pool.cc:139: Skipped 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 9 tests from LibRadosPools (29987 ms total) 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 9 tests from 1 test suite ran. (29987 ms total) 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 8 tests. 2024-04-23T01:46:50.295 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-23T01:46:50.296 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-04-23T01:46:50.297 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:46:50.297 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:46:50.297 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_snapshots 2024-04-23T01:46:50.320 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:46:50.320 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 13 tests from 4 test suites. 2024-04-23T01:46:50.320 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:46:50.321 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosSnapshots 2024-04-23T01:46:52.305 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-04-23T01:46:54.313 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshots.SnapList (2007 ms) 2024-04-23T01:46:54.313 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-04-23T01:46:56.318 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2005 ms) 2024-04-23T01:46:56.318 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-04-23T01:46:58.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshots.Rollback (2014 ms) 2024-04-23T01:46:58.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-04-23T01:47:00.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2000 ms) 2024-04-23T01:47:01.336 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosSnapshots (8027 ms total) 2024-04-23T01:47:01.336 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:47:01.336 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-04-23T01:47:03.356 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-04-23T01:47:07.406 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4050 ms) 2024-04-23T01:47:07.406 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-04-23T01:47:11.701 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4294 ms) 2024-04-23T01:47:11.701 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-04-23T01:47:16.537 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4836 ms) 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13180 ms total) 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:168: Skipped 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:47:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:47:17.289 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:176: Skipped 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-04-23T01:47:17.290 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:168: Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:176: Skipped 2024-04-23T01:47:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 13 tests from 4 test suites ran. (26966 ms total) 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 7 tests. 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 6 tests, listed below: 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-23T01:47:17.292 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-23T01:47:17.293 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:47:17.293 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:47:17.293 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_snapshots_pp 2024-04-23T01:47:17.317 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:47:17.317 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 21 tests from 5 test suites. 2024-04-23T01:47:17.317 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:47:17.317 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-04-23T01:47:17.317 INFO:tasks.workunit.client.0.smithi037.stdout:seed 93728 2024-04-23T01:47:19.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-04-23T01:47:21.302 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2013 ms) 2024-04-23T01:47:21.303 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-04-23T01:47:23.318 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2013 ms) 2024-04-23T01:47:23.318 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-04-23T01:47:25.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2010 ms) 2024-04-23T01:47:25.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-04-23T01:47:27.289 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1964 ms) 2024-04-23T01:47:27.290 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-04-23T01:47:31.344 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4055 ms) 2024-04-23T01:47:32.347 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from LibRadosSnapshotsPP (12055 ms total) 2024-04-23T01:47:32.347 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:47:32.347 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-04-23T01:47:34.371 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-04-23T01:47:38.489 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4118 ms) 2024-04-23T01:47:38.489 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-23T01:47:38.489 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/snapshots_cxx.cc:156: Skipped 2024-04-23T01:47:38.489 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:38.489 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2024-04-23T01:47:38.489 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-23T01:47:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/snapshots_cxx.cc:242: Skipped 2024-04-23T01:47:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:47:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2024-04-23T01:47:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-04-23T01:47:42.406 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3918 ms) 2024-04-23T01:47:42.406 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-04-23T01:47:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2158 ms) 2024-04-23T01:47:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-23T01:47:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-04-23T01:47:44.565 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:47:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-04-23T01:47:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-04-23T01:47:46.424 INFO:tasks.workunit.client.0.smithi037.stdout:deleting snap 9 in pool LibRadosSnapshotsSelfManagedPP_smithi037-93728-7 2024-04-23T01:47:47.291 INFO:tasks.workunit.client.0.smithi037.stdout:waiting for snaps to purge 2024-04-23T01:48:02.309 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17744 ms) 2024-04-23T01:48:02.456 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (27938 ms total) 2024-04-23T01:48:02.456 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:02.456 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-04-23T01:48:02.456 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-04-23T01:48:02.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (6 ms) 2024-04-23T01:48:02.462 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-04-23T01:48:07.326 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4862 ms) 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (4868 ms total) 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-23T01:48:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:07.328 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:07.329 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (1 ms) 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (1 ms total) 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 21 tests from 5 test suites ran. (50007 ms total) 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 11 tests. 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 10 tests, listed below: 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-23T01:48:07.331 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-04-23T01:48:07.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-23T01:48:07.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-23T01:48:07.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-23T01:48:07.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-23T01:48:07.332 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:48:07.332 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:48:07.332 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_stat 2024-04-23T01:48:07.343 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:48:07.343 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 9 tests from 2 test suites. 2024-04-23T01:48:07.343 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:48:07.343 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from LibRadosStat 2024-04-23T01:48:09.312 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStat.Stat 2024-04-23T01:48:09.736 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStat.Stat (424 ms) 2024-04-23T01:48:09.737 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStat.Stat2 2024-04-23T01:48:09.764 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStat.Stat2 (27 ms) 2024-04-23T01:48:09.764 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStat.StatNS 2024-04-23T01:48:09.819 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStat.StatNS (56 ms) 2024-04-23T01:48:09.820 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-04-23T01:48:09.820 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-04-23T01:48:09.820 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStat.PoolStat 2024-04-23T01:48:09.831 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStat.PoolStat (11 ms) 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from LibRadosStat (518 ms total) 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosStatEC 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:168: Skipped 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatEC.Stat 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:48:10.321 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-04-23T01:48:10.322 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:176: Skipped 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 9 tests from 2 test suites ran. (2976 ms total) 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 5 tests. 2024-04-23T01:48:10.323 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 4 tests, listed below: 2024-04-23T01:48:10.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-04-23T01:48:10.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-04-23T01:48:10.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-04-23T01:48:10.324 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-04-23T01:48:10.324 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:48:10.324 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:48:10.324 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_stat_pp 2024-04-23T01:48:10.342 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:48:10.342 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 9 tests from 2 test suites. 2024-04-23T01:48:10.342 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:48:10.342 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from LibRadosStatPP 2024-04-23T01:48:10.342 INFO:tasks.workunit.client.0.smithi037.stdout:seed 93862 2024-04-23T01:48:12.330 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-04-23T01:48:12.720 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStatPP.StatPP (390 ms) 2024-04-23T01:48:12.720 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-04-23T01:48:12.744 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (24 ms) 2024-04-23T01:48:12.744 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-04-23T01:48:12.744 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-04-23T01:48:12.744 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-04-23T01:48:12.755 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStatPP.PoolStatPP (11 ms) 2024-04-23T01:48:12.755 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-04-23T01:48:12.808 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosStatPP.StatPPNS (53 ms) 2024-04-23T01:48:13.332 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from LibRadosStatPP (478 ms total) 2024-04-23T01:48:13.332 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:13.332 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosStatECPP 2024-04-23T01:48:13.332 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:48:13.332 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.332 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-04-23T01:48:13.333 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-04-23T01:48:13.334 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 9 tests from 2 test suites ran. (2989 ms total) 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 5 tests. 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 4 tests, listed below: 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-04-23T01:48:13.335 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:48:13.336 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:48:13.336 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_watch_notify 2024-04-23T01:48:13.356 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:48:13.356 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 11 tests from 2 test suites. 2024-04-23T01:48:13.356 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:48:13.356 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-04-23T01:48:15.341 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-04-23T01:48:15.728 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify_test_cb 2024-04-23T01:48:15.777 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (436 ms) 2024-04-23T01:48:15.777 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-04-23T01:48:15.826 INFO:tasks.workunit.client.0.smithi037.stdout:waiting up to 300 for disconnect notification ... 2024-04-23T01:48:18.401 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_errcb cookie 21742368 err -107 2024-04-23T01:48:18.963 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3187 ms) 2024-04-23T01:48:18.964 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-04-23T01:48:18.996 INFO:tasks.workunit.client.0.smithi037.stdout:waiting up to 300 for disconnect notification ... 2024-04-23T01:48:23.402 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_errcb cookie 21753776 err -107 2024-04-23T01:48:24.004 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5040 ms) 2024-04-23T01:48:24.004 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-04-23T01:48:24.032 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049217 cookie 21758752 2024-04-23T01:48:24.051 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (47 ms) 2024-04-23T01:48:24.051 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-04-23T01:48:24.077 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049216 cookie 21773712 2024-04-23T01:48:24.096 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (45 ms) 2024-04-23T01:48:24.096 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-04-23T01:48:24.132 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049216 cookie 21773712 2024-04-23T01:48:24.152 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.AioNotify (56 ms) 2024-04-23T01:48:24.152 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-04-23T01:48:24.190 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049217 cookie 21773712 2024-04-23T01:48:24.190 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049217 cookie 21776896 2024-04-23T01:48:24.218 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (66 ms) 2024-04-23T01:48:24.218 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-04-23T01:48:24.244 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049218 cookie 21773712 2024-04-23T01:48:27.245 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049219 cookie 21773712 2024-04-23T01:48:27.267 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3050 ms) 2024-04-23T01:48:27.268 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-04-23T01:48:27.292 INFO:tasks.workunit.client.0.smithi037.stdout:waiting up to 1024 for osd to time us out ... 2024-04-23T01:48:31.301 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_errcb cookie 21773712 err -107 2024-04-23T01:48:32.322 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_cb from 15569 notify_id 1700807049219 cookie 21773712 2024-04-23T01:48:32.344 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5076 ms) 2024-04-23T01:48:32.344 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-04-23T01:48:32.382 INFO:tasks.workunit.client.0.smithi037.stdout:waiting up to 30 for disconnect notification ... 2024-04-23T01:48:33.404 INFO:tasks.workunit.client.0.smithi037.stdout:watch_notify2_test_errcb cookie 21773712 err -107 2024-04-23T01:48:34.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2047 ms) 2024-04-23T01:48:35.373 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 10 tests from LibRadosWatchNotify (19050 ms total) 2024-04-23T01:48:35.373 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:35.373 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-04-23T01:48:35.374 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:168: Skipped 2024-04-23T01:48:35.374 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.374 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-04-23T01:48:35.374 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:182: Skipped 2024-04-23T01:48:35.374 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.375 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:196: Skipped 2024-04-23T01:48:35.375 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-04-23T01:48:35.375 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/TestCase.cc:176: Skipped 2024-04-23T01:48:35.375 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.375 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-04-23T01:48:35.375 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:35.376 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:48:35.376 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 11 tests from 2 test suites ran. (22016 ms total) 2024-04-23T01:48:35.376 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 10 tests. 2024-04-23T01:48:35.376 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-23T01:48:35.376 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-04-23T01:48:35.377 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:48:35.377 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:48:35.378 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-04-23T01:48:35.397 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:48:35.397 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-23T01:48:35.397 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-23T01:48:35.398 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:35.399 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-04-23T01:48:37.380 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-04-23T01:48:37.737 INFO:tasks.workunit.client.0.smithi037.stdout:notify 2024-04-23T01:48:37.774 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (393 ms) 2024-04-23T01:48:37.774 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-04-23T01:48:37.831 INFO:tasks.workunit.client.0.smithi037.stdout:notify 2024-04-23T01:48:37.845 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (71 ms) 2024-04-23T01:48:37.845 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-04-23T01:48:37.877 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (32 ms) 2024-04-23T01:48:37.877 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-04-23T01:48:37.907 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (31 ms) 2024-04-23T01:48:37.908 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-04-23T01:48:37.935 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951105 notifier_gid 15572 2024-04-23T01:48:37.948 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (41 ms) 2024-04-23T01:48:37.949 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-04-23T01:48:37.977 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951109 notifier_gid 15572 2024-04-23T01:48:37.991 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (43 ms) 2024-04-23T01:48:37.992 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-04-23T01:48:38.019 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951105 notifier_gid 15572 2024-04-23T01:48:38.033 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (42 ms) 2024-04-23T01:48:38.033 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-04-23T01:48:38.061 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951106 notifier_gid 15572 2024-04-23T01:48:38.074 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (41 ms) 2024-04-23T01:48:38.074 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-04-23T01:48:38.102 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951107 notifier_gid 15572 2024-04-23T01:48:38.116 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (41 ms) 2024-04-23T01:48:38.116 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-04-23T01:48:38.143 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951108 notifier_gid 15572 2024-04-23T01:48:38.156 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (41 ms) 2024-04-23T01:48:38.157 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-04-23T01:48:38.180 INFO:tasks.workunit.client.0.smithi037.stdout: trying... 2024-04-23T01:48:38.184 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951110 notifier_gid 15572 2024-04-23T01:48:39.183 INFO:tasks.workunit.client.0.smithi037.stdout: timed out 2024-04-23T01:48:39.196 INFO:tasks.workunit.client.0.smithi037.stdout: flushing 2024-04-23T01:48:41.184 INFO:tasks.workunit.client.0.smithi037.stdout: flushed 2024-04-23T01:48:41.184 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3027 ms) 2024-04-23T01:48:41.184 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-04-23T01:48:41.215 INFO:tasks.workunit.client.0.smithi037.stdout: trying... 2024-04-23T01:48:41.219 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951111 notifier_gid 15572 2024-04-23T01:48:42.219 INFO:tasks.workunit.client.0.smithi037.stdout: timed out 2024-04-23T01:48:42.232 INFO:tasks.workunit.client.0.smithi037.stdout: flushing 2024-04-23T01:48:44.220 INFO:tasks.workunit.client.0.smithi037.stdout: flushed 2024-04-23T01:48:44.220 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3036 ms) 2024-04-23T01:48:44.220 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-04-23T01:48:44.245 INFO:tasks.workunit.client.0.smithi037.stdout:List watches 2024-04-23T01:48:44.246 INFO:tasks.workunit.client.0.smithi037.stdout:notify2 2024-04-23T01:48:44.249 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1713691951109 notifier_gid 15572 2024-04-23T01:48:47.256 INFO:tasks.workunit.client.0.smithi037.stdout:notify2 done 2024-04-23T01:48:47.256 INFO:tasks.workunit.client.0.smithi037.stdout:watch_check 2024-04-23T01:48:47.256 INFO:tasks.workunit.client.0.smithi037.stdout:unwatch2 2024-04-23T01:48:47.269 INFO:tasks.workunit.client.0.smithi037.stdout: flushing 2024-04-23T01:48:47.269 INFO:tasks.workunit.client.0.smithi037.stdout:done 2024-04-23T01:48:47.269 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3049 ms) 2024-04-23T01:48:47.269 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-04-23T01:48:47.299 INFO:tasks.workunit.client.0.smithi037.stdout:List watches 2024-04-23T01:48:47.300 INFO:tasks.workunit.client.0.smithi037.stdout:notify2 2024-04-23T01:48:47.305 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 24064080 notify_id 1726576852994 notifier_gid 15572 2024-04-23T01:48:50.312 INFO:tasks.workunit.client.0.smithi037.stdout:notify2 done 2024-04-23T01:48:50.312 INFO:tasks.workunit.client.0.smithi037.stdout:watch_check 2024-04-23T01:48:50.312 INFO:tasks.workunit.client.0.smithi037.stdout:unwatch2 2024-04-23T01:48:50.325 INFO:tasks.workunit.client.0.smithi037.stdout: flushing 2024-04-23T01:48:50.325 INFO:tasks.workunit.client.0.smithi037.stdout:done 2024-04-23T01:48:50.325 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3056 ms) 2024-04-23T01:48:50.406 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12944 ms total) 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 16 tests from 2 test suites ran. (15009 ms total) 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 14 tests. 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 2 tests, listed below: 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-23T01:48:50.407 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:48:50.408 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:48:50.408 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_cmd 2024-04-23T01:48:50.429 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:48:50.429 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-23T01:48:50.429 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:48:50.430 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosCmd 2024-04-23T01:48:50.430 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-04-23T01:48:50.469 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCmd.MonDescribe (40 ms) 2024-04-23T01:48:50.469 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-04-23T01:48:50.506 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCmd.OSDCmd (37 ms) 2024-04-23T01:48:50.506 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-04-23T01:48:53.420 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCmd.PGCmd (2914 ms) 2024-04-23T01:48:53.420 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-04-23T01:48:53.457 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:52.408563+0000 mon.a [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-04-23T01:48:53.457 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:52.414797+0000 mon.a [INF] from='client.? 172.21.15.37:0/1609941975' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi037-93919-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-23T01:48:54.425 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:53.458063+0000 client.admin [INF] onexx 2024-04-23T01:48:54.425 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:53.458269+0000 mon.a [INF] from='client.? 172.21.15.37:0/4129642798' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-23T01:48:55.427 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:54.425444+0000 mon.a [INF] from='client.? 172.21.15.37:0/4129642798' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-04-23T01:48:58.433 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:56.432669+0000 mon.a [INF] from='client.? 172.21.15.37:0/4129642798' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-23T01:48:58.489 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:58.433480+0000 client.admin [INF] threexx 2024-04-23T01:48:58.489 INFO:tasks.workunit.client.0.smithi037.stdout:got: 2024-04-23T01:48:58.434180+0000 mon.a [INF] from='client.? 172.21.15.37:0/4129642798' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-23T01:49:02.496 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCmd.WatchLog (9076 ms) 2024-04-23T01:49:02.496 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosCmd (12067 ms total) 2024-04-23T01:49:02.496 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:02.497 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:49:02.497 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 4 tests from 1 test suite ran. (12067 ms total) 2024-04-23T01:49:02.497 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 4 tests. 2024-04-23T01:49:02.498 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:49:02.498 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:49:02.498 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_cmd_pp 2024-04-23T01:49:02.520 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:49:02.520 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-23T01:49:02.520 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:49:02.520 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosCmd 2024-04-23T01:49:02.520 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-04-23T01:49:02.557 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCmd.MonDescribePP (37 ms) 2024-04-23T01:49:02.557 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-04-23T01:49:02.591 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCmd.OSDCmdPP (34 ms) 2024-04-23T01:49:02.591 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-04-23T01:49:05.523 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCmd.PGCmdPP (2932 ms) 2024-04-23T01:49:05.523 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from LibRadosCmd (3003 ms total) 2024-04-23T01:49:05.524 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:05.524 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:49:05.524 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 3 tests from 1 test suite ran. (3003 ms total) 2024-04-23T01:49:05.524 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 3 tests. 2024-04-23T01:49:05.525 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:49:05.525 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:49:05.525 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_service 2024-04-23T01:49:05.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:49:05.557+0000 7fba6a05c840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:49:05.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:49:05.557+0000 7fba6a05c840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:49:05.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:49:05.557+0000 7fba6a05c840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:49:05.558 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-23T01:49:05.558 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:49:05.558 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosService 2024-04-23T01:49:05.559 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-04-23T01:49:10.592 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosService.RegisterEarly (5035 ms) 2024-04-23T01:49:10.592 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosService.RegisterLate 2024-04-23T01:49:10.626 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosService.RegisterLate (31 ms) 2024-04-23T01:49:10.626 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosService.StatusFormat 2024-04-23T01:49:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: cluster: 2024-04-23T01:49:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: id: e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:49:10.781 INFO:tasks.workunit.client.0.smithi037.stdout: health: HEALTH_WARN 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: 1 pool(s) do not have an application enabled 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: services: 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: mon: 1 daemons, quorum a (age 10m) 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: mgr: x(active, since 10m) 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: laundry: 1 daemon active (1 hosts) 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: data: 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: pools: 3 pools, 41 pgs 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: objects: 3 objects, 577 KiB 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: usage: 165 MiB used, 400 GiB / 400 GiB avail 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: pgs: 41 active+clean 2024-04-23T01:49:10.782 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:10.783 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: cluster: 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: id: e132a9f8-f5c5-4318-805c-a5b188312643 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: health: HEALTH_WARN 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: 1 pool(s) do not have an application enabled 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: services: 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: mon: 1 daemons, quorum a (age 10m) 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: mgr: x(active, since 10m) 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-04-23T01:49:12.813 INFO:tasks.workunit.client.0.smithi037.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: data: 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: pools: 3 pools, 41 pgs 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: objects: 3 objects, 577 KiB 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: usage: 165 MiB used, 400 GiB / 400 GiB avail 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: pgs: 41 active+clean 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:12.814 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:12.838 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosService.StatusFormat (2216 ms) 2024-04-23T01:49:12.839 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosService.Status 2024-04-23T01:49:32.871 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosService.Status (20032 ms) 2024-04-23T01:49:32.872 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosService (27314 ms total) 2024-04-23T01:49:32.872 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:49:32.872 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:49:32.872 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 4 tests from 1 test suite ran. (27314 ms total) 2024-04-23T01:49:32.872 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 4 tests. 2024-04-23T01:49:32.876 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:49:32.876 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:49:32.877 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_service_pp 2024-04-23T01:49:32.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:49:32.913+0000 7f6e8db3f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:49:32.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:49:32.913+0000 7f6e8db3f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:49:32.914 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:49:32.914+0000 7f6e8db3f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:49:32.914 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-23T01:49:32.914 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:49:32.915 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosServicePP 2024-04-23T01:49:32.915 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-04-23T01:49:37.944 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5029 ms) 2024-04-23T01:49:37.945 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-04-23T01:49:37.991 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosServicePP.RegisterLate (48 ms) 2024-04-23T01:49:37.991 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosServicePP.Status 2024-04-23T01:49:58.022 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosServicePP.Status (20031 ms) 2024-04-23T01:49:58.022 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosServicePP.Close 2024-04-23T01:49:58.022 INFO:tasks.workunit.client.0.smithi037.stdout:attempt 0 of 20 2024-04-23T01:50:03.082 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosServicePP.Close (5060 ms) 2024-04-23T01:50:03.083 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 4 tests from LibRadosServicePP (30168 ms total) 2024-04-23T01:50:03.083 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:50:03.083 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:50:03.083 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 4 tests from 1 test suite ran. (30168 ms total) 2024-04-23T01:50:03.083 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 4 tests. 2024-04-23T01:50:03.085 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:50:03.085 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:50:03.085 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_c_write_operations 2024-04-23T01:50:03.107 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:50:03.107 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 8 tests from 2 test suites. 2024-04-23T01:50:03.107 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:50:03.107 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibradosCWriteOps 2024-04-23T01:50:03.108 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-04-23T01:50:03.108 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-04-23T01:50:03.108 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-04-23T01:50:03.108 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:50:03.108 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-04-23T01:50:03.108 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-04-23T01:50:05.376 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCWriteOps.assertExists (2269 ms) 2024-04-23T01:50:05.376 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-04-23T01:50:08.397 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3021 ms) 2024-04-23T01:50:08.397 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-04-23T01:50:11.413 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3016 ms) 2024-04-23T01:50:11.413 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-04-23T01:50:14.426 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCWriteOps.Write (3012 ms) 2024-04-23T01:50:14.426 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-04-23T01:50:17.443 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCWriteOps.Exec (3017 ms) 2024-04-23T01:50:17.443 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-04-23T01:50:20.465 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3023 ms) 2024-04-23T01:50:20.466 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-04-23T01:50:30.488 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] LibRadosCWriteOps.CmpExt (10022 ms) 2024-04-23T01:50:30.488 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from LibRadosCWriteOps (27380 ms total) 2024-04-23T01:50:30.488 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:50:30.488 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:50:30.488 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 8 tests from 2 test suites ran. (27380 ms total) 2024-04-23T01:50:30.488 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 8 tests. 2024-04-23T01:50:30.490 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:50:30.490 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:50:30.490 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_c_read_operations 2024-04-23T01:50:30.513 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:50:30.513 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 17 tests from 1 test suite. 2024-04-23T01:50:30.514 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:50:30.514 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 17 tests from CReadOpsTest 2024-04-23T01:50:32.496 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-04-23T01:50:32.496 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-04-23T01:50:32.496 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-04-23T01:50:32.926 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.SetOpFlags (431 ms) 2024-04-23T01:50:32.926 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-04-23T01:50:32.955 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.AssertExists (29 ms) 2024-04-23T01:50:32.955 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-04-23T01:50:32.998 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.AssertVersion (43 ms) 2024-04-23T01:50:32.998 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-04-23T01:50:33.177 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.CmpXattr (179 ms) 2024-04-23T01:50:33.177 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.Read 2024-04-23T01:50:33.217 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.Read (39 ms) 2024-04-23T01:50:33.217 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.Checksum 2024-04-23T01:50:33.260 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.Checksum (43 ms) 2024-04-23T01:50:33.260 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-04-23T01:50:33.284 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.RWOrderedRead (25 ms) 2024-04-23T01:50:33.285 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-04-23T01:50:33.322 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.ShortRead (38 ms) 2024-04-23T01:50:33.323 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.Exec 2024-04-23T01:50:33.348 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.Exec (26 ms) 2024-04-23T01:50:33.348 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-04-23T01:50:33.383 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.ExecUserBuf (35 ms) 2024-04-23T01:50:33.384 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.Stat 2024-04-23T01:50:33.417 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.Stat (34 ms) 2024-04-23T01:50:33.417 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.Stat2 2024-04-23T01:50:33.451 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.Stat2 (33 ms) 2024-04-23T01:50:33.451 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.Omap 2024-04-23T01:50:33.628 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.Omap (178 ms) 2024-04-23T01:50:33.628 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-04-23T01:50:33.712 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.OmapNuls (84 ms) 2024-04-23T01:50:33.713 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-04-23T01:50:33.781 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.GetXattrs (68 ms) 2024-04-23T01:50:33.781 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-04-23T01:50:33.813 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] CReadOpsTest.CmpExt (33 ms) 2024-04-23T01:50:34.504 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 17 tests from CReadOpsTest (1318 ms total) 2024-04-23T01:50:34.504 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:50:34.504 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:50:34.504 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 17 tests from 1 test suite ran. (3991 ms total) 2024-04-23T01:50:34.505 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 17 tests. 2024-04-23T01:50:34.506 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:50:34.506 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:50:34.506 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_api_cls_remote_reads 2024-04-23T01:50:34.552 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:50:34.551+0000 7f082d0526c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:50:34.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:50:34.551+0000 7f082d0526c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:50:34.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:50:34.551+0000 7f082d0526c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:50:34.611 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 1 test from 1 test suite. 2024-04-23T01:50:34.611 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:50:34.611 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from ClsTestRemoteReads 2024-04-23T01:50:34.611 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] ClsTestRemoteReads.TestGather 2024-04-23T01:50:34.611 INFO:tasks.workunit.client.0.smithi037.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3192-ga1f34943/rpm/el9/BUILD/ceph-19.0.0-3192-ga1f34943/src/test/librados/cls_remote_reads.cc:13: Skipped 2024-04-23T01:50:34.611 INFO:tasks.workunit.client.0.smithi037.stdout:Not supported by crimson yet. Skipped 2024-04-23T01:50:34.611 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from ClsTestRemoteReads (0 ms total) 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 1 test from 1 test suite ran. (0 ms total) 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 0 tests. 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:50:34.612 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:50:34.613 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_list_parallel 2024-04-23T01:50:37.515 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94604]: starting. 2024-04-23T01:50:37.515 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94604]: creating pool ceph_test_rados_list_parallel.smithi037-94603 2024-04-23T01:50:37.515 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94604]: created object 0... 2024-04-23T01:50:37.515 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94604]: created object 25... 2024-04-23T01:50:37.515 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94604]: created object 49... 2024-04-23T01:50:37.515 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94604]: finishing. 2024-04-23T01:50:37.515 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94604]: shutting down. 2024-04-23T01:50:37.915 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94605]: starting. 2024-04-23T01:50:37.915 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94605]: listing objects. 2024-04-23T01:50:37.915 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94605]: listed object 0... 2024-04-23T01:50:37.915 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94605]: listed object 25... 2024-04-23T01:50:37.915 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94605]: saw 50 objects 2024-04-23T01:50:37.915 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94605]: shutting down. 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94640]: starting. 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94640]: creating pool ceph_test_rados_list_parallel.smithi037-94603 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94640]: created object 0... 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94640]: created object 25... 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94640]: created object 49... 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94640]: finishing. 2024-04-23T01:50:38.461 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94640]: shutting down. 2024-04-23T01:50:38.718 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:38.718 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94641]: starting. 2024-04-23T01:50:38.719 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94641]: listing objects. 2024-04-23T01:50:38.719 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94641]: listed object 0... 2024-04-23T01:50:38.719 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94641]: listed object 25... 2024-04-23T01:50:38.719 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94641]: saw 43 objects 2024-04-23T01:50:38.719 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94641]: shutting down. 2024-04-23T01:50:38.953 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:38.953 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[94642]: starting. 2024-04-23T01:50:38.953 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[94642]: removed 25 objects... 2024-04-23T01:50:38.953 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[94642]: removed half of the objects 2024-04-23T01:50:38.953 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[94642]: removed 50 objects... 2024-04-23T01:50:38.954 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[94642]: removed 50 objects 2024-04-23T01:50:38.954 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[94642]: shutting down. 2024-04-23T01:50:39.508 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:39.508 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:39.508 INFO:tasks.workunit.client.0.smithi037.stdout:process_6_[94691]: starting. 2024-04-23T01:50:39.509 INFO:tasks.workunit.client.0.smithi037.stdout:process_6_[94691]: creating pool ceph_test_rados_list_parallel.smithi037-94603 2024-04-23T01:50:39.509 INFO:tasks.workunit.client.0.smithi037.stdout:process_6_[94691]: created object 0... 2024-04-23T01:50:39.509 INFO:tasks.workunit.client.0.smithi037.stdout:process_6_[94691]: created object 25... 2024-04-23T01:50:39.509 INFO:tasks.workunit.client.0.smithi037.stdout:process_6_[94691]: created object 49... 2024-04-23T01:50:39.509 INFO:tasks.workunit.client.0.smithi037.stdout:process_6_[94691]: finishing. 2024-04-23T01:50:39.509 INFO:tasks.workunit.client.0.smithi037.stdout:process_6_[94691]: shutting down. 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:process_7_[94692]: starting. 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:process_7_[94692]: listing objects. 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:process_7_[94692]: listed object 0... 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:process_7_[94692]: listed object 25... 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:process_7_[94692]: listed object 50... 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:process_7_[94692]: saw 56 objects 2024-04-23T01:50:39.814 INFO:tasks.workunit.client.0.smithi037.stdout:process_7_[94692]: shutting down. 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:process_8_[94693]: starting. 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:process_8_[94693]: added 25 objects... 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:process_8_[94693]: added half of the objects 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:process_8_[94693]: added 50 objects... 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:process_8_[94693]: added 50 objects 2024-04-23T01:50:40.078 INFO:tasks.workunit.client.0.smithi037.stdout:process_8_[94693]: shutting down. 2024-04-23T01:50:40.643 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.643 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:process_9_[94742]: starting. 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:process_9_[94742]: creating pool ceph_test_rados_list_parallel.smithi037-94603 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:process_9_[94742]: created object 0... 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:process_9_[94742]: created object 25... 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:process_9_[94742]: created object 49... 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:process_9_[94742]: finishing. 2024-04-23T01:50:40.644 INFO:tasks.workunit.client.0.smithi037.stdout:process_9_[94742]: shutting down. 2024-04-23T01:50:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: starting. 2024-04-23T01:50:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: listing objects. 2024-04-23T01:50:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: listed object 0... 2024-04-23T01:50:40.965 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: listed object 25... 2024-04-23T01:50:40.966 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: listed object 50... 2024-04-23T01:50:40.966 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: listed object 75... 2024-04-23T01:50:40.966 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: saw 98 objects 2024-04-23T01:50:40.966 INFO:tasks.workunit.client.0.smithi037.stdout:process_10_[94743]: shutting down. 2024-04-23T01:50:41.275 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:process_13_[94746]: starting. 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:process_13_[94746]: removed 25 objects... 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:process_13_[94746]: removed half of the objects 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:process_13_[94746]: removed 50 objects... 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:process_13_[94746]: removed 50 objects 2024-04-23T01:50:41.276 INFO:tasks.workunit.client.0.smithi037.stdout:process_13_[94746]: shutting down. 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:process_11_[94744]: starting. 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:process_11_[94744]: added 25 objects... 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:process_11_[94744]: added half of the objects 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:process_11_[94744]: added 50 objects... 2024-04-23T01:50:41.311 INFO:tasks.workunit.client.0.smithi037.stdout:process_11_[94744]: added 50 objects 2024-04-23T01:50:41.312 INFO:tasks.workunit.client.0.smithi037.stdout:process_11_[94744]: shutting down. 2024-04-23T01:50:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.339 INFO:tasks.workunit.client.0.smithi037.stdout:process_12_[94745]: starting. 2024-04-23T01:50:41.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_12_[94745]: added 25 objects... 2024-04-23T01:50:41.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_12_[94745]: added half of the objects 2024-04-23T01:50:41.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_12_[94745]: added 50 objects... 2024-04-23T01:50:41.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_12_[94745]: added 50 objects 2024-04-23T01:50:41.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_12_[94745]: shutting down. 2024-04-23T01:50:41.898 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:process_14_[94827]: starting. 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:process_14_[94827]: creating pool ceph_test_rados_list_parallel.smithi037-94603 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:process_14_[94827]: created object 0... 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:process_14_[94827]: created object 25... 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:process_14_[94827]: created object 49... 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:process_14_[94827]: finishing. 2024-04-23T01:50:41.899 INFO:tasks.workunit.client.0.smithi037.stdout:process_14_[94827]: shutting down. 2024-04-23T01:50:42.181 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.181 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.181 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.181 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.181 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: starting. 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: listing objects. 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: listed object 0... 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: listed object 25... 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: listed object 50... 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: listed object 75... 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: listed object 100... 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: listed object 125... 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: saw 150 objects 2024-04-23T01:50:42.182 INFO:tasks.workunit.client.0.smithi037.stdout:process_15_[94828]: shutting down. 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:process_16_[94829]: starting. 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:process_16_[94829]: added 25 objects... 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:process_16_[94829]: added half of the objects 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:process_16_[94829]: added 50 objects... 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:process_16_[94829]: added 50 objects 2024-04-23T01:50:42.439 INFO:tasks.workunit.client.0.smithi037.stdout:process_16_[94829]: shutting down. 2024-04-23T01:50:42.521 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.521 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.521 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.521 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.521 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:42.521 INFO:tasks.workunit.client.0.smithi037.stdout:******* SUCCESS ********** 2024-04-23T01:50:42.522 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:50:42.522 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:50:42.522 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_open_pools_parallel 2024-04-23T01:50:45.468 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94895]: starting. 2024-04-23T01:50:45.468 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94895]: creating pool ceph_test_rados_open_pools_parallel.smithi037-94894 2024-04-23T01:50:45.468 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94895]: created object 0... 2024-04-23T01:50:45.468 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94895]: created object 25... 2024-04-23T01:50:45.468 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94895]: created object 49... 2024-04-23T01:50:45.468 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94895]: finishing. 2024-04-23T01:50:45.468 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94895]: shutting down. 2024-04-23T01:50:45.534 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94896]: starting. 2024-04-23T01:50:45.534 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94896]: rados_pool_create. 2024-04-23T01:50:45.534 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94896]: rados_ioctx_create. 2024-04-23T01:50:45.535 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94896]: shutting down. 2024-04-23T01:50:48.216 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:48.216 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94931]: starting. 2024-04-23T01:50:48.217 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94931]: creating pool ceph_test_rados_open_pools_parallel.smithi037-94894 2024-04-23T01:50:48.217 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94931]: created object 0... 2024-04-23T01:50:48.217 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94931]: created object 25... 2024-04-23T01:50:48.217 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94931]: created object 49... 2024-04-23T01:50:48.217 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94931]: finishing. 2024-04-23T01:50:48.217 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[94931]: shutting down. 2024-04-23T01:50:48.340 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:48.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94932]: starting. 2024-04-23T01:50:48.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94932]: rados_pool_create. 2024-04-23T01:50:48.340 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94932]: rados_ioctx_create. 2024-04-23T01:50:48.341 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[94932]: shutting down. 2024-04-23T01:50:48.341 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:48.341 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:48.342 INFO:tasks.workunit.client.0.smithi037.stdout:******* SUCCESS ********** 2024-04-23T01:50:48.342 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-23T01:50:48.343 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:50:48.343 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_rados_delete_pools_parallel 2024-04-23T01:50:51.249 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94968]: starting. 2024-04-23T01:50:51.249 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94968]: creating pool ceph_test_rados_delete_pools_parallel.smithi037-94967 2024-04-23T01:50:51.249 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94968]: created object 0... 2024-04-23T01:50:51.249 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94968]: created object 25... 2024-04-23T01:50:51.249 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94968]: created object 49... 2024-04-23T01:50:51.249 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94968]: finishing. 2024-04-23T01:50:51.250 INFO:tasks.workunit.client.0.smithi037.stdout:process_1_[94968]: shutting down. 2024-04-23T01:50:51.348 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94969]: starting. 2024-04-23T01:50:51.348 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94969]: deleting pool ceph_test_rados_delete_pools_parallel.smithi037-94967 2024-04-23T01:50:51.349 INFO:tasks.workunit.client.0.smithi037.stdout:process_2_[94969]: shutting down. 2024-04-23T01:50:54.282 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:54.282 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[95004]: starting. 2024-04-23T01:50:54.282 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[95004]: creating pool ceph_test_rados_delete_pools_parallel.smithi037-94967 2024-04-23T01:50:54.283 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[95004]: created object 0... 2024-04-23T01:50:54.283 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[95004]: created object 25... 2024-04-23T01:50:54.283 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[95004]: created object 49... 2024-04-23T01:50:54.283 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[95004]: finishing. 2024-04-23T01:50:54.283 INFO:tasks.workunit.client.0.smithi037.stdout:process_3_[95004]: shutting down. 2024-04-23T01:50:54.499 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:54.499 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[95006]: starting. 2024-04-23T01:50:54.499 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[95006]: listing objects. 2024-04-23T01:50:54.499 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[95006]: listed object 0... 2024-04-23T01:50:54.499 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[95006]: listed object 25... 2024-04-23T01:50:54.499 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[95006]: saw 50 objects 2024-04-23T01:50:54.500 INFO:tasks.workunit.client.0.smithi037.stdout:process_5_[95006]: shutting down. 2024-04-23T01:50:55.367 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:55.367 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[95005]: starting. 2024-04-23T01:50:55.367 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[95005]: deleting pool ceph_test_rados_delete_pools_parallel.smithi037-94967 2024-04-23T01:50:55.367 INFO:tasks.workunit.client.0.smithi037.stdout:process_4_[95005]: shutting down. 2024-04-23T01:50:55.368 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:55.368 INFO:tasks.workunit.client.0.smithi037.stdout:******************************* 2024-04-23T01:50:55.369 INFO:tasks.workunit.client.0.smithi037.stdout:******* SUCCESS ********** 2024-04-23T01:50:55.369 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:50:55.370 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:50:55.370 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:50:55.370 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' cls = ec_io ']' 2024-04-23T01:50:55.370 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' cls = ec_list ']' 2024-04-23T01:50:55.370 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_cls 2024-04-23T01:50:55.389 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:50:55.389 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 2 tests from 1 test suite. 2024-04-23T01:50:55.389 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:50:55.389 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from NeoRadosCls 2024-04-23T01:50:55.389 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosCls.DNE 2024-04-23T01:50:58.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosCls.DNE (3003 ms) 2024-04-23T01:50:58.392 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosCls.RemoteReads 2024-04-23T01:50:59.395 INFO:tasks.workunit.client.0.smithi037.stderr:Not supported by crimson yet. Skipped 2024-04-23T01:51:00.403 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosCls.RemoteReads (2011 ms) 2024-04-23T01:51:00.403 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from NeoRadosCls (5015 ms total) 2024-04-23T01:51:00.403 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:51:00.403 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:51:00.404 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 2 tests from 1 test suite ran. (5015 ms total) 2024-04-23T01:51:00.404 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 2 tests. 2024-04-23T01:51:00.406 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:51:00.406 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:51:00.406 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:51:00.406 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' cmd = ec_io ']' 2024-04-23T01:51:00.406 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' cmd = ec_list ']' 2024-04-23T01:51:00.407 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_cmd 2024-04-23T01:51:00.432 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:51:00.432 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-23T01:51:00.432 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:51:00.432 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from NeoRadosCmd 2024-04-23T01:51:00.433 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-04-23T01:51:02.416 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosCmd.MonDescribe (1984 ms) 2024-04-23T01:51:02.416 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-04-23T01:51:04.432 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosCmd.OSDCmd (2016 ms) 2024-04-23T01:51:04.432 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-04-23T01:51:07.335 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosCmd.PGCmd (2903 ms) 2024-04-23T01:51:07.336 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from NeoRadosCmd (6903 ms total) 2024-04-23T01:51:07.336 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:51:07.336 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:51:07.336 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 3 tests from 1 test suite ran. (6904 ms total) 2024-04-23T01:51:07.336 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 3 tests. 2024-04-23T01:51:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:51:07.337 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:51:07.338 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:51:07.338 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' handler_error = ec_io ']' 2024-04-23T01:51:07.338 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' handler_error = ec_list ']' 2024-04-23T01:51:07.338 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_handler_error 2024-04-23T01:51:07.355 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:51:07.355 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 1 test from 1 test suite. 2024-04-23T01:51:07.355 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:51:07.355 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from neocls_handler_error 2024-04-23T01:51:07.355 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-04-23T01:51:10.449 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] neocls_handler_error.test_handler_error (3094 ms) 2024-04-23T01:51:10.449 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 1 test from neocls_handler_error (3094 ms total) 2024-04-23T01:51:10.449 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:51:10.449 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:51:10.449 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 1 test from 1 test suite ran. (3094 ms total) 2024-04-23T01:51:10.449 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 1 test. 2024-04-23T01:51:10.451 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:51:10.451 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:51:10.451 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:51:10.451 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' io = ec_io ']' 2024-04-23T01:51:10.451 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' io = ec_list ']' 2024-04-23T01:51:10.451 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_io 2024-04-23T01:51:10.472 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:51:10.472 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 14 tests from 1 test suite. 2024-04-23T01:51:10.472 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:51:10.472 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from NeoRadosIo 2024-04-23T01:51:10.472 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.Limits 2024-04-23T01:51:11.452 INFO:tasks.workunit.client.0.smithi037.stderr:Not supported by crimson yet. Skipped 2024-04-23T01:51:12.338 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.Limits (1866 ms) 2024-04-23T01:51:12.338 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-04-23T01:51:15.469 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.SimpleWrite (3131 ms) 2024-04-23T01:51:15.470 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-04-23T01:51:18.483 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.ReadOp (3013 ms) 2024-04-23T01:51:18.483 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-04-23T01:51:21.495 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.SparseRead (3012 ms) 2024-04-23T01:51:21.495 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-04-23T01:51:24.507 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.RoundTrip (3012 ms) 2024-04-23T01:51:24.508 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-04-23T01:51:27.528 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3022 ms) 2024-04-23T01:51:27.528 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-04-23T01:51:30.546 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3017 ms) 2024-04-23T01:51:30.546 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-04-23T01:51:33.350 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (2804 ms) 2024-04-23T01:51:33.350 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-04-23T01:51:36.362 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3012 ms) 2024-04-23T01:51:36.362 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.Trunc 2024-04-23T01:51:39.372 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.Trunc (3010 ms) 2024-04-23T01:51:39.372 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.Remove 2024-04-23T01:51:42.345 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.Remove (2972 ms) 2024-04-23T01:51:42.345 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-04-23T01:51:45.403 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3059 ms) 2024-04-23T01:51:45.403 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-04-23T01:51:48.418 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.RmXattr (3014 ms) 2024-04-23T01:51:48.418 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-04-23T01:51:51.428 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosIo.GetXattrs (3010 ms) 2024-04-23T01:51:51.428 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from NeoRadosIo (40955 ms total) 2024-04-23T01:51:51.428 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:51:51.428 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:51:51.428 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 14 tests from 1 test suite ran. (40955 ms total) 2024-04-23T01:51:51.428 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 14 tests. 2024-04-23T01:51:51.432 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:51:51.432 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:51:51.432 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:51:51.432 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' ec_io = ec_io ']' 2024-04-23T01:51:51.432 INFO:tasks.workunit.client.0.smithi037.stdout:Skipping EC with Crimson 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo 'Skipping EC with Crimson' 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ continue 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' list = ec_io ']' 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' list = ec_list ']' 2024-04-23T01:51:51.433 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_list 2024-04-23T01:51:51.453 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:51:51.453 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-23T01:51:51.453 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:51:51.453 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from NeoradosList 2024-04-23T01:51:51.453 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoradosList.ListObjects 2024-04-23T01:51:54.447 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoradosList.ListObjects (2994 ms) 2024-04-23T01:51:54.448 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-04-23T01:51:57.455 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoradosList.ListObjectsNS (3008 ms) 2024-04-23T01:51:57.455 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-04-23T01:52:06.481 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoradosList.ListObjectsMany (9026 ms) 2024-04-23T01:52:06.482 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 3 tests from NeoradosList (15028 ms total) 2024-04-23T01:52:06.482 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:52:06.482 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:52:06.482 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 3 tests from 1 test suite ran. (15028 ms total) 2024-04-23T01:52:06.482 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 3 tests. 2024-04-23T01:52:06.484 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:52:06.484 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:52:06.484 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:52:06.484 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' ec_list = ec_io ']' 2024-04-23T01:52:06.485 INFO:tasks.workunit.client.0.smithi037.stdout:Skipping EC with Crimson 2024-04-23T01:52:06.485 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' ec_list = ec_list ']' 2024-04-23T01:52:06.485 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo 'Skipping EC with Crimson' 2024-04-23T01:52:06.485 INFO:tasks.workunit.client.0.smithi037.stderr:+ continue 2024-04-23T01:52:06.486 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:52:06.486 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:52:06.486 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:52:06.486 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' misc = ec_io ']' 2024-04-23T01:52:06.486 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' misc = ec_list ']' 2024-04-23T01:52:06.486 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_misc 2024-04-23T01:52:06.509 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:52:06.509 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 12 tests from 1 test suite. 2024-04-23T01:52:06.509 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:52:06.509 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 12 tests from NeoRadosMisc 2024-04-23T01:52:06.509 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.Version 2024-04-23T01:52:08.355 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.Version (1846 ms) 2024-04-23T01:52:08.355 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-04-23T01:52:10.365 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2010 ms) 2024-04-23T01:52:10.365 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.LongName 2024-04-23T01:52:13.377 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.LongName (3012 ms) 2024-04-23T01:52:13.377 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-04-23T01:52:14.386 INFO:tasks.workunit.client.0.smithi037.stderr:Not supported by crimson yet. Skipped 2024-04-23T01:52:15.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.LongLocator (2013 ms) 2024-04-23T01:52:15.391 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-04-23T01:52:18.407 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.LongNamespace (3016 ms) 2024-04-23T01:52:18.408 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-04-23T01:52:21.420 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.LongAttrName (3014 ms) 2024-04-23T01:52:21.421 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.Exec 2024-04-23T01:52:24.434 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.Exec (3013 ms) 2024-04-23T01:52:24.434 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-04-23T01:52:27.358 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.Operate1 (2924 ms) 2024-04-23T01:52:27.358 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-04-23T01:52:30.452 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.Operate2 (3094 ms) 2024-04-23T01:52:30.452 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-04-23T01:52:33.465 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.BigObject (3014 ms) 2024-04-23T01:52:33.466 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-04-23T01:52:35.473 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.BigAttr (2007 ms) 2024-04-23T01:52:35.473 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-04-23T01:52:36.481 INFO:tasks.workunit.client.0.smithi037.stderr:Not supported by crimson yet. Skipped 2024-04-23T01:52:37.361 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosMisc.WriteSame (1888 ms) 2024-04-23T01:52:37.362 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 12 tests from NeoRadosMisc (30852 ms total) 2024-04-23T01:52:37.362 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:52:37.362 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:52:37.362 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 12 tests from 1 test suite ran. (30852 ms total) 2024-04-23T01:52:37.362 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 12 tests. 2024-04-23T01:52:37.365 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:52:37.365 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:52:37.365 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:52:37.365 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' pool = ec_io ']' 2024-04-23T01:52:37.365 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' pool = ec_list ']' 2024-04-23T01:52:37.365 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_pool 2024-04-23T01:52:37.392 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:52:37.393 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 6 tests from 1 test suite. 2024-04-23T01:52:37.393 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:52:37.393 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 6 tests from NeoRadosPools 2024-04-23T01:52:37.393 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosPools.PoolList 2024-04-23T01:52:39.373 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosPools.PoolList (1980 ms) 2024-04-23T01:52:39.373 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-04-23T01:52:41.378 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosPools.PoolLookup (2005 ms) 2024-04-23T01:52:41.379 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-04-23T01:52:43.387 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2008 ms) 2024-04-23T01:52:43.387 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-04-23T01:52:47.363 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosPools.PoolDelete (3976 ms) 2024-04-23T01:52:47.363 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-04-23T01:52:49.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2011 ms) 2024-04-23T01:52:49.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-04-23T01:52:51.385 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2011 ms) 2024-04-23T01:52:51.386 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 6 tests from NeoRadosPools (13992 ms total) 2024-04-23T01:52:51.386 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:52:51.386 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:52:51.386 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 6 tests from 1 test suite ran. (13992 ms total) 2024-04-23T01:52:51.386 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 6 tests. 2024-04-23T01:52:51.389 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:52:51.389 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:52:51.389 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:52:51.389 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' read_operations = ec_io ']' 2024-04-23T01:52:51.389 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' read_operations = ec_list ']' 2024-04-23T01:52:51.389 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_read_operations 2024-04-23T01:52:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:52:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 14 tests from 1 test suite. 2024-04-23T01:52:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:52:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from NeoRadosReadOps 2024-04-23T01:52:51.418 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-04-23T01:52:54.402 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2984 ms) 2024-04-23T01:52:54.402 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-04-23T01:52:57.363 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.AssertExists (2961 ms) 2024-04-23T01:52:57.363 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-04-23T01:53:00.418 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3055 ms) 2024-04-23T01:53:00.419 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-04-23T01:53:03.437 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3019 ms) 2024-04-23T01:53:03.437 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.Read 2024-04-23T01:53:06.452 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.Read (3014 ms) 2024-04-23T01:53:06.452 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-04-23T01:53:09.463 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.Checksum (3012 ms) 2024-04-23T01:53:09.463 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-04-23T01:53:12.483 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3019 ms) 2024-04-23T01:53:12.483 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-04-23T01:53:15.498 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.ShortRead (3016 ms) 2024-04-23T01:53:15.498 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-04-23T01:53:18.509 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.Exec (3011 ms) 2024-04-23T01:53:18.510 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-04-23T01:53:21.516 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.Stat (3007 ms) 2024-04-23T01:53:21.516 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-04-23T01:53:24.531 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.Omap (3015 ms) 2024-04-23T01:53:24.531 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-04-23T01:53:27.372 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.OmapNuls (2841 ms) 2024-04-23T01:53:27.372 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-04-23T01:53:30.550 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3178 ms) 2024-04-23T01:53:30.551 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-04-23T01:53:33.561 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosReadOps.CmpExt (3011 ms) 2024-04-23T01:53:33.562 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 14 tests from NeoRadosReadOps (42143 ms total) 2024-04-23T01:53:33.562 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:53:33.562 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:53:33.562 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 14 tests from 1 test suite ran. (42143 ms total) 2024-04-23T01:53:33.562 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 14 tests. 2024-04-23T01:53:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:53:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:53:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:53:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' snapshots = ec_io ']' 2024-04-23T01:53:33.566 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' snapshots = ec_list ']' 2024-04-23T01:53:33.567 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_snapshots 2024-04-23T01:53:33.586 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:53:33.586 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 11 tests from 2 test suites. 2024-04-23T01:53:33.586 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:53:33.586 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-04-23T01:53:33.586 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-04-23T01:53:38.374 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSnapshots.SnapList (4788 ms) 2024-04-23T01:53:38.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-04-23T01:53:43.397 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (5023 ms) 2024-04-23T01:53:43.397 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-04-23T01:53:47.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSnapshots.Rollback (3978 ms) 2024-04-23T01:53:47.375 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-04-23T01:53:52.426 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5051 ms) 2024-04-23T01:53:52.426 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-04-23T01:53:59.381 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (6954 ms) 2024-04-23T01:53:59.381 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 5 tests from NeoRadosSnapshots (25794 ms total) 2024-04-23T01:53:59.381 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:53:59.381 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-04-23T01:53:59.381 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-04-23T01:54:04.428 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5048 ms) 2024-04-23T01:54:04.429 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-04-23T01:54:05.429 INFO:tasks.workunit.client.0.smithi037.stderr:Not supported by crimson yet. Skipped 2024-04-23T01:54:06.428 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (1999 ms) 2024-04-23T01:54:06.428 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-04-23T01:54:07.381 INFO:tasks.workunit.client.0.smithi037.stderr:Not supported by crimson yet. Skipped 2024-04-23T01:54:08.382 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (1955 ms) 2024-04-23T01:54:08.383 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-04-23T01:54:14.405 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6022 ms) 2024-04-23T01:54:14.405 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-04-23T01:54:18.429 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4024 ms) 2024-04-23T01:54:18.429 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-04-23T01:54:21.438 INFO:tasks.workunit.client.0.smithi037.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi037-95914-11. 2024-04-23T01:54:22.453 INFO:tasks.workunit.client.0.smithi037.stdout:Waiting for snaps to purge. 2024-04-23T01:54:38.465 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20036 ms) 2024-04-23T01:54:38.465 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (39084 ms total) 2024-04-23T01:54:38.465 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:54:38.465 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:54:38.465 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 11 tests from 2 test suites ran. (64878 ms total) 2024-04-23T01:54:38.465 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 11 tests. 2024-04-23T01:54:38.468 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:54:38.468 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:54:38.469 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:54:38.469 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' watch_notify = ec_io ']' 2024-04-23T01:54:38.469 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' watch_notify = ec_list ']' 2024-04-23T01:54:38.469 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_watch_notify 2024-04-23T01:54:38.489 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:54:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 2 tests from 1 test suite. 2024-04-23T01:54:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:54:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-04-23T01:54:38.490 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-04-23T01:54:41.022 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 36582112 notify_id 2826088480772 notifier_gid 15969 2024-04-23T01:54:41.485 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2995 ms) 2024-04-23T01:54:41.485 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-04-23T01:54:44.033 INFO:tasks.workunit.client.0.smithi037.stdout:Trying... 2024-04-23T01:54:44.037 INFO:tasks.workunit.client.0.smithi037.stdout:handle_notify cookie 48388160 notify_id 2838973382662 notifier_gid 15972 2024-04-23T01:54:44.037 INFO:tasks.workunit.client.0.smithi037.stdout:Waiting for 3.000000000s 2024-04-23T01:54:45.037 INFO:tasks.workunit.client.0.smithi037.stdout:Timed out. 2024-04-23T01:54:45.049 INFO:tasks.workunit.client.0.smithi037.stdout:Flushing... 2024-04-23T01:54:45.049 INFO:tasks.workunit.client.0.smithi037.stdout:Flushed... 2024-04-23T01:54:48.505 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7021 ms) 2024-04-23T01:54:48.505 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 2 tests from NeoRadosWatchNotify (10016 ms total) 2024-04-23T01:54:48.505 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:54:48.506 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:54:48.506 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 2 tests from 1 test suite ran. (10016 ms total) 2024-04-23T01:54:48.506 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 2 tests. 2024-04-23T01:54:48.508 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-23T01:54:48.508 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:54:48.508 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 1 -eq 1 ']' 2024-04-23T01:54:48.508 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' write_operations = ec_io ']' 2024-04-23T01:54:48.508 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' write_operations = ec_list ']' 2024-04-23T01:54:48.509 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph_test_neorados_write_operations 2024-04-23T01:54:48.529 INFO:tasks.workunit.client.0.smithi037.stdout:Running main() from gmock_main.cc 2024-04-23T01:54:48.529 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] Running 7 tests from 1 test suite. 2024-04-23T01:54:48.529 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment set-up. 2024-04-23T01:54:48.529 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-04-23T01:54:48.529 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-04-23T01:54:51.524 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2995 ms) 2024-04-23T01:54:51.524 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-04-23T01:54:54.536 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3011 ms) 2024-04-23T01:54:54.536 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-04-23T01:54:57.549 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3014 ms) 2024-04-23T01:54:57.549 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-04-23T01:55:00.566 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWriteOps.Write (3017 ms) 2024-04-23T01:55:00.567 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-04-23T01:55:03.579 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWriteOps.Exec (3013 ms) 2024-04-23T01:55:03.579 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-04-23T01:55:06.592 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3013 ms) 2024-04-23T01:55:06.592 INFO:tasks.workunit.client.0.smithi037.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-04-23T01:55:17.409 INFO:tasks.workunit.client.0.smithi037.stdout:[ OK ] NeoRadosWriteOps.CmpExt (10817 ms) 2024-04-23T01:55:17.410 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] 7 tests from NeoRadosWriteOps (28880 ms total) 2024-04-23T01:55:17.410 INFO:tasks.workunit.client.0.smithi037.stdout: 2024-04-23T01:55:17.410 INFO:tasks.workunit.client.0.smithi037.stdout:[----------] Global test environment tear-down 2024-04-23T01:55:17.410 INFO:tasks.workunit.client.0.smithi037.stdout:[==========] 7 tests from 1 test suite ran. (28880 ms total) 2024-04-23T01:55:17.410 INFO:tasks.workunit.client.0.smithi037.stdout:[ PASSED ] 7 tests. 2024-04-23T01:55:17.412 INFO:tasks.workunit.client.0.smithi037.stderr:+ ret=0 2024-04-23T01:55:17.412 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -eq 1 ']' 2024-04-23T01:55:17.412 INFO:tasks.workunit.client.0.smithi037.stderr:+ exit 0 2024-04-23T01:55:17.412 INFO:tasks.workunit.client.0.smithi037.stderr:+ cleanup 2024-04-23T01:55:17.413 INFO:tasks.workunit.client.0.smithi037.stderr:+ pkill -P 30339 2024-04-23T01:55:17.440 INFO:tasks.workunit.client.0.smithi037.stderr:+ true 2024-04-23T01:55:17.440 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T01:55:17.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T01:55:17.510 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-04-23T01:55:17.511 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-04-23T01:55:17.512 DEBUG:teuthology.orchestra.run.smithi037:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a1f34943cf7f9ae8af14bde99c6ca6a06e193ce4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-04-23T01:55:17.573 INFO:tasks.workunit.client.0.smithi037.stderr:++ uuidgen 2024-04-23T01:55:17.581 INFO:tasks.workunit.client.0.smithi037.stderr:+ p=d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:55:17.581 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool create d506dafc-2d08-46f3-8878-f69f9e013c29 12 2024-04-23T01:55:17.683 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.673+0000 7f9e3706d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:17.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.683+0000 7f9e3706d640 1 Processor -- start 2024-04-23T01:55:17.684 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.683+0000 7f9e3706d640 1 -- start start 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.684+0000 7f9e3706d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e30137eb0 0x7f9e3013a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.684+0000 7f9e3706d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e3006e770 con 0x7f9e30135040 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.684+0000 7f9e3706d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9e3009c830 con 0x7f9e30137eb0 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.684+0000 7f9e2ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e30137eb0 0x7f9e3013a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e34e09640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e30135040 0x7f9e30135450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36870/0 (socket says 172.21.15.37:36870) 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e34e09640 1 -- 172.21.15.37:0/1759239041 learned_addr learned my addr 172.21.15.37:0/1759239041 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2f7fe640 1 -- 172.21.15.37:0/1759239041 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600084016 0 0) 0x7f9e3006e770 con 0x7f9e30135040 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2f7fe640 1 -- 172.21.15.37:0/1759239041 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e18003580 con 0x7f9e30135040 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2ffff640 1 -- 172.21.15.37:0/1759239041 >> v1:172.21.15.37:6789/0 conn(0x7f9e30135040 legacy=0x7f9e30135450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:17.687 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2ffff640 1 -- 172.21.15.37:0/1759239041 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e30134ba0 con 0x7f9e30137eb0 2024-04-23T01:55:17.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2ffff640 1 --2- 172.21.15.37:0/1759239041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30137eb0 0x7f9e3013a2d0 crc :-1 s=READY pgs=12812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0a99f665da063f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:17.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2f7fe640 1 -- 172.21.15.37:0/1759239041 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e24009d90 con 0x7f9e30137eb0 2024-04-23T01:55:17.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2f7fe640 1 -- 172.21.15.37:0/1759239041 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9e2400e230 con 0x7f9e30137eb0 2024-04-23T01:55:17.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.685+0000 7f9e2f7fe640 1 -- 172.21.15.37:0/1759239041 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e2400e4d0 con 0x7f9e30137eb0 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.686+0000 7f9e3706d640 1 -- 172.21.15.37:0/1759239041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30137eb0 msgr2=0x7f9e3013a2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.686+0000 7f9e3706d640 1 --2- 172.21.15.37:0/1759239041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30137eb0 0x7f9e3013a2d0 crc :-1 s=READY pgs=12812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.686+0000 7f9e3706d640 1 -- 172.21.15.37:0/1759239041 shutdown_connections 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.686+0000 7f9e3706d640 1 --2- 172.21.15.37:0/1759239041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30137eb0 0x7f9e3013a2d0 unknown :-1 s=CLOSED pgs=12812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.686+0000 7f9e3706d640 1 -- 172.21.15.37:0/1759239041 >> 172.21.15.37:0/1759239041 conn(0x7f9e3006d3a0 msgr2=0x7f9e3006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.687+0000 7f9e3706d640 1 -- 172.21.15.37:0/1759239041 shutdown_connections 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.687+0000 7f9e3706d640 1 -- 172.21.15.37:0/1759239041 wait complete. 2024-04-23T01:55:17.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.687+0000 7f9e3706d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:17.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.689+0000 7f9e3706d640 1 Processor -- start 2024-04-23T01:55:17.690 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.689+0000 7f9e3706d640 1 -- start start 2024-04-23T01:55:17.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.690+0000 7f9e3706d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30135040 0x7f9e3009fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:17.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.690+0000 7f9e3706d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3006bdb0 con 0x7f9e30135040 2024-04-23T01:55:17.692 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e34e09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30135040 0x7f9e3009fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:17.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e34e09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30135040 0x7f9e3009fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53596/0 (socket says 172.21.15.37:53596) 2024-04-23T01:55:17.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e34e09640 1 -- 172.21.15.37:0/3770271386 learned_addr learned my addr 172.21.15.37:0/3770271386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:17.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e34e09640 1 -- 172.21.15.37:0/3770271386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3009f740 con 0x7f9e30135040 2024-04-23T01:55:17.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e34e09640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30135040 0x7f9e3009fd90 crc :-1 s=READY pgs=12813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:17.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e280070b0 con 0x7f9e30135040 2024-04-23T01:55:17.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9e28007210 con 0x7f9e30135040 2024-04-23T01:55:17.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.691+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3011d710 con 0x7f9e30135040 2024-04-23T01:55:17.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.692+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9e280074b0 con 0x7f9e30135040 2024-04-23T01:55:17.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.692+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3011ea10 con 0x7f9e30135040 2024-04-23T01:55:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.693+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9e28007660 con 0x7f9e30135040 2024-04-23T01:55:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.693+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e300697f0 con 0x7f9e30135040 2024-04-23T01:55:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.693+0000 7f9e2d7fa640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9e1c038980 0x7f9e1c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.693+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(687..687 src has 609..687) ==== 3403+0+0 (crc 0 0 0) 0x7f9e28048f00 con 0x7f9e30135040 2024-04-23T01:55:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.693+0000 7f9e2ffff640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9e1c038980 0x7f9e1c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:17.695 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.694+0000 7f9e2ffff640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9e1c038980 0x7f9e1c03ae90 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:17.701 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.699+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f9e280092e0 con 0x7f9e30135040 2024-04-23T01:55:17.887 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:17.886+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pg_num": 12} v 0) -- 0x7f9e300681a0 con 0x7f9e30135040 2024-04-23T01:55:18.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.413+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pg_num": 12}]=0 pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' created v688) ==== 176+0+0 (crc 0 0 0) 0x7f9e2800d150 con 0x7f9e30135040 2024-04-23T01:55:18.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.577+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pg_num": 12} v 0) -- 0x7f9e3011f740 con 0x7f9e30135040 2024-04-23T01:55:18.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.578+0000 7f9e2d7fa640 1 -- 172.21.15.37:0/3770271386 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pg_num": 12}]=0 pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' already exists v688) ==== 183+0+0 (crc 0 0 0) 0x7f9e2800ddb0 con 0x7f9e30135040 2024-04-23T01:55:18.580 INFO:tasks.workunit.client.0.smithi037.stderr:pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' already exists 2024-04-23T01:55:18.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9e1c038980 msgr2=0x7f9e1c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:18.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9e1c038980 0x7f9e1c03ae90 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:18.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30135040 msgr2=0x7f9e3009fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:18.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30135040 0x7f9e3009fd90 crc :-1 s=READY pgs=12813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:18.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 shutdown_connections 2024-04-23T01:55:18.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9e1c038980 0x7f9e1c03ae90 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:18.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 --2- 172.21.15.37:0/3770271386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e30135040 0x7f9e3009fd90 unknown :-1 s=CLOSED pgs=12813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:18.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 >> 172.21.15.37:0/3770271386 conn(0x7f9e3006d3a0 msgr2=0x7f9e301329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:18.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 shutdown_connections 2024-04-23T01:55:18.584 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.581+0000 7f9e3706d640 1 -- 172.21.15.37:0/3770271386 wait complete. 2024-04-23T01:55:18.602 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota d506dafc-2d08-46f3-8878-f69f9e013c29 max_objects 10 2024-04-23T01:55:18.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.705+0000 7f9329a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:18.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.719+0000 7f9329a6d640 1 Processor -- start 2024-04-23T01:55:18.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.719+0000 7f9329a6d640 1 -- start start 2024-04-23T01:55:18.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.721+0000 7f9329a6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93241356a0 0x7f9324139e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.721+0000 7f9329a6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9324134c80 con 0x7f932409b460 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.721+0000 7f9329a6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f932409bf20 con 0x7f93241356a0 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.722+0000 7f9322ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93241356a0 0x7f9324139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.722+0000 7f9322ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93241356a0 0x7f9324139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53608/0 (socket says 172.21.15.37:53608) 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.722+0000 7f9322ffd640 1 -- 172.21.15.37:0/1275768783 learned_addr learned my addr 172.21.15.37:0/1275768783 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.722+0000 7f93237fe640 1 --1- 172.21.15.37:0/1275768783 >> v1:172.21.15.37:6789/0 conn(0x7f932409b460 0x7f9324134f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36882/0 (socket says 172.21.15.37:36882) 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.722+0000 7f9322ffd640 1 -- 172.21.15.37:0/1275768783 >> v1:172.21.15.37:6789/0 conn(0x7f932409b460 legacy=0x7f9324134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.722+0000 7f93227fc640 1 -- 172.21.15.37:0/1275768783 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419753562 0 0) 0x7f9324134c80 con 0x7f932409b460 2024-04-23T01:55:18.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.722+0000 7f9322ffd640 1 -- 172.21.15.37:0/1275768783 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932409c8d0 con 0x7f93241356a0 2024-04-23T01:55:18.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.723+0000 7f9322ffd640 1 --2- 172.21.15.37:0/1275768783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f9324139e80 crc :-1 s=READY pgs=12815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac36f7e1e8bf0b2b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:18.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.723+0000 7f93227fc640 1 -- 172.21.15.37:0/1275768783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9318009e50 con 0x7f93241356a0 2024-04-23T01:55:18.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.723+0000 7f93227fc640 1 -- 172.21.15.37:0/1275768783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f931800e230 con 0x7f93241356a0 2024-04-23T01:55:18.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.723+0000 7f93227fc640 1 -- 172.21.15.37:0/1275768783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f931800e4d0 con 0x7f93241356a0 2024-04-23T01:55:18.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.724+0000 7f9329a6d640 1 -- 172.21.15.37:0/1275768783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 msgr2=0x7f9324139e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.724+0000 7f9329a6d640 1 --2- 172.21.15.37:0/1275768783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f9324139e80 crc :-1 s=READY pgs=12815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.724+0000 7f9329a6d640 1 -- 172.21.15.37:0/1275768783 shutdown_connections 2024-04-23T01:55:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.724+0000 7f9329a6d640 1 --2- 172.21.15.37:0/1275768783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f9324139e80 unknown :-1 s=CLOSED pgs=12815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.724+0000 7f9329a6d640 1 -- 172.21.15.37:0/1275768783 >> 172.21.15.37:0/1275768783 conn(0x7f93240a3c00 msgr2=0x7f93240a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.724+0000 7f9329a6d640 1 -- 172.21.15.37:0/1275768783 shutdown_connections 2024-04-23T01:55:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.724+0000 7f9329a6d640 1 -- 172.21.15.37:0/1275768783 wait complete. 2024-04-23T01:55:18.727 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.725+0000 7f9329a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:18.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.728+0000 7f9329a6d640 1 Processor -- start 2024-04-23T01:55:18.729 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.728+0000 7f9329a6d640 1 -- start start 2024-04-23T01:55:18.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.730+0000 7f9329a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f93241c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:18.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.730+0000 7f9329a6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9324132400 con 0x7f93241356a0 2024-04-23T01:55:18.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.731+0000 7f93237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f93241c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:18.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.731+0000 7f93237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f93241c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53612/0 (socket says 172.21.15.37:53612) 2024-04-23T01:55:18.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.731+0000 7f93237fe640 1 -- 172.21.15.37:0/3798957014 learned_addr learned my addr 172.21.15.37:0/3798957014 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:18.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.731+0000 7f93237fe640 1 -- 172.21.15.37:0/3798957014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9324120930 con 0x7f93241356a0 2024-04-23T01:55:18.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.731+0000 7f93237fe640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f93241c9690 crc :-1 s=READY pgs=12816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.732+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9314004b80 con 0x7f93241356a0 2024-04-23T01:55:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.732+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9314004ce0 con 0x7f93241356a0 2024-04-23T01:55:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.732+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93240a0740 con 0x7f93241356a0 2024-04-23T01:55:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.732+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9314004b80 con 0x7f93241356a0 2024-04-23T01:55:18.734 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.732+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932411ed20 con 0x7f93241356a0 2024-04-23T01:55:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.733+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9314007120 con 0x7f93241356a0 2024-04-23T01:55:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.734+0000 7f930bfff640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f93100389b0 0x7f931003aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.734+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(688..688 src has 609..688) ==== 3778+0+0 (crc 0 0 0) 0x7f93140484e0 con 0x7f93241356a0 2024-04-23T01:55:18.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.734+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9324132190 con 0x7f93241356a0 2024-04-23T01:55:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.734+0000 7f9322ffd640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f93100389b0 0x7f931003aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:18.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.735+0000 7f9322ffd640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f93100389b0 0x7f931003aec0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:18.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.741+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f931400a2e0 con 0x7f93241356a0 2024-04-23T01:55:18.976 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:18.974+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "10"} v 0) -- 0x7f93240697f0 con 0x7f93241356a0 2024-04-23T01:55:19.418 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:19.418+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v689) ==== 223+0+0 (crc 0 0 0) 0x7f931400a100 con 0x7f93241356a0 2024-04-23T01:55:19.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:19.640+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "10"} v 0) -- 0x7f93240008d0 con 0x7f93241356a0 2024-04-23T01:55:20.425 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.423+0000 7f930bfff640 1 -- 172.21.15.37:0/3798957014 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v690) ==== 223+0+0 (crc 0 0 0) 0x7f931400a100 con 0x7f93241356a0 2024-04-23T01:55:20.425 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_objects = 10 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:55:20.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f93100389b0 msgr2=0x7f931003aec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:20.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f93100389b0 0x7f931003aec0 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:20.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 msgr2=0x7f93241c9690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:20.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f93241c9690 crc :-1 s=READY pgs=12816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:20.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 shutdown_connections 2024-04-23T01:55:20.428 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f93100389b0 0x7f931003aec0 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:20.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 --2- 172.21.15.37:0/3798957014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93241356a0 0x7f93241c9690 unknown :-1 s=CLOSED pgs=12816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:20.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 >> 172.21.15.37:0/3798957014 conn(0x7f93240a3c00 msgr2=0x7f9324133c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:20.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 shutdown_connections 2024-04-23T01:55:20.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.426+0000 7f9329a6d640 1 -- 172.21.15.37:0/3798957014 wait complete. 2024-04-23T01:55:20.439 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool application enable d506dafc-2d08-46f3-8878-f69f9e013c29 rados 2024-04-23T01:55:20.540 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.530+0000 7f7f4e66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:20.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.540+0000 7f7f4e66d640 1 Processor -- start 2024-04-23T01:55:20.541 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.540+0000 7f7f4e66d640 1 -- start start 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.541+0000 7f7f4e66d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f480707f0 0x7f7f48070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.541+0000 7f7f4e66d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f48072390 con 0x7f7f48071140 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.541+0000 7f7f4e66d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7f48071bb0 con 0x7f7f480707f0 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.541+0000 7f7f47fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f480707f0 0x7f7f48070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f477fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f48071140 0x7f7f4812c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52044/0 (socket says 172.21.15.37:52044) 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f477fe640 1 -- 172.21.15.37:0/2173758655 learned_addr learned my addr 172.21.15.37:0/2173758655 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f47fff640 1 -- 172.21.15.37:0/2173758655 >> v1:172.21.15.37:6789/0 conn(0x7f7f48071140 legacy=0x7f7f4812c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f47fff640 1 -- 172.21.15.37:0/2173758655 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f48072050 con 0x7f7f480707f0 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f47fff640 1 --2- 172.21.15.37:0/2173758655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f48070c00 crc :-1 s=READY pgs=12818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d2b16edfb3d198 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f46ffd640 1 -- 172.21.15.37:0/2173758655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f38009d90 con 0x7f7f480707f0 2024-04-23T01:55:20.544 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f46ffd640 1 -- 172.21.15.37:0/2173758655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7f3800e230 con 0x7f7f480707f0 2024-04-23T01:55:20.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.542+0000 7f7f46ffd640 1 -- 172.21.15.37:0/2173758655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f3800e4d0 con 0x7f7f480707f0 2024-04-23T01:55:20.545 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 1 -- 172.21.15.37:0/2173758655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 msgr2=0x7f7f48070c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 1 --2- 172.21.15.37:0/2173758655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f48070c00 crc :-1 s=READY pgs=12818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 1 -- 172.21.15.37:0/2173758655 shutdown_connections 2024-04-23T01:55:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 1 --2- 172.21.15.37:0/2173758655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f48070c00 unknown :-1 s=CLOSED pgs=12818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 1 -- 172.21.15.37:0/2173758655 >> 172.21.15.37:0/2173758655 conn(0x7f7f480a1a20 msgr2=0x7f7f480a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 1 -- 172.21.15.37:0/2173758655 shutdown_connections 2024-04-23T01:55:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 1 -- 172.21.15.37:0/2173758655 wait complete. 2024-04-23T01:55:20.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.543+0000 7f7f4e66d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:20.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.545+0000 7f7f4e66d640 1 Processor -- start 2024-04-23T01:55:20.547 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.545+0000 7f7f4e66d640 1 -- start start 2024-04-23T01:55:20.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f4e66d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f4811be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:20.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f4e66d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4811d310 con 0x7f7f480707f0 2024-04-23T01:55:20.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f4811be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:20.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f4811be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52974/0 (socket says 172.21.15.37:52974) 2024-04-23T01:55:20.549 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f47fff640 1 -- 172.21.15.37:0/3476134164 learned_addr learned my addr 172.21.15.37:0/3476134164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:20.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f47fff640 1 -- 172.21.15.37:0/3476134164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4811efc0 con 0x7f7f480707f0 2024-04-23T01:55:20.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f47fff640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f4811be80 crc :-1 s=READY pgs=12819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:20.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f38014620 con 0x7f7f480707f0 2024-04-23T01:55:20.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7f38014780 con 0x7f7f480707f0 2024-04-23T01:55:20.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4811fef0 con 0x7f7f480707f0 2024-04-23T01:55:20.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.547+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7f38014a20 con 0x7f7f480707f0 2024-04-23T01:55:20.550 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.548+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f48068d00 con 0x7f7f480707f0 2024-04-23T01:55:20.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.548+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f48073be0 con 0x7f7f480707f0 2024-04-23T01:55:20.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.549+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7f38014bd0 con 0x7f7f480707f0 2024-04-23T01:55:20.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.549+0000 7f7f44ff9640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7f34038980 0x7f7f3403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:20.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.549+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(690..690 src has 609..690) ==== 3778+0+0 (crc 0 0 0) 0x7f7f38019040 con 0x7f7f480707f0 2024-04-23T01:55:20.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.549+0000 7f7f477fe640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7f34038980 0x7f7f3403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:20.551 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.550+0000 7f7f477fe640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7f34038980 0x7f7f3403ae90 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:20.556 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.554+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f7f38018190 con 0x7f7f480707f0 2024-04-23T01:55:20.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:20.741+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "app": "rados"} v 0) -- 0x7f7f480697f0 con 0x7f7f480707f0 2024-04-23T01:55:21.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:21.424+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "app": "rados"}]=0 enabled application 'rados' on pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' v691) ==== 213+0+0 (crc 0 0 0) 0x7f7f3800fb30 con 0x7f7f480707f0 2024-04-23T01:55:21.546 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:21.544+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "app": "rados"} v 0) -- 0x7f7f4811e2e0 con 0x7f7f480707f0 2024-04-23T01:55:22.397 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.396+0000 7f7f44ff9640 1 -- 172.21.15.37:0/3476134164 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "app": "rados"}]=0 enabled application 'rados' on pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' v692) ==== 213+0+0 (crc 0 0 0) 0x7f7f3800fd10 con 0x7f7f480707f0 2024-04-23T01:55:22.398 INFO:tasks.workunit.client.0.smithi037.stderr:enabled application 'rados' on pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' 2024-04-23T01:55:22.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7f34038980 msgr2=0x7f7f3403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7f34038980 0x7f7f3403ae90 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 msgr2=0x7f7f4811be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.400 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f4811be80 crc :-1 s=READY pgs=12819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 shutdown_connections 2024-04-23T01:55:22.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7f34038980 0x7f7f3403ae90 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 --2- 172.21.15.37:0/3476134164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f480707f0 0x7f7f4811be80 unknown :-1 s=CLOSED pgs=12819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.398+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 >> 172.21.15.37:0/3476134164 conn(0x7f7f480a1a20 msgr2=0x7f7f481325c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.399+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 shutdown_connections 2024-04-23T01:55:22.401 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.399+0000 7f7f4e66d640 1 -- 172.21.15.37:0/3476134164 wait complete. 2024-04-23T01:55:22.412 INFO:tasks.workunit.client.0.smithi037.stderr:++ seq 1 10 2024-04-23T01:55:22.423 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:22.423 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj1 /etc/passwd 2024-04-23T01:55:22.466 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.464+0000 7fb8cfd1aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.470+0000 7fb8cfd1aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.472 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.470+0000 7fb8cfd1aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.471+0000 7fb8cfd1aec0 1 Processor -- start 2024-04-23T01:55:22.473 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.471+0000 7fb8cfd1aec0 1 -- start start 2024-04-23T01:55:22.474 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.473+0000 7fb8cfd1aec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1f26260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.473+0000 7fb8cfd1aec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1e91950 con 0x1f2a6a0 2024-04-23T01:55:22.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.473+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1f26260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.473+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1f26260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53000/0 (socket says 172.21.15.37:53000) 2024-04-23T01:55:22.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.473+0000 7fb8c37fe640 1 -- 172.21.15.37:0/4101553048 learned_addr learned my addr 172.21.15.37:0/4101553048 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.475 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.473+0000 7fb8c37fe640 1 -- 172.21.15.37:0/4101553048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e301e0 con 0x1f2a6a0 2024-04-23T01:55:22.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8c37fe640 1 --2- 172.21.15.37:0/4101553048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1f26260 crc :-1 s=READY pgs=12822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d569083fef988de5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8c1ffb640 1 -- 172.21.15.37:0/4101553048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8b402c990 con 0x1f2a6a0 2024-04-23T01:55:22.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8c1ffb640 1 -- 172.21.15.37:0/4101553048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb8b400a040 con 0x1f2a6a0 2024-04-23T01:55:22.476 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8c1ffb640 1 -- 172.21.15.37:0/4101553048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8b400a2e0 con 0x1f2a6a0 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/4101553048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 msgr2=0x1f26260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/4101553048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1f26260 crc :-1 s=READY pgs=12822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/4101553048 shutdown_connections 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/4101553048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1f26260 unknown :-1 s=CLOSED pgs=12822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/4101553048 >> 172.21.15.37:0/4101553048 conn(0x1e48960 msgr2=0x1f2f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.474+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/4101553048 shutdown_connections 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.475+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/4101553048 wait complete. 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.476+0000 7fb8cfd1aec0 1 Processor -- start 2024-04-23T01:55:22.477 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.476+0000 7fb8cfd1aec0 1 -- start start 2024-04-23T01:55:22.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.477+0000 7fb8cfd1aec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1fc01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.477+0000 7fb8cfd1aec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1e8f3d0 con 0x1f2a6a0 2024-04-23T01:55:22.479 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.477+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1fc01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.477+0000 7fb8c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1fc01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53010/0 (socket says 172.21.15.37:53010) 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.477+0000 7fb8c37fe640 1 -- 172.21.15.37:0/1898634516 learned_addr learned my addr 172.21.15.37:0/1898634516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.477+0000 7fb8c37fe640 1 -- 172.21.15.37:0/1898634516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e22e30 con 0x1f2a6a0 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.478+0000 7fb8c37fe640 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1fc01a0 crc :-1 s=READY pgs=12823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.478+0000 7fb8c0ff9640 1 -- 172.21.15.37:0/1898634516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8b402d570 con 0x1f2a6a0 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.478+0000 7fb8c0ff9640 1 -- 172.21.15.37:0/1898634516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb8b402d6d0 con 0x1f2a6a0 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.478+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e22890 con 0x1f2a6a0 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.478+0000 7fb8c0ff9640 1 -- 172.21.15.37:0/1898634516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb8b402d970 con 0x1f2a6a0 2024-04-23T01:55:22.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.478+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1fc0e70 con 0x1f2a6a0 2024-04-23T01:55:22.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.479+0000 7fb8c0ff9640 1 -- 172.21.15.37:0/1898634516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb8b4035040 con 0x1f2a6a0 2024-04-23T01:55:22.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.479+0000 7fb8c0ff9640 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb8b0037210 0x7fb8b0039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.479+0000 7fb8c0ff9640 1 -- 172.21.15.37:0/1898634516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7fb8b4032040 con 0x1f2a6a0 2024-04-23T01:55:22.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.479+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/1898634516 >> v2:172.21.15.37:6805/1977556410 conn(0x1f2c450 0x2053860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.479+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 --> v2:172.21.15.37:6805/1977556410 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x1fad310 con 0x1f2c450 2024-04-23T01:55:22.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.479+0000 7fb8c2ffd640 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb8b0037210 0x7fb8b0039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.480+0000 7fb8c2ffd640 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb8b0037210 0x7fb8b0039720 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.480+0000 7fb8c899c640 1 --2- 172.21.15.37:0/1898634516 >> v2:172.21.15.37:6805/1977556410 conn(0x1f2c450 0x2053860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:22.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.483+0000 7fb8c899c640 1 --2- 172.21.15.37:0/1898634516 >> v2:172.21.15.37:6805/1977556410 conn(0x1f2c450 0x2053860 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8c899c640 1 -- 172.21.15.37:0/1898634516 <== osd.1 v2:172.21.15.37:6805/1977556410 1 ==== osd_op_reply(1 obj1 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb8bc00a430 con 0x1f2c450 2024-04-23T01:55:22.688 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 >> v2:172.21.15.37:6805/1977556410 conn(0x1f2c450 msgr2=0x2053860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/1898634516 >> v2:172.21.15.37:6805/1977556410 conn(0x1f2c450 0x2053860 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb8b0037210 msgr2=0x7fb8b0039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb8b0037210 0x7fb8b0039720 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 msgr2=0x1fc01a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1fc01a0 crc :-1 s=READY pgs=12823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 shutdown_connections 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/1898634516 >> v2:172.21.15.37:6805/1977556410 conn(0x1f2c450 0x2053860 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fb8b0037210 0x7fb8b0039720 unknown :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 --2- 172.21.15.37:0/1898634516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1f2a6a0 0x1fc01a0 unknown :-1 s=CLOSED pgs=12823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 >> 172.21.15.37:0/1898634516 conn(0x1e48960 msgr2=0x1f24c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 shutdown_connections 2024-04-23T01:55:22.689 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.686+0000 7fb8cfd1aec0 1 -- 172.21.15.37:0/1898634516 wait complete. 2024-04-23T01:55:22.690 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:22.690 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj2 /etc/passwd 2024-04-23T01:55:22.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.725+0000 7f5149091ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.730+0000 7f5149091ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.730+0000 7f5149091ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.731+0000 7f5149091ec0 1 Processor -- start 2024-04-23T01:55:22.733 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.731+0000 7f5149091ec0 1 -- start start 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f5149091ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x19580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f5149091ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1840950 con 0x18d6670 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f514119b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x19580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f514119b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x19580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53016/0 (socket says 172.21.15.37:53016) 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f514119b640 1 -- 172.21.15.37:0/3001381385 learned_addr learned my addr 172.21.15.37:0/3001381385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f514119b640 1 -- 172.21.15.37:0/3001381385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17df1e0 con 0x18d6670 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f514119b640 1 --2- 172.21.15.37:0/3001381385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x19580a0 crc :-1 s=READY pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4259968f05f1fcfe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.735 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f513affd640 1 -- 172.21.15.37:0/3001381385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f51340061f0 con 0x18d6670 2024-04-23T01:55:22.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f513affd640 1 -- 172.21.15.37:0/3001381385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f51340019f0 con 0x18d6670 2024-04-23T01:55:22.736 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.733+0000 7f513affd640 1 -- 172.21.15.37:0/3001381385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5134001b60 con 0x18d6670 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.734+0000 7f5149091ec0 1 -- 172.21.15.37:0/3001381385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 msgr2=0x19580a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.734+0000 7f5149091ec0 1 --2- 172.21.15.37:0/3001381385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x19580a0 crc :-1 s=READY pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.734+0000 7f5149091ec0 1 -- 172.21.15.37:0/3001381385 shutdown_connections 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.734+0000 7f5149091ec0 1 --2- 172.21.15.37:0/3001381385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x19580a0 unknown :-1 s=CLOSED pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.734+0000 7f5149091ec0 1 -- 172.21.15.37:0/3001381385 >> 172.21.15.37:0/3001381385 conn(0x17f7960 msgr2=0x18d8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.734+0000 7f5149091ec0 1 -- 172.21.15.37:0/3001381385 shutdown_connections 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.734+0000 7f5149091ec0 1 -- 172.21.15.37:0/3001381385 wait complete. 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.735+0000 7f5149091ec0 1 Processor -- start 2024-04-23T01:55:22.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.735+0000 7f5149091ec0 1 -- start start 2024-04-23T01:55:22.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f5149091ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x1a04bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f5149091ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x183e3d0 con 0x18d6670 2024-04-23T01:55:22.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f514119b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x1a04bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f514119b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x1a04bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53018/0 (socket says 172.21.15.37:53018) 2024-04-23T01:55:22.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f514119b640 1 -- 172.21.15.37:0/282268536 learned_addr learned my addr 172.21.15.37:0/282268536 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f514119b640 1 -- 172.21.15.37:0/282268536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17d1e30 con 0x18d6670 2024-04-23T01:55:22.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f514119b640 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x1a04bb0 crc :-1 s=READY pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f5139ffb640 1 -- 172.21.15.37:0/282268536 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5134004970 con 0x18d6670 2024-04-23T01:55:22.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f5139ffb640 1 -- 172.21.15.37:0/282268536 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5134004ad0 con 0x18d6670 2024-04-23T01:55:22.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x17d1890 con 0x18d6670 2024-04-23T01:55:22.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f5139ffb640 1 -- 172.21.15.37:0/282268536 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5134004d70 con 0x18d6670 2024-04-23T01:55:22.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.737+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x195cae0 con 0x18d6670 2024-04-23T01:55:22.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.738+0000 7f5139ffb640 1 -- 172.21.15.37:0/282268536 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f51340133a0 con 0x18d6670 2024-04-23T01:55:22.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.738+0000 7f5139ffb640 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5128037210 0x7f5128039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.738+0000 7f5139ffb640 1 -- 172.21.15.37:0/282268536 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7f51340486b0 con 0x18d6670 2024-04-23T01:55:22.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.739+0000 7f5149091ec0 1 --2- 172.21.15.37:0/282268536 >> v2:172.21.15.37:6805/1977556410 conn(0x196ff10 0x195bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.739+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 --> v2:172.21.15.37:6805/1977556410 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x195f1c0 con 0x196ff10 2024-04-23T01:55:22.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.739+0000 7f514099a640 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5128037210 0x7f5128039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.739+0000 7f514099a640 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5128037210 0x7f5128039720 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.739+0000 7f514199c640 1 --2- 172.21.15.37:0/282268536 >> v2:172.21.15.37:6805/1977556410 conn(0x196ff10 0x195bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:22.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.742+0000 7f514199c640 1 --2- 172.21.15.37:0/282268536 >> v2:172.21.15.37:6805/1977556410 conn(0x196ff10 0x195bb50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f514199c640 1 -- 172.21.15.37:0/282268536 <== osd.1 v2:172.21.15.37:6805/1977556410 1 ==== osd_op_reply(1 obj2 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f512c00c430 con 0x196ff10 2024-04-23T01:55:22.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 >> v2:172.21.15.37:6805/1977556410 conn(0x196ff10 msgr2=0x195bb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.754 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 --2- 172.21.15.37:0/282268536 >> v2:172.21.15.37:6805/1977556410 conn(0x196ff10 0x195bb50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5128037210 msgr2=0x7f5128039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5128037210 0x7f5128039720 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 msgr2=0x1a04bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x1a04bb0 crc :-1 s=READY pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 shutdown_connections 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 --2- 172.21.15.37:0/282268536 >> v2:172.21.15.37:6805/1977556410 conn(0x196ff10 0x195bb50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5128037210 0x7f5128039720 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 --2- 172.21.15.37:0/282268536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x18d6670 0x1a04bb0 unknown :-1 s=CLOSED pgs=12827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 >> 172.21.15.37:0/282268536 conn(0x17f7960 msgr2=0x18db120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 shutdown_connections 2024-04-23T01:55:22.755 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.752+0000 7f5149091ec0 1 -- 172.21.15.37:0/282268536 wait complete. 2024-04-23T01:55:22.756 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:22.756 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj3 /etc/passwd 2024-04-23T01:55:22.793 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.791+0000 7f474b2c9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.797+0000 7f474b2c9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.797+0000 7f474b2c9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.798+0000 7f474b2c9ec0 1 Processor -- start 2024-04-23T01:55:22.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.798+0000 7f474b2c9ec0 1 -- start start 2024-04-23T01:55:22.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.799+0000 7f474b2c9ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x2161400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.801 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.799+0000 7f474b2c9ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1fad950 con 0x2046ed0 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f474379b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x2161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f474379b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x2161400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53032/0 (socket says 172.21.15.37:53032) 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f474379b640 1 -- 172.21.15.37:0/3935931561 learned_addr learned my addr 172.21.15.37:0/3935931561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f474379b640 1 -- 172.21.15.37:0/3935931561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f4c1e0 con 0x2046ed0 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f474379b640 1 --2- 172.21.15.37:0/3935931561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x2161400 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1a4a31dd937525 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f4741f98640 1 -- 172.21.15.37:0/3935931561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f472c02c8b0 con 0x2046ed0 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f4741f98640 1 -- 172.21.15.37:0/3935931561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f472c02ca10 con 0x2046ed0 2024-04-23T01:55:22.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.800+0000 7f4741f98640 1 -- 172.21.15.37:0/3935931561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f472c02cd10 con 0x2046ed0 2024-04-23T01:55:22.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.801+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/3935931561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 msgr2=0x2161400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.801+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/3935931561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x2161400 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.801+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/3935931561 shutdown_connections 2024-04-23T01:55:22.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.801+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/3935931561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x2161400 unknown :-1 s=CLOSED pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.801+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/3935931561 >> 172.21.15.37:0/3935931561 conn(0x1f64960 msgr2=0x204c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.801+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/3935931561 shutdown_connections 2024-04-23T01:55:22.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.801+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/3935931561 wait complete. 2024-04-23T01:55:22.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.802+0000 7f474b2c9ec0 1 Processor -- start 2024-04-23T01:55:22.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.802+0000 7f474b2c9ec0 1 -- start start 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.803+0000 7f474b2c9ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x216fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.803+0000 7f474b2c9ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1fab3d0 con 0x2046ed0 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.803+0000 7f474379b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x216fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f474379b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x216fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53038/0 (socket says 172.21.15.37:53038) 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f474379b640 1 -- 172.21.15.37:0/2046391380 learned_addr learned my addr 172.21.15.37:0/2046391380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f474379b640 1 -- 172.21.15.37:0/2046391380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f3ee30 con 0x2046ed0 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f474379b640 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x216fb70 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f4740f96640 1 -- 172.21.15.37:0/2046391380 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f472c03d040 con 0x2046ed0 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f4740f96640 1 -- 172.21.15.37:0/2046391380 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f472c038850 con 0x2046ed0 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1f3e890 con 0x2046ed0 2024-04-23T01:55:22.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f4740f96640 1 -- 172.21.15.37:0/2046391380 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f472c038af0 con 0x2046ed0 2024-04-23T01:55:22.807 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.804+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20d9ef0 con 0x2046ed0 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.805+0000 7f4740f96640 1 -- 172.21.15.37:0/2046391380 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f472c040040 con 0x2046ed0 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.805+0000 7f4740f96640 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f47280371c0 0x7f47280396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.805+0000 7f4740f96640 1 -- 172.21.15.37:0/2046391380 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7f472c031040 con 0x2046ed0 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.806+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/2046391380 >> v2:172.21.15.191:6805/3894758024 conn(0x2047ca0 0x20c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.806+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x20c5b30 con 0x2047ca0 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.806+0000 7f4742f9a640 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f47280371c0 0x7f47280396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.806+0000 7f4742f9a640 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f47280371c0 0x7f47280396d0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.806+0000 7f4743f9c640 1 --2- 172.21.15.37:0/2046391380 >> v2:172.21.15.191:6805/3894758024 conn(0x2047ca0 0x20c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:22.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.810+0000 7f4743f9c640 1 --2- 172.21.15.37:0/2046391380 >> v2:172.21.15.191:6805/3894758024 conn(0x2047ca0 0x20c55f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f4743f9c640 1 -- 172.21.15.37:0/2046391380 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 obj3 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f473400a430 con 0x2047ca0 2024-04-23T01:55:22.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 >> v2:172.21.15.191:6805/3894758024 conn(0x2047ca0 msgr2=0x20c55f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/2046391380 >> v2:172.21.15.191:6805/3894758024 conn(0x2047ca0 0x20c55f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f47280371c0 msgr2=0x7f47280396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.823 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f47280371c0 0x7f47280396d0 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 msgr2=0x216fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x216fb70 crc :-1 s=READY pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 shutdown_connections 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/2046391380 >> v2:172.21.15.191:6805/3894758024 conn(0x2047ca0 0x20c55f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f47280371c0 0x7f47280396d0 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 --2- 172.21.15.37:0/2046391380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x2046ed0 0x216fb70 unknown :-1 s=CLOSED pgs=12831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 >> 172.21.15.37:0/2046391380 conn(0x1f64960 msgr2=0x204b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 shutdown_connections 2024-04-23T01:55:22.824 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.821+0000 7f474b2c9ec0 1 -- 172.21.15.37:0/2046391380 wait complete. 2024-04-23T01:55:22.825 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:22.825 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj4 /etc/passwd 2024-04-23T01:55:22.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.860+0000 7fc68715cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.865+0000 7fc68715cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.865+0000 7fc68715cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:22.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.866+0000 7fc68715cec0 1 Processor -- start 2024-04-23T01:55:22.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.866+0000 7fc68715cec0 1 -- start start 2024-04-23T01:55:22.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc68715cec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c8a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc68715cec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1b74950 con 0x1c0f450 2024-04-23T01:55:22.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc67affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c8a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc67affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c8a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53054/0 (socket says 172.21.15.37:53054) 2024-04-23T01:55:22.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc67affd640 1 -- 172.21.15.37:0/3057089919 learned_addr learned my addr 172.21.15.37:0/3057089919 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc67affd640 1 -- 172.21.15.37:0/3057089919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b131e0 con 0x1c0f450 2024-04-23T01:55:22.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc67affd640 1 --2- 172.21.15.37:0/3057089919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c8a090 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b371b0d70c70e27 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.868+0000 7fc679ffb640 1 -- 172.21.15.37:0/3057089919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc66c02c8b0 con 0x1c0f450 2024-04-23T01:55:22.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc679ffb640 1 -- 172.21.15.37:0/3057089919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc66c02ca10 con 0x1c0f450 2024-04-23T01:55:22.871 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc679ffb640 1 -- 172.21.15.37:0/3057089919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc66c02cd10 con 0x1c0f450 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc68715cec0 1 -- 172.21.15.37:0/3057089919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 msgr2=0x1c8a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc68715cec0 1 --2- 172.21.15.37:0/3057089919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c8a090 crc :-1 s=READY pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc68715cec0 1 -- 172.21.15.37:0/3057089919 shutdown_connections 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc68715cec0 1 --2- 172.21.15.37:0/3057089919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c8a090 unknown :-1 s=CLOSED pgs=12834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc68715cec0 1 -- 172.21.15.37:0/3057089919 >> 172.21.15.37:0/3057089919 conn(0x1b2b960 msgr2=0x1c08890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc68715cec0 1 -- 172.21.15.37:0/3057089919 shutdown_connections 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.869+0000 7fc68715cec0 1 -- 172.21.15.37:0/3057089919 wait complete. 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.870+0000 7fc68715cec0 1 Processor -- start 2024-04-23T01:55:22.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.870+0000 7fc68715cec0 1 -- start start 2024-04-23T01:55:22.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc68715cec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c0af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc68715cec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1b723d0 con 0x1c0f450 2024-04-23T01:55:22.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc67affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c0af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc67affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c0af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53058/0 (socket says 172.21.15.37:53058) 2024-04-23T01:55:22.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc67affd640 1 -- 172.21.15.37:0/1436945325 learned_addr learned my addr 172.21.15.37:0/1436945325 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:22.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc67affd640 1 -- 172.21.15.37:0/1436945325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b05e30 con 0x1c0f450 2024-04-23T01:55:22.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc67affd640 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c0af40 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc678ff9640 1 -- 172.21.15.37:0/1436945325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc66c03d040 con 0x1c0f450 2024-04-23T01:55:22.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc678ff9640 1 -- 172.21.15.37:0/1436945325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc66c038790 con 0x1c0f450 2024-04-23T01:55:22.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b05890 con 0x1c0f450 2024-04-23T01:55:22.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc678ff9640 1 -- 172.21.15.37:0/1436945325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc66c038a30 con 0x1c0f450 2024-04-23T01:55:22.875 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.872+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1c9e1e0 con 0x1c0f450 2024-04-23T01:55:22.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.873+0000 7fc678ff9640 1 -- 172.21.15.37:0/1436945325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc66c040040 con 0x1c0f450 2024-04-23T01:55:22.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.874+0000 7fc678ff9640 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc65c037210 0x7fc65c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.874+0000 7fc678ff9640 1 -- 172.21.15.37:0/1436945325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7fc66c031040 con 0x1c0f450 2024-04-23T01:55:22.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.874+0000 7fc68715cec0 1 --2- 172.21.15.37:0/1436945325 >> v2:172.21.15.37:6802/1949701083 conn(0x1ca19c0 0x1c0b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:22.876 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.874+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 --> v2:172.21.15.37:6802/1949701083 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x213d650 con 0x1ca19c0 2024-04-23T01:55:22.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.874+0000 7fc673fff640 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc65c037210 0x7fc65c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:22.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.875+0000 7fc673fff640 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc65c037210 0x7fc65c039720 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:22.877 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.875+0000 7fc67b7fe640 1 --2- 172.21.15.37:0/1436945325 >> v2:172.21.15.37:6802/1949701083 conn(0x1ca19c0 0x1c0b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:22.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:22.878+0000 7fc67b7fe640 1 --2- 172.21.15.37:0/1436945325 >> v2:172.21.15.37:6802/1949701083 conn(0x1ca19c0 0x1c0b990 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.083+0000 7fc67b7fe640 1 -- 172.21.15.37:0/1436945325 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== osd_op_reply(1 obj4 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc67400a430 con 0x1ca19c0 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.083+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 >> v2:172.21.15.37:6802/1949701083 conn(0x1ca19c0 msgr2=0x1c0b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.083+0000 7fc68715cec0 1 --2- 172.21.15.37:0/1436945325 >> v2:172.21.15.37:6802/1949701083 conn(0x1ca19c0 0x1c0b990 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc65c037210 msgr2=0x7fc65c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc65c037210 0x7fc65c039720 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 msgr2=0x1c0af40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c0af40 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.086 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 shutdown_connections 2024-04-23T01:55:23.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 --2- 172.21.15.37:0/1436945325 >> v2:172.21.15.37:6802/1949701083 conn(0x1ca19c0 0x1c0b990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc65c037210 0x7fc65c039720 unknown :-1 s=CLOSED pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 --2- 172.21.15.37:0/1436945325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c0f450 0x1c0af40 unknown :-1 s=CLOSED pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 >> 172.21.15.37:0/1436945325 conn(0x1b2b960 msgr2=0x1c08890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 shutdown_connections 2024-04-23T01:55:23.087 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.084+0000 7fc68715cec0 1 -- 172.21.15.37:0/1436945325 wait complete. 2024-04-23T01:55:23.088 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:23.088 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj5 /etc/passwd 2024-04-23T01:55:23.124 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.122+0000 7fd1a2845ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.128+0000 7fd1a2845ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.128+0000 7fd1a2845ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.130 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.129+0000 7fd1a2845ec0 1 Processor -- start 2024-04-23T01:55:23.131 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.129+0000 7fd1a2845ec0 1 -- start start 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd1a2845ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x21abda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd1a2845ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x2118950 con 0x21b16a0 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd19a99b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x21abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd19a99b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x21abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53074/0 (socket says 172.21.15.37:53074) 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd19a99b640 1 -- 172.21.15.37:0/3113793286 learned_addr learned my addr 172.21.15.37:0/3113793286 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd19a99b640 1 -- 172.21.15.37:0/3113793286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20b71e0 con 0x21b16a0 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd19a99b640 1 --2- 172.21.15.37:0/3113793286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x21abda0 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1801d12ede91dedd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd199198640 1 -- 172.21.15.37:0/3113793286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1840061e0 con 0x21b16a0 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd199198640 1 -- 172.21.15.37:0/3113793286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd184004690 con 0x21b16a0 2024-04-23T01:55:23.133 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.131+0000 7fd199198640 1 -- 172.21.15.37:0/3113793286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd184006340 con 0x21b16a0 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.132+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/3113793286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 msgr2=0x21abda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.132+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/3113793286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x21abda0 crc :-1 s=READY pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.132+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/3113793286 shutdown_connections 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.132+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/3113793286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x21abda0 unknown :-1 s=CLOSED pgs=12838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.132+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/3113793286 >> 172.21.15.37:0/3113793286 conn(0x20cf960 msgr2=0x21b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.132+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/3113793286 shutdown_connections 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.132+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/3113793286 wait complete. 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.133+0000 7fd1a2845ec0 1 Processor -- start 2024-04-23T01:55:23.135 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.133+0000 7fd1a2845ec0 1 -- start start 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd1a2845ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x22b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd1a2845ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x21163d0 con 0x21b16a0 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd19a99b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x22b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd19a99b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x22b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53088/0 (socket says 172.21.15.37:53088) 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd19a99b640 1 -- 172.21.15.37:0/2350077168 learned_addr learned my addr 172.21.15.37:0/2350077168 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd19a99b640 1 -- 172.21.15.37:0/2350077168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20a9e30 con 0x21b16a0 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd19a99b640 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x22b5480 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.137 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd1937fe640 1 -- 172.21.15.37:0/2350077168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd184001ad0 con 0x21b16a0 2024-04-23T01:55:23.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd1937fe640 1 -- 172.21.15.37:0/2350077168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd184001c30 con 0x21b16a0 2024-04-23T01:55:23.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x20a9890 con 0x21b16a0 2024-04-23T01:55:23.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd1937fe640 1 -- 172.21.15.37:0/2350077168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd184001ed0 con 0x21b16a0 2024-04-23T01:55:23.138 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.135+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x22b83a0 con 0x21b16a0 2024-04-23T01:55:23.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.136+0000 7fd1937fe640 1 -- 172.21.15.37:0/2350077168 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd184014410 con 0x21b16a0 2024-04-23T01:55:23.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.137+0000 7fd1937fe640 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd174037210 0x7fd174039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.137+0000 7fd1937fe640 1 -- 172.21.15.37:0/2350077168 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7fd1840486c0 con 0x21b16a0 2024-04-23T01:55:23.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.137+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/2350077168 >> v2:172.21.15.37:6802/1949701083 conn(0x21b1ab0 0x22d8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.137+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 --> v2:172.21.15.37:6802/1949701083 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x22b8a60 con 0x21b1ab0 2024-04-23T01:55:23.139 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.137+0000 7fd19a19a640 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd174037210 0x7fd174039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.137+0000 7fd19a19a640 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd174037210 0x7fd174039720 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.140 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.138+0000 7fd19b19c640 1 --2- 172.21.15.37:0/2350077168 >> v2:172.21.15.37:6802/1949701083 conn(0x21b1ab0 0x22d8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:23.142 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.141+0000 7fd19b19c640 1 --2- 172.21.15.37:0/2350077168 >> v2:172.21.15.37:6802/1949701083 conn(0x21b1ab0 0x22d8660 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.154 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd19b19c640 1 -- 172.21.15.37:0/2350077168 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== osd_op_reply(1 obj5 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd18c00c430 con 0x21b1ab0 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 >> v2:172.21.15.37:6802/1949701083 conn(0x21b1ab0 msgr2=0x22d8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/2350077168 >> v2:172.21.15.37:6802/1949701083 conn(0x21b1ab0 0x22d8660 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd174037210 msgr2=0x7fd174039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd174037210 0x7fd174039720 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 msgr2=0x22b5480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x22b5480 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 shutdown_connections 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.152+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/2350077168 >> v2:172.21.15.37:6802/1949701083 conn(0x21b1ab0 0x22d8660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.153+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd174037210 0x7fd174039720 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.153+0000 7fd1a2845ec0 1 --2- 172.21.15.37:0/2350077168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21b16a0 0x22b5480 unknown :-1 s=CLOSED pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.153+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 >> 172.21.15.37:0/2350077168 conn(0x20cf960 msgr2=0x22cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.153+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 shutdown_connections 2024-04-23T01:55:23.155 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.153+0000 7fd1a2845ec0 1 -- 172.21.15.37:0/2350077168 wait complete. 2024-04-23T01:55:23.156 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:23.156 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj6 /etc/passwd 2024-04-23T01:55:23.193 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.191+0000 7f104dcfaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.197+0000 7f104dcfaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.197+0000 7f104dcfaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.199 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.198+0000 7f104dcfaec0 1 Processor -- start 2024-04-23T01:55:23.200 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.198+0000 7f104dcfaec0 1 -- start start 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f104dcfaec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f104dcfaec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x150d950 con 0x163a9c0 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f104619b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f104619b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53100/0 (socket says 172.21.15.37:53100) 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f104619b640 1 -- 172.21.15.37:0/2956910356 learned_addr learned my addr 172.21.15.37:0/2956910356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f104619b640 1 -- 172.21.15.37:0/2956910356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x14ac1e0 con 0x163a9c0 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f104619b640 1 --2- 172.21.15.37:0/2956910356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a1270 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4c910e665e2276 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f1044998640 1 -- 172.21.15.37:0/2956910356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f103000c5e0 con 0x163a9c0 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f1044998640 1 -- 172.21.15.37:0/2956910356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f103000c740 con 0x163a9c0 2024-04-23T01:55:23.202 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.200+0000 7f1044998640 1 -- 172.21.15.37:0/2956910356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f103000c9e0 con 0x163a9c0 2024-04-23T01:55:23.203 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.201+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2956910356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 msgr2=0x15a1270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.201+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2956910356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a1270 crc :-1 s=READY pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.201+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2956910356 shutdown_connections 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.201+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2956910356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a1270 unknown :-1 s=CLOSED pgs=12842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.201+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2956910356 >> 172.21.15.37:0/2956910356 conn(0x14c4960 msgr2=0x16383f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.201+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2956910356 shutdown_connections 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.201+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2956910356 wait complete. 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.202+0000 7f104dcfaec0 1 Processor -- start 2024-04-23T01:55:23.204 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.202+0000 7f104dcfaec0 1 -- start start 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.203+0000 7f104dcfaec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.203+0000 7f104dcfaec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x150b3d0 con 0x163a9c0 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f104619b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f104619b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53106/0 (socket says 172.21.15.37:53106) 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f104619b640 1 -- 172.21.15.37:0/2105381027 learned_addr learned my addr 172.21.15.37:0/2105381027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f104619b640 1 -- 172.21.15.37:0/2105381027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x149ee30 con 0x163a9c0 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f104619b640 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a3f40 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f103effd640 1 -- 172.21.15.37:0/2105381027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1030013990 con 0x163a9c0 2024-04-23T01:55:23.206 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f103effd640 1 -- 172.21.15.37:0/2105381027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1030013af0 con 0x163a9c0 2024-04-23T01:55:23.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x149e890 con 0x163a9c0 2024-04-23T01:55:23.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f103effd640 1 -- 172.21.15.37:0/2105381027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1030013d90 con 0x163a9c0 2024-04-23T01:55:23.207 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.204+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15a5430 con 0x163a9c0 2024-04-23T01:55:23.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.205+0000 7f103effd640 1 -- 172.21.15.37:0/2105381027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1030010400 con 0x163a9c0 2024-04-23T01:55:23.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.205+0000 7f103effd640 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f102c037210 0x7f102c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.205+0000 7f103effd640 1 -- 172.21.15.37:0/2105381027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7f1030008040 con 0x163a9c0 2024-04-23T01:55:23.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.206+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2105381027 >> v2:172.21.15.191:6808/1018833307 conn(0x163d800 0x16d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.206+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x162aea0 con 0x163d800 2024-04-23T01:55:23.208 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.206+0000 7f104599a640 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f102c037210 0x7f102c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.206+0000 7f104599a640 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f102c037210 0x7f102c039720 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.209 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.207+0000 7f104699c640 1 --2- 172.21.15.37:0/2105381027 >> v2:172.21.15.191:6808/1018833307 conn(0x163d800 0x16d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:23.212 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.211+0000 7f104699c640 1 --2- 172.21.15.37:0/2105381027 >> v2:172.21.15.191:6808/1018833307 conn(0x163d800 0x16d1a10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.465+0000 7f104699c640 1 -- 172.21.15.37:0/2105381027 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== osd_op_reply(1 obj6 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f103800a430 con 0x163d800 2024-04-23T01:55:23.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 >> v2:172.21.15.191:6808/1018833307 conn(0x163d800 msgr2=0x16d1a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2105381027 >> v2:172.21.15.191:6808/1018833307 conn(0x163d800 0x16d1a10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f102c037210 msgr2=0x7f102c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f102c037210 0x7f102c039720 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 msgr2=0x15a3f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.468 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a3f40 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 shutdown_connections 2024-04-23T01:55:23.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2105381027 >> v2:172.21.15.191:6808/1018833307 conn(0x163d800 0x16d1a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f102c037210 0x7f102c039720 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 --2- 172.21.15.37:0/2105381027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x163a9c0 0x15a3f40 unknown :-1 s=CLOSED pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 >> 172.21.15.37:0/2105381027 conn(0x14c4960 msgr2=0x15a3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 shutdown_connections 2024-04-23T01:55:23.469 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.466+0000 7f104dcfaec0 1 -- 172.21.15.37:0/2105381027 wait complete. 2024-04-23T01:55:23.470 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:23.470 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj7 /etc/passwd 2024-04-23T01:55:23.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.505+0000 7fae51730ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.511+0000 7fae51730ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.511+0000 7fae51730ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.512+0000 7fae51730ec0 1 Processor -- start 2024-04-23T01:55:23.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.512+0000 7fae51730ec0 1 -- start start 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae51730ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1ad8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae51730ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x19c2950 con 0x1a5d450 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae49b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1ad8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae49b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1ad8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53122/0 (socket says 172.21.15.37:53122) 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae49b9b640 1 -- 172.21.15.37:0/1127141741 learned_addr learned my addr 172.21.15.37:0/1127141741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae49b9b640 1 -- 172.21.15.37:0/1127141741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19611e0 con 0x1a5d450 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae49b9b640 1 --2- 172.21.15.37:0/1127141741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1ad8090 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3097031a523e2a4d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae437fe640 1 -- 172.21.15.37:0/1127141741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae3c032040 con 0x1a5d450 2024-04-23T01:55:23.517 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae437fe640 1 -- 172.21.15.37:0/1127141741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fae3c00a040 con 0x1a5d450 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.514+0000 7fae437fe640 1 -- 172.21.15.37:0/1127141741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae3c00a2e0 con 0x1a5d450 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.515+0000 7fae51730ec0 1 -- 172.21.15.37:0/1127141741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 msgr2=0x1ad8090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.515+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1127141741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1ad8090 crc :-1 s=READY pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.515+0000 7fae51730ec0 1 -- 172.21.15.37:0/1127141741 shutdown_connections 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.515+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1127141741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1ad8090 unknown :-1 s=CLOSED pgs=12846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.515+0000 7fae51730ec0 1 -- 172.21.15.37:0/1127141741 >> 172.21.15.37:0/1127141741 conn(0x1979960 msgr2=0x1a56890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.515+0000 7fae51730ec0 1 -- 172.21.15.37:0/1127141741 shutdown_connections 2024-04-23T01:55:23.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.515+0000 7fae51730ec0 1 -- 172.21.15.37:0/1127141741 wait complete. 2024-04-23T01:55:23.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.516+0000 7fae51730ec0 1 Processor -- start 2024-04-23T01:55:23.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.516+0000 7fae51730ec0 1 -- start start 2024-04-23T01:55:23.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae51730ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1adb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae51730ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x19c03d0 con 0x1a5d450 2024-04-23T01:55:23.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae49b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1adb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae49b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1adb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53126/0 (socket says 172.21.15.37:53126) 2024-04-23T01:55:23.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae49b9b640 1 -- 172.21.15.37:0/1144617789 learned_addr learned my addr 172.21.15.37:0/1144617789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae49b9b640 1 -- 172.21.15.37:0/1144617789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1953e30 con 0x1a5d450 2024-04-23T01:55:23.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae49b9b640 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1adb3b0 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae427fc640 1 -- 172.21.15.37:0/1144617789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae3c02d650 con 0x1a5d450 2024-04-23T01:55:23.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae427fc640 1 -- 172.21.15.37:0/1144617789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fae3c02d7b0 con 0x1a5d450 2024-04-23T01:55:23.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1953890 con 0x1a5d450 2024-04-23T01:55:23.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae427fc640 1 -- 172.21.15.37:0/1144617789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae3c02da50 con 0x1a5d450 2024-04-23T01:55:23.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.518+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ade810 con 0x1a5d450 2024-04-23T01:55:23.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.519+0000 7fae427fc640 1 -- 172.21.15.37:0/1144617789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fae3c02dc00 con 0x1a5d450 2024-04-23T01:55:23.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.520+0000 7fae427fc640 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fae24037210 0x7fae24039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.520+0000 7fae427fc640 1 -- 172.21.15.37:0/1144617789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7fae3c032040 con 0x1a5d450 2024-04-23T01:55:23.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.520+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1144617789 >> v2:172.21.15.191:6808/1018833307 conn(0x1aef9c0 0x1b845f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.520+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x1adefb0 con 0x1aef9c0 2024-04-23T01:55:23.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.520+0000 7fae4939a640 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fae24037210 0x7fae24039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.520+0000 7fae4939a640 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fae24037210 0x7fae24039720 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.521+0000 7fae4a39c640 1 --2- 172.21.15.37:0/1144617789 >> v2:172.21.15.191:6808/1018833307 conn(0x1aef9c0 0x1b845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:23.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.523+0000 7fae4a39c640 1 --2- 172.21.15.37:0/1144617789 >> v2:172.21.15.191:6808/1018833307 conn(0x1aef9c0 0x1b845f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.535 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae4a39c640 1 -- 172.21.15.37:0/1144617789 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== osd_op_reply(1 obj7 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fae3400a430 con 0x1aef9c0 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 >> v2:172.21.15.191:6808/1018833307 conn(0x1aef9c0 msgr2=0x1b845f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1144617789 >> v2:172.21.15.191:6808/1018833307 conn(0x1aef9c0 0x1b845f0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fae24037210 msgr2=0x7fae24039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fae24037210 0x7fae24039720 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 msgr2=0x1adb3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1adb3b0 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 shutdown_connections 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1144617789 >> v2:172.21.15.191:6808/1018833307 conn(0x1aef9c0 0x1b845f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fae24037210 0x7fae24039720 unknown :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 --2- 172.21.15.37:0/1144617789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1a5d450 0x1adb3b0 unknown :-1 s=CLOSED pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 >> 172.21.15.37:0/1144617789 conn(0x1979960 msgr2=0x1a56890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.533+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 shutdown_connections 2024-04-23T01:55:23.536 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.534+0000 7fae51730ec0 1 -- 172.21.15.37:0/1144617789 wait complete. 2024-04-23T01:55:23.537 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:23.537 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj8 /etc/passwd 2024-04-23T01:55:23.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.572+0000 7fda9ea44ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.578+0000 7fda9ea44ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.579 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.578+0000 7fda9ea44ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.579+0000 7fda9ea44ec0 1 Processor -- start 2024-04-23T01:55:23.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.579+0000 7fda9ea44ec0 1 -- start start 2024-04-23T01:55:23.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.580+0000 7fda9ea44ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x1961590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.580+0000 7fda9ea44ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1837950 con 0x19649c0 2024-04-23T01:55:23.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.580+0000 7fda96b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x1961590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.580+0000 7fda96b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x1961590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53148/0 (socket says 172.21.15.37:53148) 2024-04-23T01:55:23.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.580+0000 7fda96b9b640 1 -- 172.21.15.37:0/3197304799 learned_addr learned my addr 172.21.15.37:0/3197304799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda96b9b640 1 -- 172.21.15.37:0/3197304799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17d61e0 con 0x19649c0 2024-04-23T01:55:23.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda96b9b640 1 --2- 172.21.15.37:0/3197304799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x1961590 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c541879c8d59a390 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda95398640 1 -- 172.21.15.37:0/3197304799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda8000b5d0 con 0x19649c0 2024-04-23T01:55:23.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda95398640 1 -- 172.21.15.37:0/3197304799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda8000b730 con 0x19649c0 2024-04-23T01:55:23.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda95398640 1 -- 172.21.15.37:0/3197304799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda8000b9d0 con 0x19649c0 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/3197304799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 msgr2=0x1961590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/3197304799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x1961590 crc :-1 s=READY pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.581+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/3197304799 shutdown_connections 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.582+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/3197304799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x1961590 unknown :-1 s=CLOSED pgs=12850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.582+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/3197304799 >> 172.21.15.37:0/3197304799 conn(0x17ee960 msgr2=0x1966700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.582+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/3197304799 shutdown_connections 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.582+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/3197304799 wait complete. 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.583+0000 7fda9ea44ec0 1 Processor -- start 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.583+0000 7fda9ea44ec0 1 -- start start 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.584+0000 7fda9ea44ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x19ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.584+0000 7fda9ea44ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x18353d0 con 0x19649c0 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.584+0000 7fda96b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x19ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.584+0000 7fda96b9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x19ecdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53156/0 (socket says 172.21.15.37:53156) 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.584+0000 7fda96b9b640 1 -- 172.21.15.37:0/1105704326 learned_addr learned my addr 172.21.15.37:0/1105704326 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.584+0000 7fda96b9b640 1 -- 172.21.15.37:0/1105704326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x17c8e30 con 0x19649c0 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.585+0000 7fda96b9b640 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x19ecdd0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.585+0000 7fda8f7fe640 1 -- 172.21.15.37:0/1105704326 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda80012910 con 0x19649c0 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.585+0000 7fda8f7fe640 1 -- 172.21.15.37:0/1105704326 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda80005040 con 0x19649c0 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.585+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x17c8890 con 0x19649c0 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.585+0000 7fda8f7fe640 1 -- 172.21.15.37:0/1105704326 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda80012ba0 con 0x19649c0 2024-04-23T01:55:23.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.585+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x18cca60 con 0x19649c0 2024-04-23T01:55:23.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.586+0000 7fda8f7fe640 1 -- 172.21.15.37:0/1105704326 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fda8000d040 con 0x19649c0 2024-04-23T01:55:23.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.586+0000 7fda8f7fe640 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fda7c037210 0x7fda7c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.586+0000 7fda8f7fe640 1 -- 172.21.15.37:0/1105704326 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7fda8000a040 con 0x19649c0 2024-04-23T01:55:23.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.586+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/1105704326 >> v2:172.21.15.191:6808/1018833307 conn(0x1967800 0x19f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.586+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x19ef020 con 0x1967800 2024-04-23T01:55:23.589 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.586+0000 7fda9639a640 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fda7c037210 0x7fda7c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.587+0000 7fda9639a640 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fda7c037210 0x7fda7c039720 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.590 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.587+0000 7fda9739c640 1 --2- 172.21.15.37:0/1105704326 >> v2:172.21.15.191:6808/1018833307 conn(0x1967800 0x19f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:23.592 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.590+0000 7fda9739c640 1 --2- 172.21.15.37:0/1105704326 >> v2:172.21.15.191:6808/1018833307 conn(0x1967800 0x19f98e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9739c640 1 -- 172.21.15.37:0/1105704326 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== osd_op_reply(1 obj8 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fda8800a430 con 0x1967800 2024-04-23T01:55:23.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 >> v2:172.21.15.191:6808/1018833307 conn(0x1967800 msgr2=0x19f98e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/1105704326 >> v2:172.21.15.191:6808/1018833307 conn(0x1967800 0x19f98e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fda7c037210 msgr2=0x7fda7c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fda7c037210 0x7fda7c039720 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 msgr2=0x19ecdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x19ecdd0 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 shutdown_connections 2024-04-23T01:55:23.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/1105704326 >> v2:172.21.15.191:6808/1018833307 conn(0x1967800 0x19f98e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fda7c037210 0x7fda7c039720 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 --2- 172.21.15.37:0/1105704326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x19649c0 0x19ecdd0 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 >> 172.21.15.37:0/1105704326 conn(0x17ee960 msgr2=0x1966700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 shutdown_connections 2024-04-23T01:55:23.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.601+0000 7fda9ea44ec0 1 -- 172.21.15.37:0/1105704326 wait complete. 2024-04-23T01:55:23.605 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:23.605 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj9 /etc/passwd 2024-04-23T01:55:23.641 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.639+0000 7fd7dec38ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.645+0000 7fd7dec38ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.647 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.645+0000 7fd7dec38ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.646+0000 7fd7dec38ec0 1 Processor -- start 2024-04-23T01:55:23.648 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.646+0000 7fd7dec38ec0 1 -- start start 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7dec38ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x94a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7dec38ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x81a950 con 0x947570 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d6d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x94a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d6d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x94a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53178/0 (socket says 172.21.15.37:53178) 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d6d9b640 1 -- 172.21.15.37:0/3110822522 learned_addr learned my addr 172.21.15.37:0/3110822522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d6d9b640 1 -- 172.21.15.37:0/3110822522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7b91e0 con 0x947570 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d6d9b640 1 --2- 172.21.15.37:0/3110822522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x94a7a0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f189e68f62edd15 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d5598640 1 -- 172.21.15.37:0/3110822522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd7c000c490 con 0x947570 2024-04-23T01:55:23.651 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d5598640 1 -- 172.21.15.37:0/3110822522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd7c000c5f0 con 0x947570 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.648+0000 7fd7d5598640 1 -- 172.21.15.37:0/3110822522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd7c000c890 con 0x947570 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.649+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/3110822522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 msgr2=0x94a7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.649+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/3110822522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x94a7a0 crc :-1 s=READY pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.649+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/3110822522 shutdown_connections 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.649+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/3110822522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x94a7a0 unknown :-1 s=CLOSED pgs=12854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.649+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/3110822522 >> 172.21.15.37:0/3110822522 conn(0x7d1960 msgr2=0x8acce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.649+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/3110822522 shutdown_connections 2024-04-23T01:55:23.652 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.649+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/3110822522 wait complete. 2024-04-23T01:55:23.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.650+0000 7fd7dec38ec0 1 Processor -- start 2024-04-23T01:55:23.653 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.650+0000 7fd7dec38ec0 1 -- start start 2024-04-23T01:55:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7dec38ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x9e0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7dec38ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x8183d0 con 0x947570 2024-04-23T01:55:23.655 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7d6d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x9e0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7d6d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x9e0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53192/0 (socket says 172.21.15.37:53192) 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7d6d9b640 1 -- 172.21.15.37:0/4209308420 learned_addr learned my addr 172.21.15.37:0/4209308420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7d6d9b640 1 -- 172.21.15.37:0/4209308420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7abe30 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7d6d9b640 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x9e0cf0 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7cf7fe640 1 -- 172.21.15.37:0/4209308420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd7c00110b0 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7cf7fe640 1 -- 172.21.15.37:0/4209308420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd7c0011210 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ab890 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7cf7fe640 1 -- 172.21.15.37:0/4209308420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd7c0011b00 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.652+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x9364b0 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.653+0000 7fd7cf7fe640 1 -- 172.21.15.37:0/4209308420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd7c0011cb0 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.653+0000 7fd7cf7fe640 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd7bc037210 0x7fd7bc039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.654+0000 7fd7cf7fe640 1 -- 172.21.15.37:0/4209308420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7fd7c0048bd0 con 0x947570 2024-04-23T01:55:23.656 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.654+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/4209308420 >> v2:172.21.15.37:6805/1977556410 conn(0x948090 0x934040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.654+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 --> v2:172.21.15.37:6805/1977556410 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x937380 con 0x948090 2024-04-23T01:55:23.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.654+0000 7fd7d659a640 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd7bc037210 0x7fd7bc039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.654+0000 7fd7d659a640 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd7bc037210 0x7fd7bc039720 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.657 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.655+0000 7fd7d759c640 1 --2- 172.21.15.37:0/4209308420 >> v2:172.21.15.37:6805/1977556410 conn(0x948090 0x934040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:23.659 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.658+0000 7fd7d759c640 1 --2- 172.21.15.37:0/4209308420 >> v2:172.21.15.37:6805/1977556410 conn(0x948090 0x934040 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7d759c640 1 -- 172.21.15.37:0/4209308420 <== osd.1 v2:172.21.15.37:6805/1977556410 1 ==== osd_op_reply(1 obj9 [writefull 0~11876] v692'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd7c800a430 con 0x948090 2024-04-23T01:55:23.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 >> v2:172.21.15.37:6805/1977556410 conn(0x948090 msgr2=0x934040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/4209308420 >> v2:172.21.15.37:6805/1977556410 conn(0x948090 0x934040 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd7bc037210 msgr2=0x7fd7bc039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd7bc037210 0x7fd7bc039720 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 msgr2=0x9e0cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x9e0cf0 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 shutdown_connections 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/4209308420 >> v2:172.21.15.37:6805/1977556410 conn(0x948090 0x934040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd7bc037210 0x7fd7bc039720 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 --2- 172.21.15.37:0/4209308420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x947570 0x9e0cf0 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 >> 172.21.15.37:0/4209308420 conn(0x7d1960 msgr2=0x8acce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 shutdown_connections 2024-04-23T01:55:23.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.670+0000 7fd7dec38ec0 1 -- 172.21.15.37:0/4209308420 wait complete. 2024-04-23T01:55:23.674 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:55:23.674 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put obj10 /etc/passwd 2024-04-23T01:55:23.710 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.709+0000 7f1bcd07aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.714+0000 7f1bcd07aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.714+0000 7f1bcd07aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:23.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.715+0000 7f1bcd07aec0 1 Processor -- start 2024-04-23T01:55:23.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.715+0000 7f1bcd07aec0 1 -- start start 2024-04-23T01:55:23.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.717+0000 7f1bcd07aec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x21aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.717+0000 7f1bcd07aec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x212f950 con 0x21c86a0 2024-04-23T01:55:23.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.717+0000 7f1bc519b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x21aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.717+0000 7f1bc519b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x21aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53224/0 (socket says 172.21.15.37:53224) 2024-04-23T01:55:23.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.717+0000 7f1bc519b640 1 -- 172.21.15.37:0/4083290229 learned_addr learned my addr 172.21.15.37:0/4083290229 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.717+0000 7f1bc519b640 1 -- 172.21.15.37:0/4083290229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20ce1e0 con 0x21c86a0 2024-04-23T01:55:23.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.717+0000 7f1bc519b640 1 --2- 172.21.15.37:0/4083290229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x21aefd0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fecaba896555c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bbeffd640 1 -- 172.21.15.37:0/4083290229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1bb800c5e0 con 0x21c86a0 2024-04-23T01:55:23.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bbeffd640 1 -- 172.21.15.37:0/4083290229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1bb800c740 con 0x21c86a0 2024-04-23T01:55:23.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bbeffd640 1 -- 172.21.15.37:0/4083290229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1bb800c9e0 con 0x21c86a0 2024-04-23T01:55:23.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/4083290229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 msgr2=0x21aefd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/4083290229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x21aefd0 crc :-1 s=READY pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/4083290229 shutdown_connections 2024-04-23T01:55:23.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/4083290229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x21aefd0 unknown :-1 s=CLOSED pgs=12858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/4083290229 >> 172.21.15.37:0/4083290229 conn(0x20e6960 msgr2=0x22e4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/4083290229 shutdown_connections 2024-04-23T01:55:23.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.718+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/4083290229 wait complete. 2024-04-23T01:55:23.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.719+0000 7f1bcd07aec0 1 Processor -- start 2024-04-23T01:55:23.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.719+0000 7f1bcd07aec0 1 -- start start 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bcd07aec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x22f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bcd07aec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x212d3d0 con 0x21c86a0 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bc519b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x22f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bc519b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x22f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53226/0 (socket says 172.21.15.37:53226) 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bc519b640 1 -- 172.21.15.37:0/1739759727 learned_addr learned my addr 172.21.15.37:0/1739759727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bc519b640 1 -- 172.21.15.37:0/1739759727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20c0e30 con 0x21c86a0 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bc519b640 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x22f1b20 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bbdffb640 1 -- 172.21.15.37:0/1739759727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1bb8013a10 con 0x21c86a0 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.721+0000 7f1bbdffb640 1 -- 172.21.15.37:0/1739759727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1bb8013b70 con 0x21c86a0 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.722+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x20c0890 con 0x21c86a0 2024-04-23T01:55:23.725 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.722+0000 7f1bbdffb640 1 -- 172.21.15.37:0/1739759727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1bb8013e10 con 0x21c86a0 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.722+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x22d14b0 con 0x21c86a0 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.722+0000 7f1bbdffb640 1 -- 172.21.15.37:0/1739759727 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1bb8010400 con 0x21c86a0 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.723+0000 7f1bbdffb640 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1bac037210 0x7f1bac039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.723+0000 7f1bbdffb640 1 -- 172.21.15.37:0/1739759727 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(692..692 src has 609..692) ==== 3791+0+0 (crc 0 0 0) 0x7f1bb8008040 con 0x21c86a0 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.723+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/1739759727 >> v2:172.21.15.191:6805/3894758024 conn(0x21c8ab0 0x22cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.723+0000 7f1bc499a640 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1bac037210 0x7f1bac039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.723+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e692) -- 0x22e0da0 con 0x21c8ab0 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.723+0000 7f1bc499a640 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1bac037210 0x7f1bac039720 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.724+0000 7f1bc599c640 1 --2- 172.21.15.37:0/1739759727 >> v2:172.21.15.191:6805/3894758024 conn(0x21c8ab0 0x22cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:23.728 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.727+0000 7f1bc599c640 1 --2- 172.21.15.37:0/1739759727 >> v2:172.21.15.191:6805/3894758024 conn(0x21c8ab0 0x22cd4e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:23.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bc599c640 1 -- 172.21.15.37:0/1739759727 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 obj10 [writefull 0~11876] v692'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f1bb000a430 con 0x21c8ab0 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 >> v2:172.21.15.191:6805/3894758024 conn(0x21c8ab0 msgr2=0x22cd4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/1739759727 >> v2:172.21.15.191:6805/3894758024 conn(0x21c8ab0 0x22cd4e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1bac037210 msgr2=0x7f1bac039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1bac037210 0x7f1bac039720 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 msgr2=0x22f1b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x22f1b20 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 shutdown_connections 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/1739759727 >> v2:172.21.15.191:6805/3894758024 conn(0x21c8ab0 0x22cd4e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1bac037210 0x7f1bac039720 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 --2- 172.21.15.37:0/1739759727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x21c86a0 0x22f1b20 unknown :-1 s=CLOSED pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 >> 172.21.15.37:0/1739759727 conn(0x20e6960 msgr2=0x22e4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 shutdown_connections 2024-04-23T01:55:23.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:23.738+0000 7f1bcd07aec0 1 -- 172.21.15.37:0/1739759727 wait complete. 2024-04-23T01:55:23.742 INFO:tasks.workunit.client.0.smithi037.stderr:+ sleep 30 2024-04-23T01:55:53.746 INFO:tasks.workunit.client.0.smithi037.stderr:+ pid=96546 2024-04-23T01:55:53.746 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota d506dafc-2d08-46f3-8878-f69f9e013c29 max_objects 100 2024-04-23T01:55:53.746 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put onemore /etc/passwd 2024-04-23T01:55:53.788 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.786+0000 7f985c032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:53.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.793+0000 7f985c032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:53.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.793+0000 7f985c032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:53.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.794+0000 7f985c032ec0 1 Processor -- start 2024-04-23T01:55:53.795 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.794+0000 7f985c032ec0 1 -- start start 2024-04-23T01:55:53.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.795+0000 7f985c032ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xef5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:53.797 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.795+0000 7f985c032ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xe61950 con 0xf8e9c0 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xef5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xef5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38204/0 (socket says 172.21.15.37:38204) 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984f7fe640 1 -- 172.21.15.37:0/1128811737 learned_addr learned my addr 172.21.15.37:0/1128811737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984f7fe640 1 -- 172.21.15.37:0/1128811737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe001e0 con 0xf8e9c0 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984f7fe640 1 --2- 172.21.15.37:0/1128811737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xef5270 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88846f413b72f99 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984dffb640 1 -- 172.21.15.37:0/1128811737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f983800c5e0 con 0xf8e9c0 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984dffb640 1 -- 172.21.15.37:0/1128811737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f983800c740 con 0xf8e9c0 2024-04-23T01:55:53.798 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.796+0000 7f984dffb640 1 -- 172.21.15.37:0/1128811737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f983800c9e0 con 0xf8e9c0 2024-04-23T01:55:53.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.797+0000 7f985c032ec0 1 -- 172.21.15.37:0/1128811737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 msgr2=0xef5270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:53.799 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.797+0000 7f985c032ec0 1 --2- 172.21.15.37:0/1128811737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xef5270 crc :-1 s=READY pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:53.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.797+0000 7f985c032ec0 1 -- 172.21.15.37:0/1128811737 shutdown_connections 2024-04-23T01:55:53.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.797+0000 7f985c032ec0 1 --2- 172.21.15.37:0/1128811737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xef5270 unknown :-1 s=CLOSED pgs=12862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:53.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.797+0000 7f985c032ec0 1 -- 172.21.15.37:0/1128811737 >> 172.21.15.37:0/1128811737 conn(0xe18960 msgr2=0xf8c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:53.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.797+0000 7f985c032ec0 1 -- 172.21.15.37:0/1128811737 shutdown_connections 2024-04-23T01:55:53.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.797+0000 7f985c032ec0 1 -- 172.21.15.37:0/1128811737 wait complete. 2024-04-23T01:55:53.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.799+0000 7f985c032ec0 1 Processor -- start 2024-04-23T01:55:53.800 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.799+0000 7f985c032ec0 1 -- start start 2024-04-23T01:55:53.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.800+0000 7f985c032ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xf79190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:53.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.800+0000 7f985c032ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xe5f3d0 con 0xf8e9c0 2024-04-23T01:55:53.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.801+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xf79190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:53.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.801+0000 7f984f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xf79190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38220/0 (socket says 172.21.15.37:38220) 2024-04-23T01:55:53.803 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.801+0000 7f984f7fe640 1 -- 172.21.15.37:0/3602117976 learned_addr learned my addr 172.21.15.37:0/3602117976 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.801+0000 7f984f7fe640 1 -- 172.21.15.37:0/3602117976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xdf2e30 con 0xf8e9c0 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.801+0000 7f984f7fe640 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xf79190 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.802+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9838013990 con 0xf8e9c0 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.802+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9838013af0 con 0xf8e9c0 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.802+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9838013d90 con 0xf8e9c0 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.802+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xdf2890 con 0xf8e9c0 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.802+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf7c600 con 0xf8e9c0 2024-04-23T01:55:53.804 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.803+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9838010400 con 0xf8e9c0 2024-04-23T01:55:53.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.803+0000 7f984cff9640 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9830037210 0x7f9830039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:53.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.804+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(694..694 src has 609..694) ==== 3791+0+0 (crc 0 0 0) 0x7f9838008040 con 0xf8e9c0 2024-04-23T01:55:53.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.804+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=695}) -- 0x7f983003d480 con 0xf8e9c0 2024-04-23T01:55:53.805 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.804+0000 7f985c032ec0 1 --2- 172.21.15.37:0/3602117976 >> v2:172.21.15.191:6808/1018833307 conn(0xf91800 0x1427a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:53.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.804+0000 7f984effd640 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9830037210 0x7f9830039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:53.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.805+0000 7f984effd640 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9830037210 0x7f9830039720 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:53.806 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.805+0000 7f985499c640 1 --2- 172.21.15.37:0/3602117976 >> v2:172.21.15.191:6808/1018833307 conn(0xf91800 0x1427a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:53.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.810+0000 7f985499c640 1 --2- 172.21.15.37:0/3602117976 >> v2:172.21.15.191:6808/1018833307 conn(0xf91800 0x1427a20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:53.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.843+0000 7f877159d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:53.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.853+0000 7f877159d640 1 Processor -- start 2024-04-23T01:55:53.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.853+0000 7f877159d640 1 -- start start 2024-04-23T01:55:53.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f877159d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f876c09b460 0x7f876c134f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:53.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f877159d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876c134c80 con 0x7f876c1354d0 2024-04-23T01:55:53.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f877159d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f876c09bf20 con 0x7f876c09b460 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f876affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f876c09b460 0x7f876c134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f876a7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f876c1354d0 0x7f876c1315a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41078/0 (socket says 172.21.15.37:41078) 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f876affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f876c09b460 0x7f876c134f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38232/0 (socket says 172.21.15.37:38232) 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f876a7fc640 1 -- 172.21.15.37:0/2382211612 learned_addr learned my addr 172.21.15.37:0/2382211612 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f876affd640 1 -- 172.21.15.37:0/2382211612 >> v1:172.21.15.37:6789/0 conn(0x7f876c1354d0 legacy=0x7f876c1315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.855+0000 7f876affd640 1 -- 172.21.15.37:0/2382211612 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c09c8d0 con 0x7f876c09b460 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.856+0000 7f876affd640 1 --2- 172.21.15.37:0/2382211612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c09b460 0x7f876c134f90 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59eb4b6765d0bdd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.856+0000 7f8769ffb640 1 -- 172.21.15.37:0/2382211612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f875c009d90 con 0x7f876c09b460 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.856+0000 7f8769ffb640 1 -- 172.21.15.37:0/2382211612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f875c00e230 con 0x7f876c09b460 2024-04-23T01:55:53.858 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.856+0000 7f8769ffb640 1 -- 172.21.15.37:0/2382211612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f875c00e4d0 con 0x7f876c09b460 2024-04-23T01:55:53.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.856+0000 7f877159d640 1 -- 172.21.15.37:0/2382211612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c09b460 msgr2=0x7f876c134f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:53.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.856+0000 7f877159d640 1 --2- 172.21.15.37:0/2382211612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c09b460 0x7f876c134f90 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:53.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.856+0000 7f877159d640 1 -- 172.21.15.37:0/2382211612 shutdown_connections 2024-04-23T01:55:53.859 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.857+0000 7f877159d640 1 --2- 172.21.15.37:0/2382211612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c09b460 0x7f876c134f90 unknown :-1 s=CLOSED pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:53.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.857+0000 7f877159d640 1 -- 172.21.15.37:0/2382211612 >> 172.21.15.37:0/2382211612 conn(0x7f876c0a3c00 msgr2=0x7f876c0a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:53.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.857+0000 7f877159d640 1 -- 172.21.15.37:0/2382211612 shutdown_connections 2024-04-23T01:55:53.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.857+0000 7f877159d640 1 -- 172.21.15.37:0/2382211612 wait complete. 2024-04-23T01:55:53.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.857+0000 7f877159d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:53.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.859+0000 7f877159d640 1 Processor -- start 2024-04-23T01:55:53.860 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.859+0000 7f877159d640 1 -- start start 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.860+0000 7f877159d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c1354d0 0x7f876c120f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.860+0000 7f877159d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f876c125110 con 0x7f876c1354d0 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f876affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c1354d0 0x7f876c120f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f876affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c1354d0 0x7f876c120f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38246/0 (socket says 172.21.15.37:38246) 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f876affd640 1 -- 172.21.15.37:0/93490645 learned_addr learned my addr 172.21.15.37:0/93490645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f876affd640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c132070 con 0x7f876c1354d0 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f876affd640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c1354d0 0x7f876c120f10 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:53.863 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f875c014540 con 0x7f876c1354d0 2024-04-23T01:55:53.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f875c0146a0 con 0x7f876c1354d0 2024-04-23T01:55:53.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c123400 con 0x7f876c1354d0 2024-04-23T01:55:53.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f875c014940 con 0x7f876c1354d0 2024-04-23T01:55:53.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.861+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c124580 con 0x7f876c1354d0 2024-04-23T01:55:53.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.862+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f875c014af0 con 0x7f876c1354d0 2024-04-23T01:55:53.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.862+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c123830 con 0x7f876c1354d0 2024-04-23T01:55:53.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.863+0000 7f87537fe640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8758038980 0x7f875803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:53.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.863+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(694..694 src has 609..694) ==== 3791+0+0 (crc 0 0 0) 0x7f875c019040 con 0x7f876c1354d0 2024-04-23T01:55:53.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.863+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=695}) -- 0x7f875803eb90 con 0x7f876c1354d0 2024-04-23T01:55:53.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.863+0000 7f876a7fc640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8758038980 0x7f875803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:53.865 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.863+0000 7f876a7fc640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8758038980 0x7f875803ae90 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:53.870 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:53.868+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f875c018190 con 0x7f876c1354d0 2024-04-23T01:55:54.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:54.058+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "100"} v 0) -- 0x7f876c132260 con 0x7f876c1354d0 2024-04-23T01:55:54.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:54.420+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v695) ==== 225+0+0 (crc 0 0 0) 0x7f875c00faf0 con 0x7f876c1354d0 2024-04-23T01:55:54.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:54.420+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(695..695 src has 609..695) ==== 628+0+0 (crc 0 0 0) 0x7f875c014da0 con 0x7f876c1354d0 2024-04-23T01:55:54.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:54.420+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 6 ==== osd_map(695..695 src has 609..695) ==== 628+0+0 (crc 0 0 0) 0x7f9838014e50 con 0xf8e9c0 2024-04-23T01:55:54.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:54.421+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=696}) -- 0x7f875803f980 con 0x7f876c1354d0 2024-04-23T01:55:54.422 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:54.421+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=696}) -- 0x7f983003db10 con 0xf8e9c0 2024-04-23T01:55:54.558 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:54.557+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "100"} v 0) -- 0x7f876c132260 con 0x7f876c1354d0 2024-04-23T01:55:55.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.424+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v696) ==== 225+0+0 (crc 0 0 0) 0x7f875c00fcd0 con 0x7f876c1354d0 2024-04-23T01:55:55.426 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_objects = 100 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:55:55.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.424+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 <== mon.0 v2:172.21.15.37:3300/0 10 ==== osd_map(696..696 src has 609..696) ==== 628+0+0 (crc 0 0 0) 0x7f875c0136e0 con 0x7f876c1354d0 2024-04-23T01:55:55.426 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.424+0000 7f87537fe640 1 -- 172.21.15.37:0/93490645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7f875803fbd0 con 0x7f876c1354d0 2024-04-23T01:55:55.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.424+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 7 ==== osd_map(696..696 src has 609..696) ==== 628+0+0 (crc 0 0 0) 0x7f9838015e30 con 0xf8e9c0 2024-04-23T01:55:55.427 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.424+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7f983003dd30 con 0xf8e9c0 2024-04-23T01:55:55.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8758038980 msgr2=0x7f875803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:55.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8758038980 0x7f875803ae90 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:55.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c1354d0 msgr2=0x7f876c120f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:55.429 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c1354d0 0x7f876c120f10 crc :-1 s=READY pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:55.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 shutdown_connections 2024-04-23T01:55:55.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8758038980 0x7f875803ae90 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:55.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 --2- 172.21.15.37:0/93490645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c1354d0 0x7f876c120f10 unknown :-1 s=CLOSED pgs=12866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:55.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 >> 172.21.15.37:0/93490645 conn(0x7f876c0a3c00 msgr2=0x7f876c1335b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:55.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.427+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 shutdown_connections 2024-04-23T01:55:55.430 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:55.428+0000 7f877159d640 1 -- 172.21.15.37:0/93490645 wait complete. 2024-04-23T01:55:55.440 INFO:tasks.workunit.client.0.smithi037.stderr:+ wait 96546 2024-04-23T01:55:57.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.407+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(697..697 src has 609..697) ==== 628+0+0 (crc 0 0 0) 0x7f983800a220 con 0xf8e9c0 2024-04-23T01:55:57.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.407+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7f983003dd30 con 0xf8e9c0 2024-04-23T01:55:57.409 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.407+0000 7f984cff9640 1 -- 172.21.15.37:0/3602117976 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:1 200.5 200:b9ff7440:::onemore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x7f983003df80 con 0xf91800 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985499c640 1 -- 172.21.15.37:0/3602117976 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== osd_op_reply(1 onemore [writefull 0~11876] v697'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f984800a430 con 0xf91800 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 >> v2:172.21.15.191:6808/1018833307 conn(0xf91800 msgr2=0x1427a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 --2- 172.21.15.37:0/3602117976 >> v2:172.21.15.191:6808/1018833307 conn(0xf91800 0x1427a20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9830037210 msgr2=0x7f9830039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9830037210 0x7f9830039720 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 msgr2=0xf79190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xf79190 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 shutdown_connections 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 --2- 172.21.15.37:0/3602117976 >> v2:172.21.15.191:6808/1018833307 conn(0xf91800 0x1427a20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9830037210 0x7f9830039720 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 --2- 172.21.15.37:0/3602117976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf8e9c0 0xf79190 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.659+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 >> 172.21.15.37:0/3602117976 conn(0xe18960 msgr2=0xef7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:57.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.660+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 shutdown_connections 2024-04-23T01:55:57.663 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.660+0000 7f985c032ec0 1 -- 172.21.15.37:0/3602117976 wait complete. 2024-04-23T01:55:57.664 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -ne 0 ']' 2024-04-23T01:55:57.664 INFO:tasks.workunit.client.0.smithi037.stderr:+ true 2024-04-23T01:55:57.664 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put twomore /etc/passwd 2024-04-23T01:55:57.706 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.705+0000 7f55ba261ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:57.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.711+0000 7f55ba261ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:57.712 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.711+0000 7f55ba261ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:57.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.712+0000 7f55ba261ec0 1 Processor -- start 2024-04-23T01:55:57.713 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.712+0000 7f55ba261ec0 1 -- start start 2024-04-23T01:55:57.715 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.713+0000 7f55ba261ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x2619400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.713+0000 7f55ba261ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x2465950 con 0x24feed0 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.713+0000 7f55b239b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x2619400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.713+0000 7f55b239b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x2619400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38264/0 (socket says 172.21.15.37:38264) 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.713+0000 7f55b239b640 1 -- 172.21.15.37:0/3983573998 learned_addr learned my addr 172.21.15.37:0/3983573998 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.714+0000 7f55b239b640 1 -- 172.21.15.37:0/3983573998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24041e0 con 0x24feed0 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.714+0000 7f55b239b640 1 --2- 172.21.15.37:0/3983573998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x2619400 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3565df2690cb2af server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.714+0000 7f55b0b98640 1 -- 172.21.15.37:0/3983573998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f559c032040 con 0x24feed0 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.714+0000 7f55b0b98640 1 -- 172.21.15.37:0/3983573998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f559c00a040 con 0x24feed0 2024-04-23T01:55:57.716 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.714+0000 7f55b0b98640 1 -- 172.21.15.37:0/3983573998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f559c00a1b0 con 0x24feed0 2024-04-23T01:55:57.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.715+0000 7f55ba261ec0 1 -- 172.21.15.37:0/3983573998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 msgr2=0x2619400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.717 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.715+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/3983573998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x2619400 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.715+0000 7f55ba261ec0 1 -- 172.21.15.37:0/3983573998 shutdown_connections 2024-04-23T01:55:57.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.715+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/3983573998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x2619400 unknown :-1 s=CLOSED pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.715+0000 7f55ba261ec0 1 -- 172.21.15.37:0/3983573998 >> 172.21.15.37:0/3983573998 conn(0x241c960 msgr2=0x2504320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:57.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.715+0000 7f55ba261ec0 1 -- 172.21.15.37:0/3983573998 shutdown_connections 2024-04-23T01:55:57.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.715+0000 7f55ba261ec0 1 -- 172.21.15.37:0/3983573998 wait complete. 2024-04-23T01:55:57.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.716+0000 7f55ba261ec0 1 Processor -- start 2024-04-23T01:55:57.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.716+0000 7f55ba261ec0 1 -- start start 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.717+0000 7f55ba261ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x257d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.717+0000 7f55ba261ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x24633d0 con 0x24feed0 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55b239b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x257d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55b239b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x257d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38274/0 (socket says 172.21.15.37:38274) 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55b239b640 1 -- 172.21.15.37:0/2321366496 learned_addr learned my addr 172.21.15.37:0/2321366496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55b239b640 1 -- 172.21.15.37:0/2321366496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x23f6e30 con 0x24feed0 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55b239b640 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x257d7a0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:57.720 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55aaffd640 1 -- 172.21.15.37:0/2321366496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f559c02d780 con 0x24feed0 2024-04-23T01:55:57.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55aaffd640 1 -- 172.21.15.37:0/2321366496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f559c02d8e0 con 0x24feed0 2024-04-23T01:55:57.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x23f6890 con 0x24feed0 2024-04-23T01:55:57.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55aaffd640 1 -- 172.21.15.37:0/2321366496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f559c02db80 con 0x24feed0 2024-04-23T01:55:57.721 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.718+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2580b80 con 0x24feed0 2024-04-23T01:55:57.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.719+0000 7f55aaffd640 1 -- 172.21.15.37:0/2321366496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f559c02dd30 con 0x24feed0 2024-04-23T01:55:57.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.720+0000 7f55aaffd640 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5598037210 0x7f5598039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:57.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.720+0000 7f55aaffd640 1 -- 172.21.15.37:0/2321366496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(697..697 src has 609..697) ==== 3791+0+0 (crc 0 0 0) 0x7f559c032040 con 0x24feed0 2024-04-23T01:55:57.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.720+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/2321366496 >> v2:172.21.15.191:6805/3894758024 conn(0x24ffca0 0x2590c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:57.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.720+0000 7f55b1b9a640 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5598037210 0x7f5598039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:57.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.720+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 200.6 200:7019d845:::twomore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e697) -- 0x2581130 con 0x24ffca0 2024-04-23T01:55:57.722 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.720+0000 7f55b1b9a640 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5598037210 0x7f5598039720 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:57.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.721+0000 7f55b2b9c640 1 --2- 172.21.15.37:0/2321366496 >> v2:172.21.15.191:6805/3894758024 conn(0x24ffca0 0x2590c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:55:57.726 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.724+0000 7f55b2b9c640 1 --2- 172.21.15.37:0/2321366496 >> v2:172.21.15.191:6805/3894758024 conn(0x24ffca0 0x2590c30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55b2b9c640 1 -- 172.21.15.37:0/2321366496 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 twomore [writefull 0~11876] v697'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f55a400a430 con 0x24ffca0 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 >> v2:172.21.15.191:6805/3894758024 conn(0x24ffca0 msgr2=0x2590c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/2321366496 >> v2:172.21.15.191:6805/3894758024 conn(0x24ffca0 0x2590c30 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5598037210 msgr2=0x7f5598039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5598037210 0x7f5598039720 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 msgr2=0x257d7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x257d7a0 crc :-1 s=READY pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 shutdown_connections 2024-04-23T01:55:57.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/2321366496 >> v2:172.21.15.191:6805/3894758024 conn(0x24ffca0 0x2590c30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f5598037210 0x7f5598039720 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 --2- 172.21.15.37:0/2321366496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x24feed0 0x257d7a0 unknown :-1 s=CLOSED pgs=12870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 >> 172.21.15.37:0/2321366496 conn(0x241c960 msgr2=0x25038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:57.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 shutdown_connections 2024-04-23T01:55:57.739 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.736+0000 7f55ba261ec0 1 -- 172.21.15.37:0/2321366496 wait complete. 2024-04-23T01:55:57.740 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota d506dafc-2d08-46f3-8878-f69f9e013c29 max_bytes 100 2024-04-23T01:55:57.839 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.829+0000 7fe78a31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:57.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.839+0000 7fe78a31d640 1 Processor -- start 2024-04-23T01:55:57.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.839+0000 7fe78a31d640 1 -- start start 2024-04-23T01:55:57.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.840+0000 7fe78a31d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe784135a30 0x7fe784137e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:57.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe78a31d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7840720d0 con 0x7fe78412e510 2024-04-23T01:55:57.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe78a31d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe78412f030 con 0x7fe784135a30 2024-04-23T01:55:57.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe7837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe784135a30 0x7fe784137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:57.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe7837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe784135a30 0x7fe784137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38290/0 (socket says 172.21.15.37:38290) 2024-04-23T01:55:57.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe783fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe78412e510 0x7fe78412e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41088/0 (socket says 172.21.15.37:41088) 2024-04-23T01:55:57.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe7837fe640 1 -- 172.21.15.37:0/3300732163 learned_addr learned my addr 172.21.15.37:0/3300732163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:57.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe7837fe640 1 -- 172.21.15.37:0/3300732163 >> v1:172.21.15.37:6789/0 conn(0x7fe78412e510 legacy=0x7fe78412e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe7837fe640 1 -- 172.21.15.37:0/3300732163 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe784073a00 con 0x7fe784135a30 2024-04-23T01:55:57.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe7837fe640 1 --2- 172.21.15.37:0/3300732163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe784135a30 0x7fe784137e50 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb3ca38c2766d34 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:57.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe782ffd640 1 -- 172.21.15.37:0/3300732163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe774009e50 con 0x7fe784135a30 2024-04-23T01:55:57.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe782ffd640 1 -- 172.21.15.37:0/3300732163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe77400e230 con 0x7fe784135a30 2024-04-23T01:55:57.844 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.841+0000 7fe782ffd640 1 -- 172.21.15.37:0/3300732163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe77400e4d0 con 0x7fe784135a30 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 1 -- 172.21.15.37:0/3300732163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe784135a30 msgr2=0x7fe784137e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 1 --2- 172.21.15.37:0/3300732163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe784135a30 0x7fe784137e50 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 1 -- 172.21.15.37:0/3300732163 shutdown_connections 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 1 --2- 172.21.15.37:0/3300732163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe784135a30 0x7fe784137e50 unknown :-1 s=CLOSED pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 1 -- 172.21.15.37:0/3300732163 >> 172.21.15.37:0/3300732163 conn(0x7fe7840a1850 msgr2=0x7fe7840a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 1 -- 172.21.15.37:0/3300732163 shutdown_connections 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 1 -- 172.21.15.37:0/3300732163 wait complete. 2024-04-23T01:55:57.845 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.842+0000 7fe78a31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:55:57.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.844+0000 7fe78a31d640 1 Processor -- start 2024-04-23T01:55:57.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.844+0000 7fe78a31d640 1 -- start start 2024-04-23T01:55:57.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.846+0000 7fe78a31d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe78412e510 0x7fe78411b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:57.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.846+0000 7fe78a31d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe78411e1c0 con 0x7fe78412e510 2024-04-23T01:55:57.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.846+0000 7fe783fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe78412e510 0x7fe78411b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:57.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.846+0000 7fe783fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe78412e510 0x7fe78411b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38296/0 (socket says 172.21.15.37:38296) 2024-04-23T01:55:57.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.846+0000 7fe783fff640 1 -- 172.21.15.37:0/1832811499 learned_addr learned my addr 172.21.15.37:0/1832811499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:55:57.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.846+0000 7fe783fff640 1 -- 172.21.15.37:0/1832811499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78412dfa0 con 0x7fe78412e510 2024-04-23T01:55:57.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.846+0000 7fe783fff640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe78412e510 0x7fe78411b000 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:57.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.847+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe7780059a0 con 0x7fe78412e510 2024-04-23T01:55:57.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.847+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe778005b00 con 0x7fe78412e510 2024-04-23T01:55:57.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.847+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe778005da0 con 0x7fe78412e510 2024-04-23T01:55:57.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.847+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78411cfc0 con 0x7fe78412e510 2024-04-23T01:55:57.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.847+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78412dc00 con 0x7fe78412e510 2024-04-23T01:55:57.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.848+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fe7780070b0 con 0x7fe78412e510 2024-04-23T01:55:57.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.848+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe78411eac0 con 0x7fe78412e510 2024-04-23T01:55:57.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.848+0000 7fe780ff9640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fe770038980 0x7fe77003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:55:57.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.848+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(697..697 src has 609..697) ==== 3791+0+0 (crc 0 0 0) 0x7fe7780485e0 con 0x7fe78412e510 2024-04-23T01:55:57.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.848+0000 7fe7837fe640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fe770038980 0x7fe77003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:55:57.850 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.849+0000 7fe7837fe640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fe770038980 0x7fe77003ae90 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:55:57.855 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:57.853+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fe77800d330 con 0x7fe78412e510 2024-04-23T01:55:58.049 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:58.047+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "100"} v 0) -- 0x7fe7840697f0 con 0x7fe78412e510 2024-04-23T01:55:58.438 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:58.436+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v698) ==== 221+0+0 (crc 0 0 0) 0x7fe77800d150 con 0x7fe78412e510 2024-04-23T01:55:58.571 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:58.569+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "100"} v 0) -- 0x7fe7840008d0 con 0x7fe78412e510 2024-04-23T01:55:59.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.437+0000 7fe780ff9640 1 -- 172.21.15.37:0/1832811499 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v699) ==== 221+0+0 (crc 0 0 0) 0x7fe77800d150 con 0x7fe78412e510 2024-04-23T01:55:59.439 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_bytes = 100 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:55:59.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fe770038980 msgr2=0x7fe77003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:59.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fe770038980 0x7fe77003ae90 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:59.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe78412e510 msgr2=0x7fe78411b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:55:59.442 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe78412e510 0x7fe78411b000 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:59.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 shutdown_connections 2024-04-23T01:55:59.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fe770038980 0x7fe77003ae90 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:59.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 --2- 172.21.15.37:0/1832811499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe78412e510 0x7fe78411b000 unknown :-1 s=CLOSED pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:55:59.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 >> 172.21.15.37:0/1832811499 conn(0x7fe7840a1850 msgr2=0x7fe784070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:55:59.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 shutdown_connections 2024-04-23T01:55:59.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:55:59.440+0000 7fe78a31d640 1 -- 172.21.15.37:0/1832811499 wait complete. 2024-04-23T01:55:59.454 INFO:tasks.workunit.client.0.smithi037.stderr:+ sleep 30 2024-04-23T01:56:29.457 INFO:tasks.workunit.client.0.smithi037.stderr:+ pid=96637 2024-04-23T01:56:29.457 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota d506dafc-2d08-46f3-8878-f69f9e013c29 max_bytes 0 2024-04-23T01:56:29.457 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put two /etc/passwd 2024-04-23T01:56:29.503 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.501+0000 7fc6cf839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.508+0000 7fc6cf839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:29.509 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.508+0000 7fc6cf839ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:29.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.509+0000 7fc6cf839ec0 1 Processor -- start 2024-04-23T01:56:29.511 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.509+0000 7fc6cf839ec0 1 -- start start 2024-04-23T01:56:29.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.511+0000 7fc6cf839ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x1038410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:29.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.511+0000 7fc6cf839ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xfa2950 con 0x103bed0 2024-04-23T01:56:29.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.511+0000 7fc6c2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x1038410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:29.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.511+0000 7fc6c2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x1038410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59060/0 (socket says 172.21.15.37:59060) 2024-04-23T01:56:29.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.511+0000 7fc6c2ffd640 1 -- 172.21.15.37:0/2504786739 learned_addr learned my addr 172.21.15.37:0/2504786739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:29.513 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.511+0000 7fc6c2ffd640 1 -- 172.21.15.37:0/2504786739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf411e0 con 0x103bed0 2024-04-23T01:56:29.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.512+0000 7fc6c2ffd640 1 --2- 172.21.15.37:0/2504786739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x1038410 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b8e3225bafc77f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:29.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.512+0000 7fc6c17fa640 1 -- 172.21.15.37:0/2504786739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b400b5d0 con 0x103bed0 2024-04-23T01:56:29.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.512+0000 7fc6c17fa640 1 -- 172.21.15.37:0/2504786739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc6b400b730 con 0x103bed0 2024-04-23T01:56:29.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.512+0000 7fc6c17fa640 1 -- 172.21.15.37:0/2504786739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b400b9d0 con 0x103bed0 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.513+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/2504786739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 msgr2=0x1038410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.513+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/2504786739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x1038410 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.513+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/2504786739 shutdown_connections 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.513+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/2504786739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x1038410 unknown :-1 s=CLOSED pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.513+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/2504786739 >> 172.21.15.37:0/2504786739 conn(0xf59960 msgr2=0x10d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.513+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/2504786739 shutdown_connections 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.513+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/2504786739 wait complete. 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.514+0000 7fc6cf839ec0 1 Processor -- start 2024-04-23T01:56:29.516 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.514+0000 7fc6cf839ec0 1 -- start start 2024-04-23T01:56:29.521 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.516+0000 7fc6cf839ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x10bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:29.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.516+0000 7fc6cf839ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xfa03d0 con 0x103bed0 2024-04-23T01:56:29.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.516+0000 7fc6c2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x10bb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:29.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.516+0000 7fc6c2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x10bb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59064/0 (socket says 172.21.15.37:59064) 2024-04-23T01:56:29.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.516+0000 7fc6c2ffd640 1 -- 172.21.15.37:0/3093946173 learned_addr learned my addr 172.21.15.37:0/3093946173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:29.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.517+0000 7fc6c2ffd640 1 -- 172.21.15.37:0/3093946173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf33e30 con 0x103bed0 2024-04-23T01:56:29.522 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.517+0000 7fc6c2ffd640 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x10bb9c0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:29.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.517+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b4012940 con 0x103bed0 2024-04-23T01:56:29.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.517+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc6b4005040 con 0x103bed0 2024-04-23T01:56:29.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.517+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xf33890 con 0x103bed0 2024-04-23T01:56:29.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.517+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc6b4012bd0 con 0x103bed0 2024-04-23T01:56:29.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.517+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x10bce10 con 0x103bed0 2024-04-23T01:56:29.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.518+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc6b400d040 con 0x103bed0 2024-04-23T01:56:29.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.518+0000 7fc6abfff640 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc6b0037210 0x7fc6b0039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:29.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.518+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(700..700 src has 609..700) ==== 3791+0+0 (crc 0 0 0) 0x7fc6b400a040 con 0x103bed0 2024-04-23T01:56:29.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.519+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7fc6b003d480 con 0x103bed0 2024-04-23T01:56:29.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.519+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/3093946173 >> v2:172.21.15.191:6805/3894758024 conn(0x10d26f0 0x10cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:29.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.519+0000 7fc6c27fc640 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc6b0037210 0x7fc6b0039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:29.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.520+0000 7fc6c27fc640 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc6b0037210 0x7fc6b0039720 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:29.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.520+0000 7fc6c37fe640 1 --2- 172.21.15.37:0/3093946173 >> v2:172.21.15.191:6805/3894758024 conn(0x10d26f0 0x10cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:56:29.526 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.523+0000 7fc6c37fe640 1 --2- 172.21.15.37:0/3093946173 >> v2:172.21.15.191:6805/3894758024 conn(0x10d26f0 0x10cd050 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:29.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.555+0000 7f126f91d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:29.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.565+0000 7f126f91d640 1 Processor -- start 2024-04-23T01:56:29.566 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.565+0000 7f126f91d640 1 -- start start 2024-04-23T01:56:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126f91d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12681356a0 0x7f1268139e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126f91d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1268134c80 con 0x7f126809b460 2024-04-23T01:56:29.569 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126f91d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f126809bf20 con 0x7f12681356a0 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126ceb8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12681356a0 0x7f1268139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126d6b9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f126809b460 0x7f1268134f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39724/0 (socket says 172.21.15.37:39724) 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126ceb8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12681356a0 0x7f1268139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59076/0 (socket says 172.21.15.37:59076) 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126d6b9640 1 -- 172.21.15.37:0/3392192931 learned_addr learned my addr 172.21.15.37:0/3392192931 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126ceb8640 1 -- 172.21.15.37:0/3392192931 >> v1:172.21.15.37:6789/0 conn(0x7f126809b460 legacy=0x7f1268134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126ceb8640 1 -- 172.21.15.37:0/3392192931 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126809c8d0 con 0x7f12681356a0 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f126ceb8640 1 --2- 172.21.15.37:0/3392192931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f1268139e80 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7748a458a99b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.567+0000 7f125ffff640 1 -- 172.21.15.37:0/3392192931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1258009d90 con 0x7f12681356a0 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f125ffff640 1 -- 172.21.15.37:0/3392192931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f125800e230 con 0x7f12681356a0 2024-04-23T01:56:29.570 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f125ffff640 1 -- 172.21.15.37:0/3392192931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f125800e4d0 con 0x7f12681356a0 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f126f91d640 1 -- 172.21.15.37:0/3392192931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 msgr2=0x7f1268139e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f126f91d640 1 --2- 172.21.15.37:0/3392192931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f1268139e80 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f126f91d640 1 -- 172.21.15.37:0/3392192931 shutdown_connections 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f126f91d640 1 --2- 172.21.15.37:0/3392192931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f1268139e80 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f126f91d640 1 -- 172.21.15.37:0/3392192931 >> 172.21.15.37:0/3392192931 conn(0x7f12680a3c00 msgr2=0x7f12680a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f126f91d640 1 -- 172.21.15.37:0/3392192931 shutdown_connections 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.568+0000 7f126f91d640 1 -- 172.21.15.37:0/3392192931 wait complete. 2024-04-23T01:56:29.572 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.569+0000 7f126f91d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:29.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.570+0000 7f126f91d640 1 Processor -- start 2024-04-23T01:56:29.573 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.570+0000 7f126f91d640 1 -- start start 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.572+0000 7f126f91d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f12681c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.572+0000 7f126f91d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12681bf2f0 con 0x7f12681356a0 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.572+0000 7f126d6b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f12681c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.572+0000 7f126d6b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f12681c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57154/0 (socket says 172.21.15.37:57154) 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.572+0000 7f126d6b9640 1 -- 172.21.15.37:0/139067770 learned_addr learned my addr 172.21.15.37:0/139067770 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.572+0000 7f126d6b9640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1268132410 con 0x7f12681356a0 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.572+0000 7f126d6b9640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f12681c97c0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.573+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1264005a60 con 0x7f12681356a0 2024-04-23T01:56:29.575 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.573+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1264005bc0 con 0x7f12681356a0 2024-04-23T01:56:29.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.573+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12681209b0 con 0x7f12681356a0 2024-04-23T01:56:29.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.573+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1264005e60 con 0x7f12681356a0 2024-04-23T01:56:29.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.573+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12680a08d0 con 0x7f12681356a0 2024-04-23T01:56:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.574+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f126400c780 con 0x7f12681356a0 2024-04-23T01:56:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.574+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12680697f0 con 0x7f12681356a0 2024-04-23T01:56:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.574+0000 7f125dffb640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f124c038980 0x7f124c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.574+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(700..700 src has 609..700) ==== 3791+0+0 (crc 0 0 0) 0x7f1264048660 con 0x7f12681356a0 2024-04-23T01:56:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.574+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7f124c03eb90 con 0x7f12681356a0 2024-04-23T01:56:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.574+0000 7f126ceb8640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f124c038980 0x7f124c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:29.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.575+0000 7f126ceb8640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f124c038980 0x7f124c03ae90 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:29.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.579+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f126400d330 con 0x7f12681356a0 2024-04-23T01:56:29.769 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:29.767+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"} v 0) -- 0x7f12680681a0 con 0x7f12681356a0 2024-04-23T01:56:30.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:30.477+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v701) ==== 217+0+0 (crc 0 0 0) 0x7f126400d150 con 0x7f12681356a0 2024-04-23T01:56:30.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:30.478+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 6 ==== osd_map(701..701 src has 609..701) ==== 628+0+0 (crc 0 0 0) 0x7fc6b4004e30 con 0x103bed0 2024-04-23T01:56:30.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:30.478+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(701..701 src has 609..701) ==== 628+0+0 (crc 0 0 0) 0x7f126400d510 con 0x7f12681356a0 2024-04-23T01:56:30.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:30.478+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7f124c03fb40 con 0x7f12681356a0 2024-04-23T01:56:30.480 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:30.478+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7fc6b003db10 con 0x103bed0 2024-04-23T01:56:30.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:30.593+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"} v 0) -- 0x7f12680a0550 con 0x7f12681356a0 2024-04-23T01:56:31.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.479+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v702) ==== 217+0+0 (crc 0 0 0) 0x7f126400d150 con 0x7f12681356a0 2024-04-23T01:56:31.481 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_bytes = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:56:31.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.479+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 <== mon.0 v2:172.21.15.37:3300/0 10 ==== osd_map(702..702 src has 609..702) ==== 628+0+0 (crc 0 0 0) 0x7f12640090b0 con 0x7f12681356a0 2024-04-23T01:56:31.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.479+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 7 ==== osd_map(702..702 src has 609..702) ==== 628+0+0 (crc 0 0 0) 0x7fc6b400b000 con 0x103bed0 2024-04-23T01:56:31.481 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.479+0000 7f125dffb640 1 -- 172.21.15.37:0/139067770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f124c03fbf0 con 0x7f12681356a0 2024-04-23T01:56:31.482 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.479+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7fc6b003dd30 con 0x103bed0 2024-04-23T01:56:31.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f124c038980 msgr2=0x7f124c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:31.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f124c038980 0x7f124c03ae90 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:31.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 msgr2=0x7f12681c97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:31.483 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f12681c97c0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:31.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 shutdown_connections 2024-04-23T01:56:31.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f124c038980 0x7f124c03ae90 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:31.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 --2- 172.21.15.37:0/139067770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12681356a0 0x7f12681c97c0 unknown :-1 s=CLOSED pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:31.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 >> 172.21.15.37:0/139067770 conn(0x7f12680a3c00 msgr2=0x7f12680a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:31.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 shutdown_connections 2024-04-23T01:56:31.484 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.481+0000 7f126f91d640 1 -- 172.21.15.37:0/139067770 wait complete. 2024-04-23T01:56:31.494 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota d506dafc-2d08-46f3-8878-f69f9e013c29 max_objects 0 2024-04-23T01:56:31.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.584+0000 7f59de46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:31.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.594+0000 7f59de46d640 1 Processor -- start 2024-04-23T01:56:31.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.594+0000 7f59de46d640 1 -- start start 2024-04-23T01:56:31.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59de46d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59d80707f0 0x7f59d8070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:31.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59de46d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59d8072390 con 0x7f59d8071140 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59de46d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f59d8071bb0 con 0x7f59d80707f0 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59d80707f0 0x7f59d8070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f59d8071140 0x7f59d812c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49762/0 (socket says 172.21.15.37:49762) 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59d80707f0 0x7f59d8070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57162/0 (socket says 172.21.15.37:57162) 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d77fe640 1 -- 172.21.15.37:0/3820378345 learned_addr learned my addr 172.21.15.37:0/3820378345 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d7fff640 1 -- 172.21.15.37:0/3820378345 >> v1:172.21.15.37:6789/0 conn(0x7f59d8071140 legacy=0x7f59d812c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d7fff640 1 -- 172.21.15.37:0/3820378345 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d8072050 con 0x7f59d80707f0 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d6ffd640 1 -- 172.21.15.37:0/3820378345 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352083874 0 0) 0x7f59d8072390 con 0x7f59d8071140 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.596+0000 7f59d7fff640 1 --2- 172.21.15.37:0/3820378345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d8070c00 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8846645b6a150f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59d6ffd640 1 -- 172.21.15.37:0/3820378345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59c0009d90 con 0x7f59d80707f0 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59d6ffd640 1 -- 172.21.15.37:0/3820378345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59c000e230 con 0x7f59d80707f0 2024-04-23T01:56:31.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59d6ffd640 1 -- 172.21.15.37:0/3820378345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59c000e4d0 con 0x7f59d80707f0 2024-04-23T01:56:31.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59de46d640 1 -- 172.21.15.37:0/3820378345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 msgr2=0x7f59d8070c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:31.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59de46d640 1 --2- 172.21.15.37:0/3820378345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d8070c00 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59de46d640 1 -- 172.21.15.37:0/3820378345 shutdown_connections 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59de46d640 1 --2- 172.21.15.37:0/3820378345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d8070c00 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59de46d640 1 -- 172.21.15.37:0/3820378345 >> 172.21.15.37:0/3820378345 conn(0x7f59d80a1a20 msgr2=0x7f59d80a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59de46d640 1 -- 172.21.15.37:0/3820378345 shutdown_connections 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.597+0000 7f59de46d640 1 -- 172.21.15.37:0/3820378345 wait complete. 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.598+0000 7f59de46d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.599+0000 7f59de46d640 1 Processor -- start 2024-04-23T01:56:31.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.600+0000 7f59de46d640 1 -- start start 2024-04-23T01:56:31.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59de46d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d81c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:31.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59de46d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59d811e800 con 0x7f59d80707f0 2024-04-23T01:56:31.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d81c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:31.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d81c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57178/0 (socket says 172.21.15.37:57178) 2024-04-23T01:56:31.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d7fff640 1 -- 172.21.15.37:0/1604215118 learned_addr learned my addr 172.21.15.37:0/1604215118 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:31.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d7fff640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d811fb40 con 0x7f59d80707f0 2024-04-23T01:56:31.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d7fff640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d81c4050 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:31.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59c0013610 con 0x7f59d80707f0 2024-04-23T01:56:31.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59c0013770 con 0x7f59d80707f0 2024-04-23T01:56:31.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d81c3d40 con 0x7f59d80707f0 2024-04-23T01:56:31.606 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59c0013a10 con 0x7f59d80707f0 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.602+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d81c3950 con 0x7f59d80707f0 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.603+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f59c0013bc0 con 0x7f59d80707f0 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.603+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d80697f0 con 0x7f59d80707f0 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.603+0000 7f59d4ff9640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f59b8038980 0x7f59b803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.603+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(702..702 src has 609..702) ==== 3791+0+0 (crc 0 0 0) 0x7f59c0018040 con 0x7f59d80707f0 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.603+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f59b803eb90 con 0x7f59d80707f0 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.603+0000 7f59d77fe640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f59b8038980 0x7f59b803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:31.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.604+0000 7f59d77fe640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f59b8038980 0x7f59b803ae90 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:31.610 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.608+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f59c0012390 con 0x7f59d80707f0 2024-04-23T01:56:31.853 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:31.851+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"} v 0) -- 0x7f59d811e570 con 0x7f59d80707f0 2024-04-23T01:56:32.414 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.412+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v703) ==== 221+0+0 (crc 0 0 0) 0x7f59c0018a50 con 0x7f59d80707f0 2024-04-23T01:56:32.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.412+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(703..703 src has 609..703) ==== 628+0+0 (crc 0 0 0) 0x7f59c0018e30 con 0x7f59d80707f0 2024-04-23T01:56:32.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.412+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(703..703 src has 609..703) ==== 628+0+0 (crc 0 0 0) 0x7fc6b4003e20 con 0x103bed0 2024-04-23T01:56:32.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.412+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7f59b803fb40 con 0x7f59d80707f0 2024-04-23T01:56:32.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.412+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7fc6b003df50 con 0x103bed0 2024-04-23T01:56:32.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.412+0000 7fc6abfff640 1 -- 172.21.15.37:0/3093946173 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 200.6 200:6b5d76a5:::two:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x7fc6b003e140 con 0x10d26f0 2024-04-23T01:56:32.527 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.525+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"} v 0) -- 0x7f59d80008d0 con 0x7f59d80707f0 2024-04-23T01:56:32.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6c37fe640 1 -- 172.21.15.37:0/3093946173 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 two [writefull 0~11876] v703'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fc6bc00a430 con 0x10d26f0 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 >> v2:172.21.15.191:6805/3894758024 conn(0x10d26f0 msgr2=0x10cd050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/3093946173 >> v2:172.21.15.191:6805/3894758024 conn(0x10d26f0 0x10cd050 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc6b0037210 msgr2=0x7fc6b0039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc6b0037210 0x7fc6b0039720 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 msgr2=0x10bb9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x10bb9c0 crc :-1 s=READY pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 shutdown_connections 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/3093946173 >> v2:172.21.15.191:6805/3894758024 conn(0x10d26f0 0x10cd050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc6b0037210 0x7fc6b0039720 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 --2- 172.21.15.37:0/3093946173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x103bed0 0x10bb9c0 unknown :-1 s=CLOSED pgs=12877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 >> 172.21.15.37:0/3093946173 conn(0xf59960 msgr2=0x10d06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:32.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 shutdown_connections 2024-04-23T01:56:32.596 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:32.592+0000 7fc6cf839ec0 1 -- 172.21.15.37:0/3093946173 wait complete. 2024-04-23T01:56:33.500 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.498+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v704) ==== 221+0+0 (crc 0 0 0) 0x7f59c0018c30 con 0x7f59d80707f0 2024-04-23T01:56:33.500 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_objects = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:56:33.502 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.500+0000 7f59d4ff9640 1 -- 172.21.15.37:0/1604215118 <== mon.0 v2:172.21.15.37:3300/0 10 ==== osd_map(704..704 src has 609..704) ==== 628+0+0 (crc 0 0 0) 0x7f59c0006750 con 0x7f59d80707f0 2024-04-23T01:56:33.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f59b8038980 msgr2=0x7f59b803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:33.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f59b8038980 0x7f59b803ae90 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 msgr2=0x7f59d81c4050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:33.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d81c4050 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 shutdown_connections 2024-04-23T01:56:33.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f59b8038980 0x7f59b803ae90 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.504 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 --2- 172.21.15.37:0/1604215118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59d80707f0 0x7f59d81c4050 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 >> 172.21.15.37:0/1604215118 conn(0x7f59d80a1a20 msgr2=0x7f59d81325c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:33.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 shutdown_connections 2024-04-23T01:56:33.505 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.502+0000 7f59de46d640 1 -- 172.21.15.37:0/1604215118 wait complete. 2024-04-23T01:56:33.520 INFO:tasks.workunit.client.0.smithi037.stderr:+ wait 96637 2024-04-23T01:56:33.520 INFO:tasks.workunit.client.0.smithi037.stderr:+ '[' 0 -ne 0 ']' 2024-04-23T01:56:33.520 INFO:tasks.workunit.client.0.smithi037.stderr:+ true 2024-04-23T01:56:33.520 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put three /etc/passwd 2024-04-23T01:56:33.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.581+0000 7f77e0866ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.591+0000 7f77e0866ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:33.593 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.591+0000 7f77e0866ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:33.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.593+0000 7f77e0866ec0 1 Processor -- start 2024-04-23T01:56:33.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.593+0000 7f77e0866ec0 1 -- start start 2024-04-23T01:56:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.595+0000 7f77e0866ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xa61bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.596+0000 7f77e0866ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x9ce950 con 0xa676a0 2024-04-23T01:56:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.596+0000 7f77d899b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xa61bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:33.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.596+0000 7f77d899b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xa61bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57208/0 (socket says 172.21.15.37:57208) 2024-04-23T01:56:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.596+0000 7f77d899b640 1 -- 172.21.15.37:0/351141950 learned_addr learned my addr 172.21.15.37:0/351141950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:33.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.596+0000 7f77d899b640 1 -- 172.21.15.37:0/351141950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x96d1e0 con 0xa676a0 2024-04-23T01:56:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.596+0000 7f77d899b640 1 --2- 172.21.15.37:0/351141950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xa61bb0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8decc3a6ae911ec0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.597+0000 7f77d27fc640 1 -- 172.21.15.37:0/351141950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77c400c490 con 0xa676a0 2024-04-23T01:56:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.597+0000 7f77d27fc640 1 -- 172.21.15.37:0/351141950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f77c400c5f0 con 0xa676a0 2024-04-23T01:56:33.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.597+0000 7f77d27fc640 1 -- 172.21.15.37:0/351141950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77c400c490 con 0xa676a0 2024-04-23T01:56:33.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.598+0000 7f77e0866ec0 1 -- 172.21.15.37:0/351141950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 msgr2=0xa61bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:33.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.598+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/351141950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xa61bb0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.598+0000 7f77e0866ec0 1 -- 172.21.15.37:0/351141950 shutdown_connections 2024-04-23T01:56:33.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.598+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/351141950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xa61bb0 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.600 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.598+0000 7f77e0866ec0 1 -- 172.21.15.37:0/351141950 >> 172.21.15.37:0/351141950 conn(0x985960 msgr2=0xa68d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:33.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.599+0000 7f77e0866ec0 1 -- 172.21.15.37:0/351141950 shutdown_connections 2024-04-23T01:56:33.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.599+0000 7f77e0866ec0 1 -- 172.21.15.37:0/351141950 wait complete. 2024-04-23T01:56:33.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.600+0000 7f77e0866ec0 1 Processor -- start 2024-04-23T01:56:33.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.600+0000 7f77e0866ec0 1 -- start start 2024-04-23T01:56:33.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.602+0000 7f77e0866ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xb92570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:33.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.602+0000 7f77e0866ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x9cc3d0 con 0xa676a0 2024-04-23T01:56:33.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.602+0000 7f77d899b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xb92570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:33.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.602+0000 7f77d899b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xb92570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57210/0 (socket says 172.21.15.37:57210) 2024-04-23T01:56:33.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.602+0000 7f77d899b640 1 -- 172.21.15.37:0/3671958736 learned_addr learned my addr 172.21.15.37:0/3671958736 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:33.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.602+0000 7f77d899b640 1 -- 172.21.15.37:0/3671958736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x95fe30 con 0xa676a0 2024-04-23T01:56:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.602+0000 7f77d899b640 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xb92570 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.603+0000 7f77d17fa640 1 -- 172.21.15.37:0/3671958736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77c400c490 con 0xa676a0 2024-04-23T01:56:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.603+0000 7f77d17fa640 1 -- 172.21.15.37:0/3671958736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f77c40110b0 con 0xa676a0 2024-04-23T01:56:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.604+0000 7f77d17fa640 1 -- 172.21.15.37:0/3671958736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f77c4011b90 con 0xa676a0 2024-04-23T01:56:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.604+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x95f890 con 0xa676a0 2024-04-23T01:56:33.605 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.604+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb75710 con 0xa676a0 2024-04-23T01:56:33.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.605+0000 7f77d17fa640 1 -- 172.21.15.37:0/3671958736 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f77c400f450 con 0xa676a0 2024-04-23T01:56:33.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.606+0000 7f77d17fa640 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f77c00371c0 0x7f77c00396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:33.607 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.606+0000 7f77d17fa640 1 -- 172.21.15.37:0/3671958736 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(704..704 src has 609..704) ==== 3791+0+0 (crc 0 0 0) 0x7f77c4048be0 con 0xa676a0 2024-04-23T01:56:33.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.606+0000 7f77d37fe640 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f77c00371c0 0x7f77c00396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:33.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.606+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/3671958736 >> v2:172.21.15.37:6802/1949701083 conn(0xa67ab0 0xb914f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:33.608 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.606+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 --> v2:172.21.15.37:6802/1949701083 -- osd_op(unknown.0.0:1 200.3 200:c57798d7:::three:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e704) -- 0xb76070 con 0xa67ab0 2024-04-23T01:56:33.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.607+0000 7f77d37fe640 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f77c00371c0 0x7f77c00396d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:33.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.607+0000 7f77d919c640 1 --2- 172.21.15.37:0/3671958736 >> v2:172.21.15.37:6802/1949701083 conn(0xa67ab0 0xb914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:56:33.614 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.612+0000 7f77d919c640 1 --2- 172.21.15.37:0/3671958736 >> v2:172.21.15.37:6802/1949701083 conn(0xa67ab0 0xb914f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77d919c640 1 -- 172.21.15.37:0/3671958736 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== osd_op_reply(1 three [writefull 0~11876] v704'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f77cc00a430 con 0xa67ab0 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 >> v2:172.21.15.37:6802/1949701083 conn(0xa67ab0 msgr2=0xb914f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/3671958736 >> v2:172.21.15.37:6802/1949701083 conn(0xa67ab0 0xb914f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f77c00371c0 msgr2=0x7f77c00396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f77c00371c0 0x7f77c00396d0 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 msgr2=0xb92570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xb92570 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 shutdown_connections 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/3671958736 >> v2:172.21.15.37:6802/1949701083 conn(0xa67ab0 0xb914f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f77c00371c0 0x7f77c00396d0 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 --2- 172.21.15.37:0/3671958736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa676a0 0xb92570 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:33.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 >> 172.21.15.37:0/3671958736 conn(0x985960 msgr2=0xa68300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:33.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 shutdown_connections 2024-04-23T01:56:33.962 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:33.958+0000 7f77e0866ec0 1 -- 172.21.15.37:0/3671958736 wait complete. 2024-04-23T01:56:33.963 INFO:tasks.workunit.client.0.smithi037.stderr:++ uuidgen 2024-04-23T01:56:33.964 INFO:tasks.workunit.client.0.smithi037.stderr:+ pp=66e90510-9ce4-418d-804c-f8d1f71f3917 2024-04-23T01:56:33.964 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool create 66e90510-9ce4-418d-804c-f8d1f71f3917 12 2024-04-23T01:56:34.059 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.050+0000 7f3b82a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.058+0000 7f3b82a2d640 1 Processor -- start 2024-04-23T01:56:34.060 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.058+0000 7f3b82a2d640 1 -- start start 2024-04-23T01:56:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b82a2d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b7c12f890 0x7f3b7c12fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b82a2d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c09d440 con 0x7f3b7c06bb90 2024-04-23T01:56:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b82a2d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c0a2c40 con 0x7f3b7c12f890 2024-04-23T01:56:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b7c12f890 0x7f3b7c12fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:34.062 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b7c06bb90 0x7f3b7c06bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49776/0 (socket says 172.21.15.37:49776) 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b7c12f890 0x7f3b7c12fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57220/0 (socket says 172.21.15.37:57220) 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7b7fe640 1 -- 172.21.15.37:0/4148903534 learned_addr learned my addr 172.21.15.37:0/4148903534 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7bfff640 1 -- 172.21.15.37:0/4148903534 >> v1:172.21.15.37:6789/0 conn(0x7f3b7c06bb90 legacy=0x7f3b7c06bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7bfff640 1 -- 172.21.15.37:0/4148903534 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c09d7a0 con 0x7f3b7c12f890 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/4148903534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c12f890 0x7f3b7c12fca0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f08ba4faff7b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.060+0000 7f3b7affd640 1 -- 172.21.15.37:0/4148903534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b64009d90 con 0x7f3b7c12f890 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b7affd640 1 -- 172.21.15.37:0/4148903534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b6400e230 con 0x7f3b7c12f890 2024-04-23T01:56:34.063 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b7affd640 1 -- 172.21.15.37:0/4148903534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b6400e4d0 con 0x7f3b7c12f890 2024-04-23T01:56:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b82a2d640 1 -- 172.21.15.37:0/4148903534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c12f890 msgr2=0x7f3b7c12fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b82a2d640 1 --2- 172.21.15.37:0/4148903534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c12f890 0x7f3b7c12fca0 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b82a2d640 1 -- 172.21.15.37:0/4148903534 shutdown_connections 2024-04-23T01:56:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b82a2d640 1 --2- 172.21.15.37:0/4148903534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c12f890 0x7f3b7c12fca0 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b82a2d640 1 -- 172.21.15.37:0/4148903534 >> 172.21.15.37:0/4148903534 conn(0x7f3b7c0a04d0 msgr2=0x7f3b7c0a08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b82a2d640 1 -- 172.21.15.37:0/4148903534 shutdown_connections 2024-04-23T01:56:34.064 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.061+0000 7f3b82a2d640 1 -- 172.21.15.37:0/4148903534 wait complete. 2024-04-23T01:56:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.062+0000 7f3b82a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.063+0000 7f3b82a2d640 1 Processor -- start 2024-04-23T01:56:34.065 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.063+0000 7f3b82a2d640 1 -- start start 2024-04-23T01:56:34.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.065+0000 7f3b82a2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c06bb90 0x7f3b7c09a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:34.067 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.065+0000 7f3b82a2d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c09c170 con 0x7f3b7c06bb90 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.065+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c06bb90 0x7f3b7c09a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.065+0000 7f3b7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c06bb90 0x7f3b7c09a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57224/0 (socket says 172.21.15.37:57224) 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.065+0000 7f3b7bfff640 1 -- 172.21.15.37:0/1163422257 learned_addr learned my addr 172.21.15.37:0/1163422257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.065+0000 7f3b7bfff640 1 -- 172.21.15.37:0/1163422257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1331f0 con 0x7f3b7c06bb90 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.065+0000 7f3b7bfff640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c06bb90 0x7f3b7c09a9e0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.066+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b64014540 con 0x7f3b7c06bb90 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.066+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3b640146a0 con 0x7f3b7c06bb90 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.066+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c12cd60 con 0x7f3b7c06bb90 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.066+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3b64014940 con 0x7f3b7c06bb90 2024-04-23T01:56:34.068 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.066+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c11e290 con 0x7f3b7c06bb90 2024-04-23T01:56:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.067+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f3b64014b40 con 0x7f3b7c06bb90 2024-04-23T01:56:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.067+0000 7f3b78ff9640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3b5c038930 0x7f3b5c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.067+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(704..704 src has 609..704) ==== 3791+0+0 (crc 0 0 0) 0x7f3b64019040 con 0x7f3b7c06bb90 2024-04-23T01:56:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.067+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7c11e480 con 0x7f3b7c06bb90 2024-04-23T01:56:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.067+0000 7f3b7b7fe640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3b5c038930 0x7f3b5c03ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:34.069 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.068+0000 7f3b7b7fe640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3b5c038930 0x7f3b5c03ae40 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:34.074 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.073+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f3b64014e40 con 0x7f3b7c06bb90 2024-04-23T01:56:34.264 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.262+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pg_num": 12} v 0) -- 0x7f3b7c0697f0 con 0x7f3b7c06bb90 2024-04-23T01:56:34.507 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.505+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pg_num": 12}]=0 pool '66e90510-9ce4-418d-804c-f8d1f71f3917' created v705) ==== 176+0+0 (crc 0 0 0) 0x7f3b6400fb30 con 0x7f3b7c06bb90 2024-04-23T01:56:34.718 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.716+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pg_num": 12} v 0) -- 0x7f3b7c0733b0 con 0x7f3b7c06bb90 2024-04-23T01:56:34.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.717+0000 7f3b78ff9640 1 -- 172.21.15.37:0/1163422257 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pg_num": 12}]=0 pool '66e90510-9ce4-418d-804c-f8d1f71f3917' already exists v705) ==== 183+0+0 (crc 0 0 0) 0x7f3b6400fd10 con 0x7f3b7c06bb90 2024-04-23T01:56:34.719 INFO:tasks.workunit.client.0.smithi037.stderr:pool '66e90510-9ce4-418d-804c-f8d1f71f3917' already exists 2024-04-23T01:56:34.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3b5c038930 msgr2=0x7f3b5c03ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:34.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3b5c038930 0x7f3b5c03ae40 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c06bb90 msgr2=0x7f3b7c09a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:34.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c06bb90 0x7f3b7c09a9e0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 shutdown_connections 2024-04-23T01:56:34.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3b5c038930 0x7f3b5c03ae40 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 --2- 172.21.15.37:0/1163422257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c06bb90 0x7f3b7c09a9e0 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 >> 172.21.15.37:0/1163422257 conn(0x7f3b7c0a04d0 msgr2=0x7f3b7c12d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:34.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 shutdown_connections 2024-04-23T01:56:34.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.721+0000 7f3b82a2d640 1 -- 172.21.15.37:0/1163422257 wait complete. 2024-04-23T01:56:34.743 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool application enable 66e90510-9ce4-418d-804c-f8d1f71f3917 rados 2024-04-23T01:56:34.862 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.851+0000 7fa99d95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:34.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.862+0000 7fa99d95d640 1 Processor -- start 2024-04-23T01:56:34.864 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.862+0000 7fa99d95d640 1 -- start start 2024-04-23T01:56:34.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa99d95d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9981356a0 0x7fa998139e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:34.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa99d95d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa998134c80 con 0x7fa99809b460 2024-04-23T01:56:34.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa99d95d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa99809bf20 con 0x7fa9981356a0 2024-04-23T01:56:34.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa9967fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9981356a0 0x7fa998139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:34.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa9967fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa9981356a0 0x7fa998139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57226/0 (socket says 172.21.15.37:57226) 2024-04-23T01:56:34.866 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa996ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa99809b460 0x7fa998134f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49778/0 (socket says 172.21.15.37:49778) 2024-04-23T01:56:34.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa9967fc640 1 -- 172.21.15.37:0/3094728873 learned_addr learned my addr 172.21.15.37:0/3094728873 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:34.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa9967fc640 1 -- 172.21.15.37:0/3094728873 >> v1:172.21.15.37:6789/0 conn(0x7fa99809b460 legacy=0x7fa998134f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:34.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa9967fc640 1 -- 172.21.15.37:0/3094728873 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99809c8d0 con 0x7fa9981356a0 2024-04-23T01:56:34.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa9967fc640 1 --2- 172.21.15.37:0/3094728873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa998139e80 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e18c5dc80a7c8c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:34.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa995ffb640 1 -- 172.21.15.37:0/3094728873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa988009e50 con 0x7fa9981356a0 2024-04-23T01:56:34.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa995ffb640 1 -- 172.21.15.37:0/3094728873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa98800e230 con 0x7fa9981356a0 2024-04-23T01:56:34.867 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.864+0000 7fa995ffb640 1 -- 172.21.15.37:0/3094728873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa98800e4d0 con 0x7fa9981356a0 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.865+0000 7fa99d95d640 1 -- 172.21.15.37:0/3094728873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 msgr2=0x7fa998139e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.865+0000 7fa99d95d640 1 --2- 172.21.15.37:0/3094728873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa998139e80 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.865+0000 7fa99d95d640 1 -- 172.21.15.37:0/3094728873 shutdown_connections 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.865+0000 7fa99d95d640 1 --2- 172.21.15.37:0/3094728873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa998139e80 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.865+0000 7fa99d95d640 1 -- 172.21.15.37:0/3094728873 >> 172.21.15.37:0/3094728873 conn(0x7fa9980a3c00 msgr2=0x7fa9980a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.865+0000 7fa99d95d640 1 -- 172.21.15.37:0/3094728873 shutdown_connections 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.865+0000 7fa99d95d640 1 -- 172.21.15.37:0/3094728873 wait complete. 2024-04-23T01:56:34.868 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.866+0000 7fa99d95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:34.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.867+0000 7fa99d95d640 1 Processor -- start 2024-04-23T01:56:34.869 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.868+0000 7fa99d95d640 1 -- start start 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.869+0000 7fa99d95d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa9981c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.869+0000 7fa99d95d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9981bf2f0 con 0x7fa9981356a0 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.869+0000 7fa996ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa9981c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.869+0000 7fa996ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa9981c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57230/0 (socket says 172.21.15.37:57230) 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.869+0000 7fa996ffd640 1 -- 172.21.15.37:0/1360181451 learned_addr learned my addr 172.21.15.37:0/1360181451 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.870+0000 7fa996ffd640 1 -- 172.21.15.37:0/1360181451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa998132410 con 0x7fa9981356a0 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.870+0000 7fa996ffd640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa9981c97c0 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.870+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa9800059a0 con 0x7fa9981356a0 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.870+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa980005b00 con 0x7fa9981356a0 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.870+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9981209b0 con 0x7fa9981356a0 2024-04-23T01:56:34.872 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.870+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa980005da0 con 0x7fa9981356a0 2024-04-23T01:56:34.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.870+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9980a08d0 con 0x7fa9981356a0 2024-04-23T01:56:34.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.871+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9980697f0 con 0x7fa9981356a0 2024-04-23T01:56:34.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.871+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fa9800070b0 con 0x7fa9981356a0 2024-04-23T01:56:34.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.871+0000 7fa98ffff640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa978038980 0x7fa97803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:34.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.871+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(705..705 src has 609..705) ==== 4166+0+0 (crc 0 0 0) 0x7fa9800487b0 con 0x7fa9981356a0 2024-04-23T01:56:34.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.872+0000 7fa9967fc640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa978038980 0x7fa97803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:34.874 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.872+0000 7fa9967fc640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa978038980 0x7fa97803ae90 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:34.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:34.877+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fa98000d330 con 0x7fa9981356a0 2024-04-23T01:56:35.066 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:35.064+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "app": "rados"} v 0) -- 0x7fa9981321e0 con 0x7fa9981356a0 2024-04-23T01:56:35.510 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:35.509+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "app": "rados"}]=0 enabled application 'rados' on pool '66e90510-9ce4-418d-804c-f8d1f71f3917' v706) ==== 213+0+0 (crc 0 0 0) 0x7fa98000d150 con 0x7fa9981356a0 2024-04-23T01:56:35.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:35.679+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "app": "rados"} v 0) -- 0x7fa99813a390 con 0x7fa9981356a0 2024-04-23T01:56:36.514 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.512+0000 7fa98ffff640 1 -- 172.21.15.37:0/1360181451 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "app": "rados"}]=0 enabled application 'rados' on pool '66e90510-9ce4-418d-804c-f8d1f71f3917' v707) ==== 213+0+0 (crc 0 0 0) 0x7fa98000d150 con 0x7fa9981356a0 2024-04-23T01:56:36.514 INFO:tasks.workunit.client.0.smithi037.stderr:enabled application 'rados' on pool '66e90510-9ce4-418d-804c-f8d1f71f3917' 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa978038980 msgr2=0x7fa97803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa978038980 0x7fa97803ae90 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 msgr2=0x7fa9981c97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa9981c97c0 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 shutdown_connections 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fa978038980 0x7fa97803ae90 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 --2- 172.21.15.37:0/1360181451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9981356a0 0x7fa9981c97c0 unknown :-1 s=CLOSED pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:36.518 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 >> 172.21.15.37:0/1360181451 conn(0x7fa9980a3c00 msgr2=0x7fa9980a4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:36.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 shutdown_connections 2024-04-23T01:56:36.519 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.516+0000 7fa99d95d640 1 -- 172.21.15.37:0/1360181451 wait complete. 2024-04-23T01:56:36.529 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota 66e90510-9ce4-418d-804c-f8d1f71f3917 max_objects 10 2024-04-23T01:56:36.628 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.618+0000 7f2ba84ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:36.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.628+0000 7f2ba84ed640 1 Processor -- start 2024-04-23T01:56:36.629 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.628+0000 7f2ba84ed640 1 -- start start 2024-04-23T01:56:36.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.629+0000 7f2ba84ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ba01318a0 0x7f2ba0131cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:36.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba84ed640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ba009c8e0 con 0x7f2ba00a2530 2024-04-23T01:56:36.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba84ed640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2ba009abe0 con 0x7f2ba01318a0 2024-04-23T01:56:36.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba6289640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ba01318a0 0x7f2ba0131cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:36.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba5a88640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ba00a2530 0x7f2ba00a2940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49790/0 (socket says 172.21.15.37:49790) 2024-04-23T01:56:36.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba5a88640 1 -- 172.21.15.37:0/2144094381 learned_addr learned my addr 172.21.15.37:0/2144094381 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:56:36.632 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba6289640 1 -- 172.21.15.37:0/2144094381 >> v1:172.21.15.37:6789/0 conn(0x7f2ba00a2530 legacy=0x7f2ba00a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:36.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba6289640 1 -- 172.21.15.37:0/2144094381 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba0131490 con 0x7f2ba01318a0 2024-04-23T01:56:36.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba6289640 1 --2- 172.21.15.37:0/2144094381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba01318a0 0x7f2ba0131cb0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d0785605d88cfa server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:36.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba5287640 1 -- 172.21.15.37:0/2144094381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b9c009d90 con 0x7f2ba01318a0 2024-04-23T01:56:36.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba5287640 1 -- 172.21.15.37:0/2144094381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b9c00e230 con 0x7f2ba01318a0 2024-04-23T01:56:36.633 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.630+0000 7f2ba5287640 1 -- 172.21.15.37:0/2144094381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b9c00e4d0 con 0x7f2ba01318a0 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2144094381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba01318a0 msgr2=0x7f2ba0131cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 1 --2- 172.21.15.37:0/2144094381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba01318a0 0x7f2ba0131cb0 crc :-1 s=READY pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2144094381 shutdown_connections 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 1 --2- 172.21.15.37:0/2144094381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba01318a0 0x7f2ba0131cb0 unknown :-1 s=CLOSED pgs=12895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2144094381 >> 172.21.15.37:0/2144094381 conn(0x7f2ba006d3a0 msgr2=0x7f2ba006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2144094381 shutdown_connections 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2144094381 wait complete. 2024-04-23T01:56:36.634 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.631+0000 7f2ba84ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:56:36.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.633+0000 7f2ba84ed640 1 Processor -- start 2024-04-23T01:56:36.635 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.633+0000 7f2ba84ed640 1 -- start start 2024-04-23T01:56:36.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2ba84ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba00a2530 0x7f2ba011d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:36.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2ba84ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba01301a0 con 0x7f2ba00a2530 2024-04-23T01:56:36.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2ba6289640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba00a2530 0x7f2ba011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:36.637 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2ba6289640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba00a2530 0x7f2ba011d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57248/0 (socket says 172.21.15.37:57248) 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2ba6289640 1 -- 172.21.15.37:0/2696993352 learned_addr learned my addr 172.21.15.37:0/2696993352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2ba6289640 1 -- 172.21.15.37:0/2696993352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba009fb40 con 0x7f2ba00a2530 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2ba6289640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba00a2530 0x7f2ba011d170 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.635+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b9c014620 con 0x7f2ba00a2530 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.636+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b9c014780 con 0x7f2ba00a2530 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.636+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba00a03a0 con 0x7f2ba00a2530 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.636+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b9c014a20 con 0x7f2ba00a2530 2024-04-23T01:56:36.638 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.636+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba011e580 con 0x7f2ba00a2530 2024-04-23T01:56:36.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.636+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba009c0f0 con 0x7f2ba00a2530 2024-04-23T01:56:36.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.637+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f2b9c014bd0 con 0x7f2ba00a2530 2024-04-23T01:56:36.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.637+0000 7f2b96ffd640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f2b84038980 0x7f2b8403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:56:36.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.637+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(707..707 src has 609..707) ==== 4179+0+0 (crc 0 0 0) 0x7f2b9c019040 con 0x7f2ba00a2530 2024-04-23T01:56:36.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.637+0000 7f2ba5a88640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f2b84038980 0x7f2b8403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:56:36.639 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.638+0000 7f2ba5a88640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f2b84038980 0x7f2b8403ae90 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:56:36.644 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.642+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f2ba009c0f0 con 0x7f2ba00a2530 2024-04-23T01:56:36.832 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:36.830+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "field": "max_objects", "val": "10"} v 0) -- 0x7f2ba009c0f0 con 0x7f2ba00a2530 2024-04-23T01:56:37.415 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:37.413+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 66e90510-9ce4-418d-804c-f8d1f71f3917 v708) ==== 223+0+0 (crc 0 0 0) 0x7f2ba009c0f0 con 0x7f2ba00a2530 2024-04-23T01:56:37.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:37.524+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "field": "max_objects", "val": "10"} v 0) -- 0x7f2ba009c0f0 con 0x7f2ba00a2530 2024-04-23T01:56:38.520 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.518+0000 7f2b96ffd640 1 -- 172.21.15.37:0/2696993352 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 66e90510-9ce4-418d-804c-f8d1f71f3917 v709) ==== 223+0+0 (crc 0 0 0) 0x7f2ba009c0f0 con 0x7f2ba00a2530 2024-04-23T01:56:38.520 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_objects = 10 for pool 66e90510-9ce4-418d-804c-f8d1f71f3917 2024-04-23T01:56:38.523 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f2b84038980 msgr2=0x7f2b8403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:38.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f2b84038980 0x7f2b8403ae90 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:38.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba00a2530 msgr2=0x7f2ba011d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:56:38.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba00a2530 0x7f2ba011d170 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:38.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 shutdown_connections 2024-04-23T01:56:38.524 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f2b84038980 0x7f2b8403ae90 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:38.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 --2- 172.21.15.37:0/2696993352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ba00a2530 0x7f2ba011d170 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:56:38.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 >> 172.21.15.37:0/2696993352 conn(0x7f2ba006d3a0 msgr2=0x7f2ba01bca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:56:38.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 shutdown_connections 2024-04-23T01:56:38.525 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:56:38.521+0000 7f2ba84ed640 1 -- 172.21.15.37:0/2696993352 wait complete. 2024-04-23T01:56:38.539 INFO:tasks.workunit.client.0.smithi037.stderr:+ sleep 30 2024-04-23T01:57:08.541 INFO:tasks.workunit.client.0.smithi037.stderr:++ seq 1 10 2024-04-23T01:57:08.542 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:08.542 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj1 /etc/passwd 2024-04-23T01:57:08.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.586+0000 7f07ba069ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.592+0000 7f07ba069ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.594 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.592+0000 7f07ba069ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.593+0000 7f07ba069ec0 1 Processor -- start 2024-04-23T01:57:08.595 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.593+0000 7f07ba069ec0 1 -- start start 2024-04-23T01:57:08.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.594+0000 7f07ba069ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb326a0 0xb34b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.594+0000 7f07ba069ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xa99950 con 0xb326a0 2024-04-23T01:57:08.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b219b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb326a0 0xb34b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b219b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb326a0 0xb34b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35150/0 (socket says 172.21.15.37:35150) 2024-04-23T01:57:08.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b219b640 1 -- 172.21.15.37:0/4216813739 learned_addr learned my addr 172.21.15.37:0/4216813739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b219b640 1 -- 172.21.15.37:0/4216813739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa381e0 con 0xb326a0 2024-04-23T01:57:08.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b219b640 1 --2- 172.21.15.37:0/4216813739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb326a0 0xb34b50 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb196052b1a8d2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b0998640 1 -- 172.21.15.37:0/4216813739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a400d500 con 0xb326a0 2024-04-23T01:57:08.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b0998640 1 -- 172.21.15.37:0/4216813739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f07a400d660 con 0xb326a0 2024-04-23T01:57:08.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.595+0000 7f07b0998640 1 -- 172.21.15.37:0/4216813739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a400d900 con 0xb326a0 2024-04-23T01:57:08.598 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.596+0000 7f07ba069ec0 1 -- 172.21.15.37:0/4216813739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb326a0 msgr2=0xb34b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.596+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/4216813739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb326a0 0xb34b50 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.596+0000 7f07ba069ec0 1 -- 172.21.15.37:0/4216813739 shutdown_connections 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.596+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/4216813739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb326a0 0xb34b50 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.596+0000 7f07ba069ec0 1 -- 172.21.15.37:0/4216813739 >> 172.21.15.37:0/4216813739 conn(0xa50960 msgr2=0xc4e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.596+0000 7f07ba069ec0 1 -- 172.21.15.37:0/4216813739 shutdown_connections 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.596+0000 7f07ba069ec0 1 -- 172.21.15.37:0/4216813739 wait complete. 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.597+0000 7f07ba069ec0 1 Processor -- start 2024-04-23T01:57:08.599 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.597+0000 7f07ba069ec0 1 -- start start 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.599+0000 7f07ba069ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb32ab0 0xc37a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.599+0000 7f07ba069ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xa973d0 con 0xb32ab0 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.599+0000 7f07b219b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb32ab0 0xc37a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.599+0000 7f07b219b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb32ab0 0xc37a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35162/0 (socket says 172.21.15.37:35162) 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.599+0000 7f07b219b640 1 -- 172.21.15.37:0/1774409663 learned_addr learned my addr 172.21.15.37:0/1774409663 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.599+0000 7f07b219b640 1 -- 172.21.15.37:0/1774409663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa2ae30 con 0xb32ab0 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.600+0000 7f07b219b640 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb32ab0 0xc37a20 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.600+0000 7f07aaffd640 1 -- 172.21.15.37:0/1774409663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a400f990 con 0xb32ab0 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.600+0000 7f07aaffd640 1 -- 172.21.15.37:0/1774409663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f07a400faf0 con 0xb32ab0 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.600+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xa2a890 con 0xb32ab0 2024-04-23T01:57:08.602 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.600+0000 7f07aaffd640 1 -- 172.21.15.37:0/1774409663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a400fd90 con 0xb32ab0 2024-04-23T01:57:08.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.600+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc3aa00 con 0xb32ab0 2024-04-23T01:57:08.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.601+0000 7f07aaffd640 1 -- 172.21.15.37:0/1774409663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f07a400c360 con 0xb32ab0 2024-04-23T01:57:08.603 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.601+0000 7f07aaffd640 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0798037210 0x7f0798039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.601+0000 7f07aaffd640 1 -- 172.21.15.37:0/1774409663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7f07a4048d70 con 0xb32ab0 2024-04-23T01:57:08.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.601+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/1774409663 >> v2:172.21.15.37:6802/1949701083 conn(0xc49ef0 0xc4a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.601+0000 7f07b199a640 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0798037210 0x7f0798039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.601+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 --> v2:172.21.15.37:6802/1949701083 -- osd_op(unknown.0.0:1 201.7 201:ff7b1f36:::obj1:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0xc3b470 con 0xc49ef0 2024-04-23T01:57:08.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.602+0000 7f07b199a640 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0798037210 0x7f0798039720 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.603+0000 7f07b299c640 1 --2- 172.21.15.37:0/1774409663 >> v2:172.21.15.37:6802/1949701083 conn(0xc49ef0 0xc4a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:08.609 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.607+0000 7f07b299c640 1 --2- 172.21.15.37:0/1774409663 >> v2:172.21.15.37:6802/1949701083 conn(0xc49ef0 0xc4a300 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07b299c640 1 -- 172.21.15.37:0/1774409663 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== osd_op_reply(1 obj1 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f079c00a430 con 0xc49ef0 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 >> v2:172.21.15.37:6802/1949701083 conn(0xc49ef0 msgr2=0xc4a300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/1774409663 >> v2:172.21.15.37:6802/1949701083 conn(0xc49ef0 0xc4a300 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0798037210 msgr2=0x7f0798039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0798037210 0x7f0798039720 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb32ab0 msgr2=0xc37a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb32ab0 0xc37a20 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 shutdown_connections 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/1774409663 >> v2:172.21.15.37:6802/1949701083 conn(0xc49ef0 0xc4a300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.622 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0798037210 0x7f0798039720 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 --2- 172.21.15.37:0/1774409663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xb32ab0 0xc37a20 unknown :-1 s=CLOSED pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 >> 172.21.15.37:0/1774409663 conn(0xa50960 msgr2=0xc4e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 shutdown_connections 2024-04-23T01:57:08.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.619+0000 7f07ba069ec0 1 -- 172.21.15.37:0/1774409663 wait complete. 2024-04-23T01:57:08.624 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:08.624 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj2 /etc/passwd 2024-04-23T01:57:08.662 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.660+0000 7fdf2cefaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.666+0000 7fdf2cefaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.668 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.666+0000 7fdf2cefaec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.667+0000 7fdf2cefaec0 1 Processor -- start 2024-04-23T01:57:08.669 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.667+0000 7fdf2cefaec0 1 -- start start 2024-04-23T01:57:08.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf2cefaec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x125d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf2cefaec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x10ac950 con 0x11456a0 2024-04-23T01:57:08.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf2539b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x125d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.671 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf2539b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x125d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35182/0 (socket says 172.21.15.37:35182) 2024-04-23T01:57:08.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf2539b640 1 -- 172.21.15.37:0/751775692 learned_addr learned my addr 172.21.15.37:0/751775692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf2539b640 1 -- 172.21.15.37:0/751775692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x104b1e0 con 0x11456a0 2024-04-23T01:57:08.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf2539b640 1 --2- 172.21.15.37:0/751775692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x125d3a0 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee2adbaec6d4a63 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf1effd640 1 -- 172.21.15.37:0/751775692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf1000c4b0 con 0x11456a0 2024-04-23T01:57:08.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.669+0000 7fdf1effd640 1 -- 172.21.15.37:0/751775692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf1000c610 con 0x11456a0 2024-04-23T01:57:08.672 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf1effd640 1 -- 172.21.15.37:0/751775692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf1000c8b0 con 0x11456a0 2024-04-23T01:57:08.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/751775692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 msgr2=0x125d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/751775692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x125d3a0 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/751775692 shutdown_connections 2024-04-23T01:57:08.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/751775692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x125d3a0 unknown :-1 s=CLOSED pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/751775692 >> 172.21.15.37:0/751775692 conn(0x1063960 msgr2=0x1261330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/751775692 shutdown_connections 2024-04-23T01:57:08.673 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.670+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/751775692 wait complete. 2024-04-23T01:57:08.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.671+0000 7fdf2cefaec0 1 Processor -- start 2024-04-23T01:57:08.674 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.671+0000 7fdf2cefaec0 1 -- start start 2024-04-23T01:57:08.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.673+0000 7fdf2cefaec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x124a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.673+0000 7fdf2cefaec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x10aa3d0 con 0x11456a0 2024-04-23T01:57:08.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.673+0000 7fdf2539b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x124a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.673+0000 7fdf2539b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x124a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35190/0 (socket says 172.21.15.37:35190) 2024-04-23T01:57:08.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.673+0000 7fdf2539b640 1 -- 172.21.15.37:0/3517522881 learned_addr learned my addr 172.21.15.37:0/3517522881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.673+0000 7fdf2539b640 1 -- 172.21.15.37:0/3517522881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x103de30 con 0x11456a0 2024-04-23T01:57:08.675 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.674+0000 7fdf2539b640 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x124a180 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.674+0000 7fdf1dffb640 1 -- 172.21.15.37:0/3517522881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf10013a40 con 0x11456a0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.674+0000 7fdf1dffb640 1 -- 172.21.15.37:0/3517522881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf10013ba0 con 0x11456a0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.674+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x103d890 con 0x11456a0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.674+0000 7fdf1dffb640 1 -- 172.21.15.37:0/3517522881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf10013e40 con 0x11456a0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.674+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x112c550 con 0x11456a0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.675+0000 7fdf1dffb640 1 -- 172.21.15.37:0/3517522881 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdf10010400 con 0x11456a0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.675+0000 7fdf1dffb640 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdf0c037210 0x7fdf0c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.675+0000 7fdf1dffb640 1 -- 172.21.15.37:0/3517522881 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7fdf10008040 con 0x11456a0 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.675+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/3517522881 >> v2:172.21.15.37:6805/1977556410 conn(0x1145ab0 0x126e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.677 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.675+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 --> v2:172.21.15.37:6805/1977556410 -- osd_op(unknown.0.0:1 201.8 201:104778fc:::obj2:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x124c590 con 0x1145ab0 2024-04-23T01:57:08.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.675+0000 7fdf24b9a640 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdf0c037210 0x7fdf0c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.676+0000 7fdf24b9a640 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdf0c037210 0x7fdf0c039720 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.678 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.676+0000 7fdf25b9c640 1 --2- 172.21.15.37:0/3517522881 >> v2:172.21.15.37:6805/1977556410 conn(0x1145ab0 0x126e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:08.681 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.680+0000 7fdf25b9c640 1 --2- 172.21.15.37:0/3517522881 >> v2:172.21.15.37:6805/1977556410 conn(0x1145ab0 0x126e6f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.690+0000 7fdf25b9c640 1 -- 172.21.15.37:0/3517522881 <== osd.1 v2:172.21.15.37:6805/1977556410 1 ==== osd_op_reply(1 obj2 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fdf1800a430 con 0x1145ab0 2024-04-23T01:57:08.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 >> v2:172.21.15.37:6805/1977556410 conn(0x1145ab0 msgr2=0x126e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.693 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/3517522881 >> v2:172.21.15.37:6805/1977556410 conn(0x1145ab0 0x126e6f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdf0c037210 msgr2=0x7fdf0c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdf0c037210 0x7fdf0c039720 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 msgr2=0x124a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x124a180 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 shutdown_connections 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/3517522881 >> v2:172.21.15.37:6805/1977556410 conn(0x1145ab0 0x126e6f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdf0c037210 0x7fdf0c039720 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 --2- 172.21.15.37:0/3517522881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x11456a0 0x124a180 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 >> 172.21.15.37:0/3517522881 conn(0x1063960 msgr2=0x1261140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 shutdown_connections 2024-04-23T01:57:08.694 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.691+0000 7fdf2cefaec0 1 -- 172.21.15.37:0/3517522881 wait complete. 2024-04-23T01:57:08.696 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:08.696 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj3 /etc/passwd 2024-04-23T01:57:08.732 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.730+0000 7ff754252ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.736+0000 7ff754252ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.737 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.736+0000 7ff754252ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.737+0000 7ff754252ec0 1 Processor -- start 2024-04-23T01:57:08.738 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.737+0000 7ff754252ec0 1 -- start start 2024-04-23T01:57:08.740 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.738+0000 7ff754252ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0x10993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.738+0000 7ff754252ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xee5950 con 0xf64740 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.738+0000 7ff7477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0x10993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.738+0000 7ff7477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0x10993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35212/0 (socket says 172.21.15.37:35212) 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.738+0000 7ff7477fe640 1 -- 172.21.15.37:0/2625360947 learned_addr learned my addr 172.21.15.37:0/2625360947 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.738+0000 7ff7477fe640 1 -- 172.21.15.37:0/2625360947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe841e0 con 0xf64740 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff7477fe640 1 --2- 172.21.15.37:0/2625360947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0x10993b0 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff8da3ff5a13c51 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff745ffb640 1 -- 172.21.15.37:0/2625360947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff73802c990 con 0xf64740 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff745ffb640 1 -- 172.21.15.37:0/2625360947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff73800a040 con 0xf64740 2024-04-23T01:57:08.741 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff745ffb640 1 -- 172.21.15.37:0/2625360947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff73800a2e0 con 0xf64740 2024-04-23T01:57:08.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff754252ec0 1 -- 172.21.15.37:0/2625360947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 msgr2=0x10993b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2625360947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0x10993b0 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff754252ec0 1 -- 172.21.15.37:0/2625360947 shutdown_connections 2024-04-23T01:57:08.742 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2625360947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0x10993b0 unknown :-1 s=CLOSED pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff754252ec0 1 -- 172.21.15.37:0/2625360947 >> 172.21.15.37:0/2625360947 conn(0xe9c960 msgr2=0x100cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff754252ec0 1 -- 172.21.15.37:0/2625360947 shutdown_connections 2024-04-23T01:57:08.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.739+0000 7ff754252ec0 1 -- 172.21.15.37:0/2625360947 wait complete. 2024-04-23T01:57:08.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.740+0000 7ff754252ec0 1 Processor -- start 2024-04-23T01:57:08.743 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.740+0000 7ff754252ec0 1 -- start start 2024-04-23T01:57:08.744 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.742+0000 7ff754252ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0xf78330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.742+0000 7ff754252ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0xee33d0 con 0xf64740 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.742+0000 7ff7477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0xf78330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.742+0000 7ff7477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0xf78330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35214/0 (socket says 172.21.15.37:35214) 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.742+0000 7ff7477fe640 1 -- 172.21.15.37:0/2081720371 learned_addr learned my addr 172.21.15.37:0/2081720371 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.742+0000 7ff7477fe640 1 -- 172.21.15.37:0/2081720371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe76e30 con 0xf64740 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.743+0000 7ff7477fe640 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0xf78330 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.743+0000 7ff744ff9640 1 -- 172.21.15.37:0/2081720371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff73802d570 con 0xf64740 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.743+0000 7ff744ff9640 1 -- 172.21.15.37:0/2081720371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff73802d6d0 con 0xf64740 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.743+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xe76890 con 0xf64740 2024-04-23T01:57:08.745 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.743+0000 7ff744ff9640 1 -- 172.21.15.37:0/2081720371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff73802d970 con 0xf64740 2024-04-23T01:57:08.746 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.743+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1010610 con 0xf64740 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.744+0000 7ff744ff9640 1 -- 172.21.15.37:0/2081720371 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff738035040 con 0xf64740 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.744+0000 7ff744ff9640 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7340371c0 0x7ff7340396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.744+0000 7ff744ff9640 1 -- 172.21.15.37:0/2081720371 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7ff738032040 con 0xf64740 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.744+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2081720371 >> v2:172.21.15.191:6808/1018833307 conn(0x100f940 0x10a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.744+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:1 201.1 201:8dd16f86:::obj3:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0xffb2f0 con 0x100f940 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.744+0000 7ff746ffd640 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7340371c0 0x7ff7340396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.745+0000 7ff746ffd640 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7340371c0 0x7ff7340396d0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.747 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.745+0000 7ff74cb9c640 1 --2- 172.21.15.37:0/2081720371 >> v2:172.21.15.191:6808/1018833307 conn(0x100f940 0x10a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:08.750 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.749+0000 7ff74cb9c640 1 --2- 172.21.15.37:0/2081720371 >> v2:172.21.15.191:6808/1018833307 conn(0x100f940 0x10a76a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.761+0000 7ff74cb9c640 1 -- 172.21.15.37:0/2081720371 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== osd_op_reply(1 obj3 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff74000a430 con 0x100f940 2024-04-23T01:57:08.764 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.761+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 >> v2:172.21.15.191:6808/1018833307 conn(0x100f940 msgr2=0x10a76a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.761+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2081720371 >> v2:172.21.15.191:6808/1018833307 conn(0x100f940 0x10a76a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7340371c0 msgr2=0x7ff7340396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7340371c0 0x7ff7340396d0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 msgr2=0xf78330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0xf78330 crc :-1 s=READY pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 shutdown_connections 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2081720371 >> v2:172.21.15.191:6808/1018833307 conn(0x100f940 0x10a76a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7340371c0 0x7ff7340396d0 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 --2- 172.21.15.37:0/2081720371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xf64740 0xf78330 unknown :-1 s=CLOSED pgs=12908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 >> 172.21.15.37:0/2081720371 conn(0xe9c960 msgr2=0x100cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 shutdown_connections 2024-04-23T01:57:08.765 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.762+0000 7ff754252ec0 1 -- 172.21.15.37:0/2081720371 wait complete. 2024-04-23T01:57:08.766 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:08.766 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj4 /etc/passwd 2024-04-23T01:57:08.802 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.800+0000 7f41aa2daec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.806+0000 7f41aa2daec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.808 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.806+0000 7f41aa2daec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.807+0000 7f41aa2daec0 1 Processor -- start 2024-04-23T01:57:08.809 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.807+0000 7f41aa2daec0 1 -- start start 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.808+0000 7f41aa2daec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x2668d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.808+0000 7f41aa2daec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x253c950 con 0x25d4cb0 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.808+0000 7f41a279b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x2668d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.809+0000 7f41a279b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x2668d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35230/0 (socket says 172.21.15.37:35230) 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.809+0000 7f41a279b640 1 -- 172.21.15.37:0/1470276848 learned_addr learned my addr 172.21.15.37:0/1470276848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.809+0000 7f41a279b640 1 -- 172.21.15.37:0/1470276848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24db1e0 con 0x25d4cb0 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.809+0000 7f41a279b640 1 --2- 172.21.15.37:0/1470276848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x2668d90 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f1871e17f8d8b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.809+0000 7f41a0f98640 1 -- 172.21.15.37:0/1470276848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f418c00c5e0 con 0x25d4cb0 2024-04-23T01:57:08.811 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.809+0000 7f41a0f98640 1 -- 172.21.15.37:0/1470276848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f418c00c740 con 0x25d4cb0 2024-04-23T01:57:08.812 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.809+0000 7f41a0f98640 1 -- 172.21.15.37:0/1470276848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f418c00c9e0 con 0x25d4cb0 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.810+0000 7f41aa2daec0 1 -- 172.21.15.37:0/1470276848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 msgr2=0x2668d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.810+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/1470276848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x2668d90 crc :-1 s=READY pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.810+0000 7f41aa2daec0 1 -- 172.21.15.37:0/1470276848 shutdown_connections 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.810+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/1470276848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x2668d90 unknown :-1 s=CLOSED pgs=12911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.810+0000 7f41aa2daec0 1 -- 172.21.15.37:0/1470276848 >> 172.21.15.37:0/1470276848 conn(0x24f3960 msgr2=0x266a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.810+0000 7f41aa2daec0 1 -- 172.21.15.37:0/1470276848 shutdown_connections 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.810+0000 7f41aa2daec0 1 -- 172.21.15.37:0/1470276848 wait complete. 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.811+0000 7f41aa2daec0 1 Processor -- start 2024-04-23T01:57:08.813 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.811+0000 7f41aa2daec0 1 -- start start 2024-04-23T01:57:08.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.812+0000 7f41aa2daec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x26fc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.812+0000 7f41aa2daec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x253a3d0 con 0x25d4cb0 2024-04-23T01:57:08.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.812+0000 7f41a279b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x26fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.812+0000 7f41a279b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x26fc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35232/0 (socket says 172.21.15.37:35232) 2024-04-23T01:57:08.815 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.812+0000 7f41a279b640 1 -- 172.21.15.37:0/294805173 learned_addr learned my addr 172.21.15.37:0/294805173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.813+0000 7f41a279b640 1 -- 172.21.15.37:0/294805173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x24cde30 con 0x25d4cb0 2024-04-23T01:57:08.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.813+0000 7f41a279b640 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x26fc730 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.813+0000 7f419affd640 1 -- 172.21.15.37:0/294805173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f418c013a10 con 0x25d4cb0 2024-04-23T01:57:08.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.813+0000 7f419affd640 1 -- 172.21.15.37:0/294805173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f418c013b70 con 0x25d4cb0 2024-04-23T01:57:08.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.813+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x24cd890 con 0x25d4cb0 2024-04-23T01:57:08.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.813+0000 7f419affd640 1 -- 172.21.15.37:0/294805173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f418c013e10 con 0x25d4cb0 2024-04-23T01:57:08.816 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.813+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x26fc270 con 0x25d4cb0 2024-04-23T01:57:08.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.814+0000 7f419affd640 1 -- 172.21.15.37:0/294805173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f418c010400 con 0x25d4cb0 2024-04-23T01:57:08.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.814+0000 7f419affd640 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4188037210 0x7f4188039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.817 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.814+0000 7f419affd640 1 -- 172.21.15.37:0/294805173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7f418c008040 con 0x25d4cb0 2024-04-23T01:57:08.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.814+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/294805173 >> v2:172.21.15.37:6802/1949701083 conn(0x266a950 0x26f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.814+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 --> v2:172.21.15.37:6802/1949701083 -- osd_op(unknown.0.0:1 201.0 201:0ee9ae15:::obj4:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x26f30e0 con 0x266a950 2024-04-23T01:57:08.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.814+0000 7f41a1f9a640 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4188037210 0x7f4188039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.815+0000 7f41a1f9a640 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4188037210 0x7f4188039720 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.818 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.815+0000 7f41a2f9c640 1 --2- 172.21.15.37:0/294805173 >> v2:172.21.15.37:6802/1949701083 conn(0x266a950 0x26f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:08.820 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.819+0000 7f41a2f9c640 1 --2- 172.21.15.37:0/294805173 >> v2:172.21.15.37:6802/1949701083 conn(0x266a950 0x26f2ba0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41a2f9c640 1 -- 172.21.15.37:0/294805173 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== osd_op_reply(1 obj4 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f419400a430 con 0x266a950 2024-04-23T01:57:08.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 >> v2:172.21.15.37:6802/1949701083 conn(0x266a950 msgr2=0x26f2ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/294805173 >> v2:172.21.15.37:6802/1949701083 conn(0x266a950 0x26f2ba0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4188037210 msgr2=0x7f4188039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4188037210 0x7f4188039720 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 msgr2=0x26fc730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.834 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x26fc730 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 shutdown_connections 2024-04-23T01:57:08.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/294805173 >> v2:172.21.15.37:6802/1949701083 conn(0x266a950 0x26f2ba0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f4188037210 0x7f4188039720 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.831+0000 7f41aa2daec0 1 --2- 172.21.15.37:0/294805173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25d4cb0 0x26fc730 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.832+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 >> 172.21.15.37:0/294805173 conn(0x24f3960 msgr2=0x266a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.832+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 shutdown_connections 2024-04-23T01:57:08.835 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.832+0000 7f41aa2daec0 1 -- 172.21.15.37:0/294805173 wait complete. 2024-04-23T01:57:08.836 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:08.836 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj5 /etc/passwd 2024-04-23T01:57:08.873 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.871+0000 7f7393283ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.878 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.877+0000 7f7393283ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.879 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.877+0000 7f7393283ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.878+0000 7f7393283ec0 1 Processor -- start 2024-04-23T01:57:08.880 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.878+0000 7f7393283ec0 1 -- start start 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.880+0000 7f7393283ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1aaf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.880+0000 7f7393283ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x18fc950 con 0x1997450 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.880+0000 7f738b39b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1aaf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.880+0000 7f738b39b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1aaf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35250/0 (socket says 172.21.15.37:35250) 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.880+0000 7f738b39b640 1 -- 172.21.15.37:0/2858401593 learned_addr learned my addr 172.21.15.37:0/2858401593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.881+0000 7f738b39b640 1 -- 172.21.15.37:0/2858401593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x189b1e0 con 0x1997450 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.881+0000 7f738b39b640 1 --2- 172.21.15.37:0/2858401593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1aaf500 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f6bd0c14127ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.881+0000 7f7389b98640 1 -- 172.21.15.37:0/2858401593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f737c02c3f0 con 0x1997450 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.881+0000 7f7389b98640 1 -- 172.21.15.37:0/2858401593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f737c02c550 con 0x1997450 2024-04-23T01:57:08.883 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.881+0000 7f7389b98640 1 -- 172.21.15.37:0/2858401593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f737c02cd10 con 0x1997450 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.882+0000 7f7393283ec0 1 -- 172.21.15.37:0/2858401593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 msgr2=0x1aaf500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.882+0000 7f7393283ec0 1 --2- 172.21.15.37:0/2858401593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1aaf500 crc :-1 s=READY pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.882+0000 7f7393283ec0 1 -- 172.21.15.37:0/2858401593 shutdown_connections 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.882+0000 7f7393283ec0 1 --2- 172.21.15.37:0/2858401593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1aaf500 unknown :-1 s=CLOSED pgs=12915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.882+0000 7f7393283ec0 1 -- 172.21.15.37:0/2858401593 >> 172.21.15.37:0/2858401593 conn(0x18b3960 msgr2=0x1990a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.882+0000 7f7393283ec0 1 -- 172.21.15.37:0/2858401593 shutdown_connections 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.882+0000 7f7393283ec0 1 -- 172.21.15.37:0/2858401593 wait complete. 2024-04-23T01:57:08.885 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.883+0000 7f7393283ec0 1 Processor -- start 2024-04-23T01:57:08.886 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.883+0000 7f7393283ec0 1 -- start start 2024-04-23T01:57:08.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.884+0000 7f7393283ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1a130e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.884+0000 7f7393283ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x18fa3d0 con 0x1997450 2024-04-23T01:57:08.888 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f738b39b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1a130e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f738b39b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1a130e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35262/0 (socket says 172.21.15.37:35262) 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f738b39b640 1 -- 172.21.15.37:0/1273195598 learned_addr learned my addr 172.21.15.37:0/1273195598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f738b39b640 1 -- 172.21.15.37:0/1273195598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x188de30 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f738b39b640 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1a130e0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f7388b96640 1 -- 172.21.15.37:0/1273195598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f737c03d040 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f7388b96640 1 -- 172.21.15.37:0/1273195598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f737c038870 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f7388b96640 1 -- 172.21.15.37:0/1273195598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f737c038b10 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x188d890 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.885+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a15690 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.886+0000 7f7388b96640 1 -- 172.21.15.37:0/1273195598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f737c040040 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.886+0000 7f7388b96640 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f73640371c0 0x7f73640396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.886+0000 7f7388b96640 1 -- 172.21.15.37:0/1273195598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7f737c031040 con 0x1997450 2024-04-23T01:57:08.889 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.887+0000 7f7393283ec0 1 --2- 172.21.15.37:0/1273195598 >> v2:172.21.15.191:6805/3894758024 conn(0x1a299c0 0x1a257f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.887+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 201.3 201:c52c9666:::obj5:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x19907f0 con 0x1a299c0 2024-04-23T01:57:08.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.887+0000 7f738ab9a640 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f73640371c0 0x7f73640396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.887+0000 7f738ab9a640 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f73640371c0 0x7f73640396d0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.890 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.888+0000 7f738bb9c640 1 --2- 172.21.15.37:0/1273195598 >> v2:172.21.15.191:6805/3894758024 conn(0x1a299c0 0x1a257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:08.894 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.892+0000 7f738bb9c640 1 --2- 172.21.15.37:0/1273195598 >> v2:172.21.15.191:6805/3894758024 conn(0x1a299c0 0x1a257f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f738bb9c640 1 -- 172.21.15.37:0/1273195598 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 obj5 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f737400a430 con 0x1a299c0 2024-04-23T01:57:08.907 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 >> v2:172.21.15.191:6805/3894758024 conn(0x1a299c0 msgr2=0x1a257f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 --2- 172.21.15.37:0/1273195598 >> v2:172.21.15.191:6805/3894758024 conn(0x1a299c0 0x1a257f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f73640371c0 msgr2=0x7f73640396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f73640371c0 0x7f73640396d0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 msgr2=0x1a130e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1a130e0 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 shutdown_connections 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 --2- 172.21.15.37:0/1273195598 >> v2:172.21.15.191:6805/3894758024 conn(0x1a299c0 0x1a257f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f73640371c0 0x7f73640396d0 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 --2- 172.21.15.37:0/1273195598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1997450 0x1a130e0 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 >> 172.21.15.37:0/1273195598 conn(0x18b3960 msgr2=0x1999940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 shutdown_connections 2024-04-23T01:57:08.908 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.905+0000 7f7393283ec0 1 -- 172.21.15.37:0/1273195598 wait complete. 2024-04-23T01:57:08.909 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:08.909 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj6 /etc/passwd 2024-04-23T01:57:08.945 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.943+0000 7fdd90c31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.949+0000 7fdd90c31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.951 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.949+0000 7fdd90c31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:08.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.950+0000 7fdd90c31ec0 1 Processor -- start 2024-04-23T01:57:08.952 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.950+0000 7fdd90c31ec0 1 -- start start 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.951+0000 7fdd90c31ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x179f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.951+0000 7fdd90c31ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x170e950 con 0x183b570 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd88d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x179f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd88d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x179f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35288/0 (socket says 172.21.15.37:35288) 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd88d9b640 1 -- 172.21.15.37:0/3817750818 learned_addr learned my addr 172.21.15.37:0/3817750818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd88d9b640 1 -- 172.21.15.37:0/3817750818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16ad1e0 con 0x183b570 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd88d9b640 1 --2- 172.21.15.37:0/3817750818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x179f550 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea19beecd8323a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.954 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd827fc640 1 -- 172.21.15.37:0/3817750818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd7c006780 con 0x183b570 2024-04-23T01:57:08.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd827fc640 1 -- 172.21.15.37:0/3817750818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd7c0068e0 con 0x183b570 2024-04-23T01:57:08.955 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.952+0000 7fdd827fc640 1 -- 172.21.15.37:0/3817750818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd7c006be0 con 0x183b570 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.953+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3817750818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 msgr2=0x179f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.953+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3817750818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x179f550 crc :-1 s=READY pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.953+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3817750818 shutdown_connections 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.953+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3817750818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x179f550 unknown :-1 s=CLOSED pgs=12919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.953+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3817750818 >> 172.21.15.37:0/3817750818 conn(0x16c5960 msgr2=0x183abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.953+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3817750818 shutdown_connections 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.953+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3817750818 wait complete. 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.954+0000 7fdd90c31ec0 1 Processor -- start 2024-04-23T01:57:08.956 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.954+0000 7fdd90c31ec0 1 -- start start 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.955+0000 7fdd90c31ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x183f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.955+0000 7fdd90c31ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x170c3d0 con 0x183b570 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.955+0000 7fdd88d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x183f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.955+0000 7fdd88d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x183f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35294/0 (socket says 172.21.15.37:35294) 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.955+0000 7fdd88d9b640 1 -- 172.21.15.37:0/3448868201 learned_addr learned my addr 172.21.15.37:0/3448868201 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.956+0000 7fdd88d9b640 1 -- 172.21.15.37:0/3448868201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x169fe30 con 0x183b570 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.956+0000 7fdd88d9b640 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x183f6e0 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.958 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.956+0000 7fdd817fa640 1 -- 172.21.15.37:0/3448868201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd7c039040 con 0x183b570 2024-04-23T01:57:08.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.956+0000 7fdd817fa640 1 -- 172.21.15.37:0/3448868201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdd7c033620 con 0x183b570 2024-04-23T01:57:08.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.956+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x169f890 con 0x183b570 2024-04-23T01:57:08.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.956+0000 7fdd817fa640 1 -- 172.21.15.37:0/3448868201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdd7c0338c0 con 0x183b570 2024-04-23T01:57:08.959 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.956+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1840bc0 con 0x183b570 2024-04-23T01:57:08.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.957+0000 7fdd817fa640 1 -- 172.21.15.37:0/3448868201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdd7c03c040 con 0x183b570 2024-04-23T01:57:08.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.957+0000 7fdd817fa640 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdd64037210 0x7fdd64039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.957+0000 7fdd817fa640 1 -- 172.21.15.37:0/3448868201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7fdd7c069120 con 0x183b570 2024-04-23T01:57:08.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.958+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3448868201 >> v2:172.21.15.191:6808/1018833307 conn(0x183bec0 0x1836520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:08.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.958+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 --> v2:172.21.15.191:6808/1018833307 -- osd_op(unknown.0.0:1 201.4 201:233a42c1:::obj6:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x183ef60 con 0x183bec0 2024-04-23T01:57:08.960 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.958+0000 7fdd837fe640 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdd64037210 0x7fdd64039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:08.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.958+0000 7fdd837fe640 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdd64037210 0x7fdd64039720 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.961 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.959+0000 7fdd8959c640 1 --2- 172.21.15.37:0/3448868201 >> v2:172.21.15.191:6808/1018833307 conn(0x183bec0 0x1836520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:08.966 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.963+0000 7fdd8959c640 1 --2- 172.21.15.37:0/3448868201 >> v2:172.21.15.191:6808/1018833307 conn(0x183bec0 0x1836520 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.975+0000 7fdd8959c640 1 -- 172.21.15.37:0/3448868201 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== osd_op_reply(1 obj6 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fdd7400a430 con 0x183bec0 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 >> v2:172.21.15.191:6808/1018833307 conn(0x183bec0 msgr2=0x1836520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3448868201 >> v2:172.21.15.191:6808/1018833307 conn(0x183bec0 0x1836520 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdd64037210 msgr2=0x7fdd64039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdd64037210 0x7fdd64039720 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 msgr2=0x183f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x183f6e0 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 shutdown_connections 2024-04-23T01:57:08.979 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3448868201 >> v2:172.21.15.191:6808/1018833307 conn(0x183bec0 0x1836520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fdd64037210 0x7fdd64039720 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 --2- 172.21.15.37:0/3448868201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x183b570 0x183f6e0 unknown :-1 s=CLOSED pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:08.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 >> 172.21.15.37:0/3448868201 conn(0x16c5960 msgr2=0x179f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:08.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 shutdown_connections 2024-04-23T01:57:08.980 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:08.976+0000 7fdd90c31ec0 1 -- 172.21.15.37:0/3448868201 wait complete. 2024-04-23T01:57:08.980 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:08.980 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj7 /etc/passwd 2024-04-23T01:57:09.016 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.014+0000 7feb84cfcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.020+0000 7feb84cfcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.022 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.020+0000 7feb84cfcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.021+0000 7feb84cfcec0 1 Processor -- start 2024-04-23T01:57:09.023 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.021+0000 7feb84cfcec0 1 -- start start 2024-04-23T01:57:09.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb84cfcec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xb0b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb84cfcec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x9db950 con 0xa746a0 2024-04-23T01:57:09.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb7d19b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xb0b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb7d19b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xb0b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35322/0 (socket says 172.21.15.37:35322) 2024-04-23T01:57:09.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb7d19b640 1 -- 172.21.15.37:0/620750238 learned_addr learned my addr 172.21.15.37:0/620750238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.025 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb7d19b640 1 -- 172.21.15.37:0/620750238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x97a1e0 con 0xa746a0 2024-04-23T01:57:09.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb7d19b640 1 --2- 172.21.15.37:0/620750238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xb0b6d0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd2651c34917cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb76ffd640 1 -- 172.21.15.37:0/620750238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb6800b5d0 con 0xa746a0 2024-04-23T01:57:09.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb76ffd640 1 -- 172.21.15.37:0/620750238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb6800b730 con 0xa746a0 2024-04-23T01:57:09.026 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.023+0000 7feb76ffd640 1 -- 172.21.15.37:0/620750238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb6800b9d0 con 0xa746a0 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.024+0000 7feb84cfcec0 1 -- 172.21.15.37:0/620750238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 msgr2=0xb0b6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.024+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/620750238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xb0b6d0 crc :-1 s=READY pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.024+0000 7feb84cfcec0 1 -- 172.21.15.37:0/620750238 shutdown_connections 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.024+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/620750238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xb0b6d0 unknown :-1 s=CLOSED pgs=12923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.024+0000 7feb84cfcec0 1 -- 172.21.15.37:0/620750238 >> 172.21.15.37:0/620750238 conn(0x992960 msgr2=0xa75d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.024+0000 7feb84cfcec0 1 -- 172.21.15.37:0/620750238 shutdown_connections 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.024+0000 7feb84cfcec0 1 -- 172.21.15.37:0/620750238 wait complete. 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.025+0000 7feb84cfcec0 1 Processor -- start 2024-04-23T01:57:09.027 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.025+0000 7feb84cfcec0 1 -- start start 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb84cfcec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xaf20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb84cfcec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x9d93d0 con 0xa746a0 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb7d19b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xaf20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb7d19b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xaf20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35326/0 (socket says 172.21.15.37:35326) 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb7d19b640 1 -- 172.21.15.37:0/2309453128 learned_addr learned my addr 172.21.15.37:0/2309453128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb7d19b640 1 -- 172.21.15.37:0/2309453128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x96ce30 con 0xa746a0 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb7d19b640 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xaf20e0 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb75ffb640 1 -- 172.21.15.37:0/2309453128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb680129c0 con 0xa746a0 2024-04-23T01:57:09.030 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb75ffb640 1 -- 172.21.15.37:0/2309453128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7feb68005040 con 0xa746a0 2024-04-23T01:57:09.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x96c890 con 0xa746a0 2024-04-23T01:57:09.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb75ffb640 1 -- 172.21.15.37:0/2309453128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7feb68012c50 con 0xa746a0 2024-04-23T01:57:09.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.027+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb96930 con 0xa746a0 2024-04-23T01:57:09.031 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.028+0000 7feb75ffb640 1 -- 172.21.15.37:0/2309453128 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7feb6800d040 con 0xa746a0 2024-04-23T01:57:09.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.029+0000 7feb75ffb640 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7feb640371c0 0x7feb640396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.029+0000 7feb75ffb640 1 -- 172.21.15.37:0/2309453128 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7feb6800a040 con 0xa746a0 2024-04-23T01:57:09.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.029+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/2309453128 >> v2:172.21.15.191:6805/3894758024 conn(0xa74ab0 0xb0a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.029+0000 7feb7c99a640 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7feb640371c0 0x7feb640396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.029+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 201.9 201:9a09113a:::obj7:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0xaf4d70 con 0xa74ab0 2024-04-23T01:57:09.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.029+0000 7feb7c99a640 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7feb640371c0 0x7feb640396d0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.032 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.030+0000 7feb7d99c640 1 --2- 172.21.15.37:0/2309453128 >> v2:172.21.15.191:6805/3894758024 conn(0xa74ab0 0xb0a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:09.036 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.034+0000 7feb7d99c640 1 --2- 172.21.15.37:0/2309453128 >> v2:172.21.15.191:6805/3894758024 conn(0xa74ab0 0xb0a050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb7d99c640 1 -- 172.21.15.37:0/2309453128 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 obj7 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb7000a430 con 0xa74ab0 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 >> v2:172.21.15.191:6805/3894758024 conn(0xa74ab0 msgr2=0xb0a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/2309453128 >> v2:172.21.15.191:6805/3894758024 conn(0xa74ab0 0xb0a050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7feb640371c0 msgr2=0x7feb640396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7feb640371c0 0x7feb640396d0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 msgr2=0xaf20e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xaf20e0 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 shutdown_connections 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/2309453128 >> v2:172.21.15.191:6805/3894758024 conn(0xa74ab0 0xb0a050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7feb640371c0 0x7feb640396d0 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 --2- 172.21.15.37:0/2309453128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0xa746a0 0xaf20e0 unknown :-1 s=CLOSED pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.050 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 >> 172.21.15.37:0/2309453128 conn(0x992960 msgr2=0xa75300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 shutdown_connections 2024-04-23T01:57:09.051 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.047+0000 7feb84cfcec0 1 -- 172.21.15.37:0/2309453128 wait complete. 2024-04-23T01:57:09.052 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:09.052 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj8 /etc/passwd 2024-04-23T01:57:09.088 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.086+0000 7fd2da432ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.091+0000 7fd2da432ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.093 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.091+0000 7fd2da432ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.092+0000 7fd2da432ec0 1 Processor -- start 2024-04-23T01:57:09.094 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.092+0000 7fd2da432ec0 1 -- start start 2024-04-23T01:57:09.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2da432ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x1fa7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2da432ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1f0c950 con 0x1fa56a0 2024-04-23T01:57:09.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d259b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x1fa7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d259b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x1fa7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35346/0 (socket says 172.21.15.37:35346) 2024-04-23T01:57:09.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d259b640 1 -- 172.21.15.37:0/4206141460 learned_addr learned my addr 172.21.15.37:0/4206141460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.097 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d259b640 1 -- 172.21.15.37:0/4206141460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1eab1e0 con 0x1fa56a0 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d259b640 1 --2- 172.21.15.37:0/4206141460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x1fa7b50 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7005270304758b04 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d0d98640 1 -- 172.21.15.37:0/4206141460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2c000d500 con 0x1fa56a0 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d0d98640 1 -- 172.21.15.37:0/4206141460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd2c000d660 con 0x1fa56a0 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.094+0000 7fd2d0d98640 1 -- 172.21.15.37:0/4206141460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2c000d900 con 0x1fa56a0 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.095+0000 7fd2da432ec0 1 -- 172.21.15.37:0/4206141460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 msgr2=0x1fa7b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.095+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/4206141460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x1fa7b50 crc :-1 s=READY pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.095+0000 7fd2da432ec0 1 -- 172.21.15.37:0/4206141460 shutdown_connections 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.095+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/4206141460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x1fa7b50 unknown :-1 s=CLOSED pgs=12927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.095+0000 7fd2da432ec0 1 -- 172.21.15.37:0/4206141460 >> 172.21.15.37:0/4206141460 conn(0x1ec3960 msgr2=0x20c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.095+0000 7fd2da432ec0 1 -- 172.21.15.37:0/4206141460 shutdown_connections 2024-04-23T01:57:09.098 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.095+0000 7fd2da432ec0 1 -- 172.21.15.37:0/4206141460 wait complete. 2024-04-23T01:57:09.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.096+0000 7fd2da432ec0 1 Processor -- start 2024-04-23T01:57:09.099 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.096+0000 7fd2da432ec0 1 -- start start 2024-04-23T01:57:09.100 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2da432ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x20aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2da432ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1f0a3d0 con 0x1fa56a0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2d259b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x20aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2d259b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x20aa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35356/0 (socket says 172.21.15.37:35356) 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2d259b640 1 -- 172.21.15.37:0/3006962520 learned_addr learned my addr 172.21.15.37:0/3006962520 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2d259b640 1 -- 172.21.15.37:0/3006962520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e9de30 con 0x1fa56a0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2d259b640 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x20aa8a0 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2caffd640 1 -- 172.21.15.37:0/3006962520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2c000fb60 con 0x1fa56a0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2caffd640 1 -- 172.21.15.37:0/3006962520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd2c000fcc0 con 0x1fa56a0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e9d890 con 0x1fa56a0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.098+0000 7fd2caffd640 1 -- 172.21.15.37:0/3006962520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd2c000c360 con 0x1fa56a0 2024-04-23T01:57:09.101 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.099+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20adc40 con 0x1fa56a0 2024-04-23T01:57:09.102 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.099+0000 7fd2caffd640 1 -- 172.21.15.37:0/3006962520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd2c000c550 con 0x1fa56a0 2024-04-23T01:57:09.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.100+0000 7fd2caffd640 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd2b8037210 0x7fd2b8039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.100+0000 7fd2caffd640 1 -- 172.21.15.37:0/3006962520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7fd2c0049050 con 0x1fa56a0 2024-04-23T01:57:09.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.100+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/3006962520 >> v2:172.21.15.191:6805/3894758024 conn(0x1fa5ab0 0x20bcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.100+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 201.5 201:a557efb1:::obj8:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x20ae290 con 0x1fa5ab0 2024-04-23T01:57:09.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.100+0000 7fd2d1d9a640 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd2b8037210 0x7fd2b8039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.100+0000 7fd2d1d9a640 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd2b8037210 0x7fd2b8039720 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.103 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.101+0000 7fd2d2d9c640 1 --2- 172.21.15.37:0/3006962520 >> v2:172.21.15.191:6805/3894758024 conn(0x1fa5ab0 0x20bcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:09.105 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.104+0000 7fd2d2d9c640 1 --2- 172.21.15.37:0/3006962520 >> v2:172.21.15.191:6805/3894758024 conn(0x1fa5ab0 0x20bcd80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2d2d9c640 1 -- 172.21.15.37:0/3006962520 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 obj8 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fd2c400a430 con 0x1fa5ab0 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 >> v2:172.21.15.191:6805/3894758024 conn(0x1fa5ab0 msgr2=0x20bcd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/3006962520 >> v2:172.21.15.191:6805/3894758024 conn(0x1fa5ab0 0x20bcd80 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd2b8037210 msgr2=0x7fd2b8039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd2b8037210 0x7fd2b8039720 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 msgr2=0x20aa8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x20aa8a0 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 shutdown_connections 2024-04-23T01:57:09.118 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/3006962520 >> v2:172.21.15.191:6805/3894758024 conn(0x1fa5ab0 0x20bcd80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fd2b8037210 0x7fd2b8039720 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 --2- 172.21.15.37:0/3006962520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1fa56a0 0x20aa8a0 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 >> 172.21.15.37:0/3006962520 conn(0x1ec3960 msgr2=0x20c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 shutdown_connections 2024-04-23T01:57:09.119 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.115+0000 7fd2da432ec0 1 -- 172.21.15.37:0/3006962520 wait complete. 2024-04-23T01:57:09.119 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:09.120 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj9 /etc/passwd 2024-04-23T01:57:09.156 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.154+0000 7fbac3912ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.160+0000 7fbac3912ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.162 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.160+0000 7fbac3912ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.161+0000 7fbac3912ec0 1 Processor -- start 2024-04-23T01:57:09.163 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.161+0000 7fbac3912ec0 1 -- start start 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.162+0000 7fbac3912ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x1405500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.162+0000 7fbac3912ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1252950 con 0x12ed450 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x1405500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x1405500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35364/0 (socket says 172.21.15.37:35364) 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab6ffd640 1 -- 172.21.15.37:0/2341072155 learned_addr learned my addr 172.21.15.37:0/2341072155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab6ffd640 1 -- 172.21.15.37:0/2341072155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11f11e0 con 0x12ed450 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab6ffd640 1 --2- 172.21.15.37:0/2341072155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x1405500 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67981b4bc7f138d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.165 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab57fa640 1 -- 172.21.15.37:0/2341072155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa8032040 con 0x12ed450 2024-04-23T01:57:09.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab57fa640 1 -- 172.21.15.37:0/2341072155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbaa800a040 con 0x12ed450 2024-04-23T01:57:09.166 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.163+0000 7fbab57fa640 1 -- 172.21.15.37:0/2341072155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa800a2e0 con 0x12ed450 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.164+0000 7fbac3912ec0 1 -- 172.21.15.37:0/2341072155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 msgr2=0x1405500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.164+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/2341072155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x1405500 crc :-1 s=READY pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.164+0000 7fbac3912ec0 1 -- 172.21.15.37:0/2341072155 shutdown_connections 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.164+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/2341072155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x1405500 unknown :-1 s=CLOSED pgs=12931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.164+0000 7fbac3912ec0 1 -- 172.21.15.37:0/2341072155 >> 172.21.15.37:0/2341072155 conn(0x1209960 msgr2=0x12e6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.164+0000 7fbac3912ec0 1 -- 172.21.15.37:0/2341072155 shutdown_connections 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.164+0000 7fbac3912ec0 1 -- 172.21.15.37:0/2341072155 wait complete. 2024-04-23T01:57:09.172 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.165+0000 7fbac3912ec0 1 Processor -- start 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.165+0000 7fbac3912ec0 1 -- start start 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.166+0000 7fbac3912ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x137ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.166+0000 7fbac3912ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x12503d0 con 0x12ed450 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.166+0000 7fbab6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x137ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.166+0000 7fbab6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x137ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35380/0 (socket says 172.21.15.37:35380) 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.166+0000 7fbab6ffd640 1 -- 172.21.15.37:0/3064381502 learned_addr learned my addr 172.21.15.37:0/3064381502 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.167+0000 7fbab6ffd640 1 -- 172.21.15.37:0/3064381502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x11e3e30 con 0x12ed450 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.167+0000 7fbab6ffd640 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x137ba90 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.167+0000 7fba9ffff640 1 -- 172.21.15.37:0/3064381502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa802d650 con 0x12ed450 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.167+0000 7fba9ffff640 1 -- 172.21.15.37:0/3064381502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbaa802d7b0 con 0x12ed450 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.167+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x11e3890 con 0x12ed450 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.167+0000 7fba9ffff640 1 -- 172.21.15.37:0/3064381502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaa802da50 con 0x12ed450 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.167+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x136a980 con 0x12ed450 2024-04-23T01:57:09.173 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.168+0000 7fba9ffff640 1 -- 172.21.15.37:0/3064381502 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fbaa802dc50 con 0x12ed450 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.168+0000 7fba9ffff640 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fbaa4037210 0x7fbaa4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.168+0000 7fba9ffff640 1 -- 172.21.15.37:0/3064381502 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7fbaa8032040 con 0x12ed450 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.168+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/3064381502 >> v2:172.21.15.37:6802/1949701083 conn(0x137f9c0 0x1368570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.169+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 --> v2:172.21.15.37:6802/1949701083 -- osd_op(unknown.0.0:1 201.7 201:fe351e27:::obj9:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x136b7d0 con 0x137f9c0 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.169+0000 7fbab67fc640 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fbaa4037210 0x7fbaa4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.169+0000 7fbab67fc640 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fbaa4037210 0x7fbaa4039720 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.169+0000 7fbab77fe640 1 --2- 172.21.15.37:0/3064381502 >> v2:172.21.15.37:6802/1949701083 conn(0x137f9c0 0x1368570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:09.174 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.172+0000 7fbab77fe640 1 --2- 172.21.15.37:0/3064381502 >> v2:172.21.15.37:6802/1949701083 conn(0x137f9c0 0x1368570 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbab77fe640 1 -- 172.21.15.37:0/3064381502 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== osd_op_reply(1 obj9 [writefull 0~11876] v710'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbab000a430 con 0x137f9c0 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 >> v2:172.21.15.37:6802/1949701083 conn(0x137f9c0 msgr2=0x1368570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/3064381502 >> v2:172.21.15.37:6802/1949701083 conn(0x137f9c0 0x1368570 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fbaa4037210 msgr2=0x7fbaa4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fbaa4037210 0x7fbaa4039720 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 msgr2=0x137ba90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x137ba90 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 shutdown_connections 2024-04-23T01:57:09.186 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/3064381502 >> v2:172.21.15.37:6802/1949701083 conn(0x137f9c0 0x1368570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fbaa4037210 0x7fbaa4039720 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 --2- 172.21.15.37:0/3064381502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x12ed450 0x137ba90 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 >> 172.21.15.37:0/3064381502 conn(0x1209960 msgr2=0x12e6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 shutdown_connections 2024-04-23T01:57:09.187 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.182+0000 7fbac3912ec0 1 -- 172.21.15.37:0/3064381502 wait complete. 2024-04-23T01:57:09.187 INFO:tasks.workunit.client.0.smithi037.stderr:+ for f in `seq 1 10` 2024-04-23T01:57:09.187 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p 66e90510-9ce4-418d-804c-f8d1f71f3917 put obj10 /etc/passwd 2024-04-23T01:57:09.222 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.221+0000 7f683c640ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.228 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.226+0000 7f683c640ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.226+0000 7f683c640ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:09.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.227+0000 7f683c640ec0 1 Processor -- start 2024-04-23T01:57:09.229 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.227+0000 7f683c640ec0 1 -- start start 2024-04-23T01:57:09.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.229+0000 7f683c640ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x25d9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.229+0000 7f683c640ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x24af950 con 0x25dc9c0 2024-04-23T01:57:09.231 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.229+0000 7f682f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x25d9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.229+0000 7f682f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x25d9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35394/0 (socket says 172.21.15.37:35394) 2024-04-23T01:57:09.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.229+0000 7f682f7fe640 1 -- 172.21.15.37:0/3822469174 learned_addr learned my addr 172.21.15.37:0/3822469174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.229+0000 7f682f7fe640 1 -- 172.21.15.37:0/3822469174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x244e1e0 con 0x25dc9c0 2024-04-23T01:57:09.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.229+0000 7f682f7fe640 1 --2- 172.21.15.37:0/3822469174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x25d9590 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ac86b7b8d1deae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f682dffb640 1 -- 172.21.15.37:0/3822469174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f682800b5d0 con 0x25dc9c0 2024-04-23T01:57:09.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f682dffb640 1 -- 172.21.15.37:0/3822469174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f682800b730 con 0x25dc9c0 2024-04-23T01:57:09.232 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f682dffb640 1 -- 172.21.15.37:0/3822469174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f682800b9d0 con 0x25dc9c0 2024-04-23T01:57:09.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f683c640ec0 1 -- 172.21.15.37:0/3822469174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 msgr2=0x25d9590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f683c640ec0 1 --2- 172.21.15.37:0/3822469174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x25d9590 crc :-1 s=READY pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f683c640ec0 1 -- 172.21.15.37:0/3822469174 shutdown_connections 2024-04-23T01:57:09.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f683c640ec0 1 --2- 172.21.15.37:0/3822469174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x25d9590 unknown :-1 s=CLOSED pgs=12935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f683c640ec0 1 -- 172.21.15.37:0/3822469174 >> 172.21.15.37:0/3822469174 conn(0x2466960 msgr2=0x25de700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.233 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f683c640ec0 1 -- 172.21.15.37:0/3822469174 shutdown_connections 2024-04-23T01:57:09.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.230+0000 7f683c640ec0 1 -- 172.21.15.37:0/3822469174 wait complete. 2024-04-23T01:57:09.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.231+0000 7f683c640ec0 1 Processor -- start 2024-04-23T01:57:09.234 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.231+0000 7f683c640ec0 1 -- start start 2024-04-23T01:57:09.235 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.233+0000 7f683c640ec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x266e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.233+0000 7f683c640ec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x24ad3d0 con 0x25dc9c0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.233+0000 7f682f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x266e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.233+0000 7f682f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x266e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35402/0 (socket says 172.21.15.37:35402) 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.233+0000 7f682f7fe640 1 -- 172.21.15.37:0/2552165256 learned_addr learned my addr 172.21.15.37:0/2552165256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.233+0000 7f682f7fe640 1 -- 172.21.15.37:0/2552165256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2440e30 con 0x25dc9c0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.233+0000 7f682f7fe640 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x266e3f0 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.234+0000 7f682cff9640 1 -- 172.21.15.37:0/2552165256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6828012910 con 0x25dc9c0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.234+0000 7f682cff9640 1 -- 172.21.15.37:0/2552165256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6828005040 con 0x25dc9c0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.234+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2440890 con 0x25dc9c0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.234+0000 7f682cff9640 1 -- 172.21.15.37:0/2552165256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6828012ba0 con 0x25dc9c0 2024-04-23T01:57:09.236 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.234+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2542830 con 0x25dc9c0 2024-04-23T01:57:09.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.235+0000 7f682cff9640 1 -- 172.21.15.37:0/2552165256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f682800d040 con 0x25dc9c0 2024-04-23T01:57:09.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.235+0000 7f682cff9640 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6810037210 0x7f6810039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.235+0000 7f682cff9640 1 -- 172.21.15.37:0/2552165256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(710..710 src has 609..710) ==== 4179+0+0 (crc 0 0 0) 0x7f682800a040 con 0x25dc9c0 2024-04-23T01:57:09.237 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.235+0000 7f683c640ec0 1 --2- 172.21.15.37:0/2552165256 >> v2:172.21.15.191:6805/3894758024 conn(0x25df800 0x2671750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.235+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 --> v2:172.21.15.191:6805/3894758024 -- osd_op(unknown.0.0:1 201.b 201:d1337354:::obj10:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0x25448b0 con 0x25df800 2024-04-23T01:57:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.235+0000 7f682effd640 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6810037210 0x7f6810039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.236+0000 7f682effd640 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6810037210 0x7f6810039720 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.238 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.236+0000 7f6834f9c640 1 --2- 172.21.15.37:0/2552165256 >> v2:172.21.15.191:6805/3894758024 conn(0x25df800 0x2671750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:09.242 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.241+0000 7f6834f9c640 1 --2- 172.21.15.37:0/2552165256 >> v2:172.21.15.191:6805/3894758024 conn(0x25df800 0x2671750 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f6834f9c640 1 -- 172.21.15.37:0/2552165256 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== osd_op_reply(1 obj10 [writefull 0~11876] v710'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f682000a430 con 0x25df800 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 >> v2:172.21.15.191:6805/3894758024 conn(0x25df800 msgr2=0x2671750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 --2- 172.21.15.37:0/2552165256 >> v2:172.21.15.191:6805/3894758024 conn(0x25df800 0x2671750 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6810037210 msgr2=0x7f6810039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6810037210 0x7f6810039720 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 msgr2=0x266e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x266e3f0 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 shutdown_connections 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 --2- 172.21.15.37:0/2552165256 >> v2:172.21.15.191:6805/3894758024 conn(0x25df800 0x2671750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f6810037210 0x7f6810039720 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 --2- 172.21.15.37:0/2552165256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x25dc9c0 0x266e3f0 unknown :-1 s=CLOSED pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:09.256 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.253+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 >> 172.21.15.37:0/2552165256 conn(0x2466960 msgr2=0x25de700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:09.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.254+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 shutdown_connections 2024-04-23T01:57:09.257 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:09.254+0000 7f683c640ec0 1 -- 172.21.15.37:0/2552165256 wait complete. 2024-04-23T01:57:09.258 INFO:tasks.workunit.client.0.smithi037.stderr:+ sleep 30 2024-04-23T01:57:39.259 INFO:tasks.workunit.client.0.smithi037.stderr:+ rados -p d506dafc-2d08-46f3-8878-f69f9e013c29 put threemore /etc/passwd 2024-04-23T01:57:39.306 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.304+0000 7f0f9ce2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:39.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.310+0000 7f0f9ce2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:39.312 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.310+0000 7f0f9ce2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:39.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.311+0000 7f0f9ce2cec0 1 Processor -- start 2024-04-23T01:57:39.313 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.311+0000 7f0f9ce2cec0 1 -- start start 2024-04-23T01:57:39.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f9ce2cec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:39.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f9ce2cec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1bcf950 con 0x1c6a450 2024-04-23T01:57:39.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f94f9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:39.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f94f9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42416/0 (socket says 172.21.15.37:42416) 2024-04-23T01:57:39.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f94f9b640 1 -- 172.21.15.37:0/3611691423 learned_addr learned my addr 172.21.15.37:0/3611691423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:39.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f94f9b640 1 -- 172.21.15.37:0/3611691423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b6e1e0 con 0x1c6a450 2024-04-23T01:57:39.315 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f94f9b640 1 --2- 172.21.15.37:0/3611691423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce5090 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605a337a026bfa58 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:39.316 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f8e7fc640 1 -- 172.21.15.37:0/3611691423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f80032040 con 0x1c6a450 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f8e7fc640 1 -- 172.21.15.37:0/3611691423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f8000a040 con 0x1c6a450 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.313+0000 7f0f8e7fc640 1 -- 172.21.15.37:0/3611691423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f8000a2e0 con 0x1c6a450 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.314+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/3611691423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 msgr2=0x1ce5090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.314+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/3611691423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce5090 crc :-1 s=READY pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.314+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/3611691423 shutdown_connections 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.314+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/3611691423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce5090 unknown :-1 s=CLOSED pgs=12939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.314+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/3611691423 >> 172.21.15.37:0/3611691423 conn(0x1b86960 msgr2=0x1c63890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.314+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/3611691423 shutdown_connections 2024-04-23T01:57:39.317 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.314+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/3611691423 wait complete. 2024-04-23T01:57:39.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.315+0000 7f0f9ce2cec0 1 Processor -- start 2024-04-23T01:57:39.318 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.315+0000 7f0f9ce2cec0 1 -- start start 2024-04-23T01:57:39.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.317+0000 7f0f9ce2cec0 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:39.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.317+0000 7f0f9ce2cec0 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x1bcd3d0 con 0x1c6a450 2024-04-23T01:57:39.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.317+0000 7f0f94f9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:39.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.317+0000 7f0f94f9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42428/0 (socket says 172.21.15.37:42428) 2024-04-23T01:57:39.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.317+0000 7f0f94f9b640 1 -- 172.21.15.37:0/119648745 learned_addr learned my addr 172.21.15.37:0/119648745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:39.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.317+0000 7f0f94f9b640 1 -- 172.21.15.37:0/119648745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b60e30 con 0x1c6a450 2024-04-23T01:57:39.319 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.317+0000 7f0f94f9b640 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce83b0 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:39.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.318+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/119648745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f8002d650 con 0x1c6a450 2024-04-23T01:57:39.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.318+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/119648745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f8002d7b0 con 0x1c6a450 2024-04-23T01:57:39.320 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.318+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b60890 con 0x1c6a450 2024-04-23T01:57:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.318+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/119648745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f8002da50 con 0x1c6a450 2024-04-23T01:57:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.318+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ceb810 con 0x1c6a450 2024-04-23T01:57:39.321 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.319+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/119648745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0f8002dc00 con 0x1c6a450 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.319+0000 7f0f8d7fa640 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f7c037210 0x7f0f7c039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.319+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/119648745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(712..712 src has 609..712) ==== 4179+0+0 (crc 0 0 0) 0x7f0f80032040 con 0x1c6a450 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.319+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/119648745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7f0f7c03dbc0 con 0x1c6a450 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.319+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/119648745 >> v2:172.21.15.37:6805/1977556410 conn(0x1cfc9c0 0x1d915f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.319+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 --> v2:172.21.15.37:6805/1977556410 -- osd_op(unknown.0.0:1 200.2 200:47cad802:::threemore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e712) -- 0x1cebfb0 con 0x1cfc9c0 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.319+0000 7f0f8f7fe640 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f7c037210 0x7f0f7c039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.320+0000 7f0f9579c640 1 --2- 172.21.15.37:0/119648745 >> v2:172.21.15.37:6805/1977556410 conn(0x1cfc9c0 0x1d915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:57:39.322 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.320+0000 7f0f8f7fe640 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f7c037210 0x7f0f7c039720 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:39.325 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.323+0000 7f0f9579c640 1 --2- 172.21.15.37:0/119648745 >> v2:172.21.15.37:6805/1977556410 conn(0x1cfc9c0 0x1d915f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:39.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9579c640 1 -- 172.21.15.37:0/119648745 <== osd.1 v2:172.21.15.37:6805/1977556410 1 ==== osd_op_reply(1 threemore [writefull 0~11876] v712'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f0f8800a430 con 0x1cfc9c0 2024-04-23T01:57:39.338 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 >> v2:172.21.15.37:6805/1977556410 conn(0x1cfc9c0 msgr2=0x1d915f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/119648745 >> v2:172.21.15.37:6805/1977556410 conn(0x1cfc9c0 0x1d915f0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f7c037210 msgr2=0x7f0f7c039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f7c037210 0x7f0f7c039720 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 msgr2=0x1ce83b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce83b0 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 shutdown_connections 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/119648745 >> v2:172.21.15.37:6805/1977556410 conn(0x1cfc9c0 0x1d915f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0f7c037210 0x7f0f7c039720 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 --2- 172.21.15.37:0/119648745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x1c6a450 0x1ce83b0 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 >> 172.21.15.37:0/119648745 conn(0x1b86960 msgr2=0x1c63890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 shutdown_connections 2024-04-23T01:57:39.339 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.336+0000 7f0f9ce2cec0 1 -- 172.21.15.37:0/119648745 wait complete. 2024-04-23T01:57:39.340 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota d506dafc-2d08-46f3-8878-f69f9e013c29 max_bytes 0 2024-04-23T01:57:39.439 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.429+0000 7f3e66a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:39.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.439+0000 7f3e66a6d640 1 Processor -- start 2024-04-23T01:57:39.441 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.439+0000 7f3e66a6d640 1 -- start start 2024-04-23T01:57:39.443 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.440+0000 7f3e66a6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e600707f0 0x7f3e60070c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.440+0000 7f3e66a6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e60072390 con 0x7f3e60071140 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.440+0000 7f3e66a6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3e60071bb0 con 0x7f3e600707f0 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.440+0000 7f3e64809640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3e600707f0 0x7f3e60070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.440+0000 7f3e5ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3e60071140 0x7f3e6012c110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36444/0 (socket says 172.21.15.37:36444) 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e5ffff640 1 -- 172.21.15.37:0/1252995189 learned_addr learned my addr 172.21.15.37:0/1252995189 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e64809640 1 --2- 172.21.15.37:0/1252995189 >> v2:172.21.15.37:3300/0 conn(0x7f3e600707f0 0x7f3e60070c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42440/0 (socket says 172.21.15.37:42440) 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e64809640 1 -- 172.21.15.37:0/1252995189 >> v1:172.21.15.37:6789/0 conn(0x7f3e60071140 legacy=0x7f3e6012c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e64809640 1 -- 172.21.15.37:0/1252995189 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e60072050 con 0x7f3e600707f0 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e64809640 1 --2- 172.21.15.37:0/1252995189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e60070c00 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b88464311931c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e5f7fe640 1 -- 172.21.15.37:0/1252995189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e48009d90 con 0x7f3e600707f0 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e5f7fe640 1 -- 172.21.15.37:0/1252995189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e4800e230 con 0x7f3e600707f0 2024-04-23T01:57:39.444 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.441+0000 7f3e5f7fe640 1 -- 172.21.15.37:0/1252995189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e4800e4d0 con 0x7f3e600707f0 2024-04-23T01:57:39.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 1 -- 172.21.15.37:0/1252995189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 msgr2=0x7f3e60070c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:39.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 1 --2- 172.21.15.37:0/1252995189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e60070c00 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 1 -- 172.21.15.37:0/1252995189 shutdown_connections 2024-04-23T01:57:39.445 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 1 --2- 172.21.15.37:0/1252995189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e60070c00 unknown :-1 s=CLOSED pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:39.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 1 -- 172.21.15.37:0/1252995189 >> 172.21.15.37:0/1252995189 conn(0x7f3e600a1a20 msgr2=0x7f3e600a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:39.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 1 -- 172.21.15.37:0/1252995189 shutdown_connections 2024-04-23T01:57:39.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 1 -- 172.21.15.37:0/1252995189 wait complete. 2024-04-23T01:57:39.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.442+0000 7f3e66a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:39.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.444+0000 7f3e66a6d640 1 Processor -- start 2024-04-23T01:57:39.446 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.444+0000 7f3e66a6d640 1 -- start start 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.446+0000 7f3e66a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e6011be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.446+0000 7f3e66a6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6011d310 con 0x7f3e600707f0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.446+0000 7f3e64809640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e6011be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.446+0000 7f3e64809640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e6011be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42450/0 (socket says 172.21.15.37:42450) 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.446+0000 7f3e64809640 1 -- 172.21.15.37:0/2585429231 learned_addr learned my addr 172.21.15.37:0/2585429231 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.446+0000 7f3e64809640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6011efc0 con 0x7f3e600707f0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.447+0000 7f3e64809640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e6011be80 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.447+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e48014620 con 0x7f3e600707f0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.447+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3e48014780 con 0x7f3e600707f0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.447+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6011fef0 con 0x7f3e600707f0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.447+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3e48014a20 con 0x7f3e600707f0 2024-04-23T01:57:39.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.447+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e60068d00 con 0x7f3e600707f0 2024-04-23T01:57:39.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.448+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f3e48014bd0 con 0x7f3e600707f0 2024-04-23T01:57:39.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.448+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e60073be0 con 0x7f3e600707f0 2024-04-23T01:57:39.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.448+0000 7f3e5d7fa640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3e40038980 0x7f3e4003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:39.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.448+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(712..712 src has 609..712) ==== 4179+0+0 (crc 0 0 0) 0x7f3e48019040 con 0x7f3e600707f0 2024-04-23T01:57:39.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.448+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7f3e4003f330 con 0x7f3e600707f0 2024-04-23T01:57:39.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.448+0000 7f3e5ffff640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3e40038980 0x7f3e4003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:39.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.449+0000 7f3e5ffff640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3e40038980 0x7f3e4003ae90 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:39.455 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.453+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f3e48012390 con 0x7f3e600707f0 2024-04-23T01:57:39.642 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:39.640+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"} v 0) -- 0x7f3e600697f0 con 0x7f3e600707f0 2024-04-23T01:57:40.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:40.445+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v713) ==== 217+0+0 (crc 0 0 0) 0x7f3e4800fb30 con 0x7f3e600707f0 2024-04-23T01:57:40.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:40.445+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(713..713 src has 609..713) ==== 628+0+0 (crc 0 0 0) 0x7f3e48013e40 con 0x7f3e600707f0 2024-04-23T01:57:40.447 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:40.445+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7f3e40040370 con 0x7f3e600707f0 2024-04-23T01:57:40.560 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:40.559+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"} v 0) -- 0x7f3e6011e2e0 con 0x7f3e600707f0 2024-04-23T01:57:41.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.446+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v714) ==== 217+0+0 (crc 0 0 0) 0x7f3e4800fd10 con 0x7f3e600707f0 2024-04-23T01:57:41.449 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_bytes = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:57:41.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.446+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 <== mon.0 v2:172.21.15.37:3300/0 10 ==== osd_map(714..714 src has 609..714) ==== 628+0+0 (crc 0 0 0) 0x7f3e48010310 con 0x7f3e600707f0 2024-04-23T01:57:41.449 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.446+0000 7f3e5d7fa640 1 -- 172.21.15.37:0/2585429231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f3e40040490 con 0x7f3e600707f0 2024-04-23T01:57:41.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3e40038980 msgr2=0x7f3e4003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:41.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3e40038980 0x7f3e4003ae90 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:41.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 msgr2=0x7f3e6011be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:41.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e6011be80 crc :-1 s=READY pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:41.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 shutdown_connections 2024-04-23T01:57:41.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f3e40038980 0x7f3e4003ae90 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:41.451 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 --2- 172.21.15.37:0/2585429231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e600707f0 0x7f3e6011be80 unknown :-1 s=CLOSED pgs=12943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:41.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 >> 172.21.15.37:0/2585429231 conn(0x7f3e600a1a20 msgr2=0x7f3e601325c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:41.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 shutdown_connections 2024-04-23T01:57:41.452 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.449+0000 7f3e66a6d640 1 -- 172.21.15.37:0/2585429231 wait complete. 2024-04-23T01:57:41.467 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool set-quota d506dafc-2d08-46f3-8878-f69f9e013c29 max_objects 0 2024-04-23T01:57:41.576 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.564+0000 7f0a9879d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:41.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.575+0000 7f0a9879d640 1 Processor -- start 2024-04-23T01:57:41.577 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.575+0000 7f0a9879d640 1 -- start start 2024-04-23T01:57:41.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.577+0000 7f0a9879d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a9009b460 0x7f0a90134f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:41.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.577+0000 7f0a9879d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a90134c80 con 0x7f0a901354d0 2024-04-23T01:57:41.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.577+0000 7f0a9879d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0a9009bf20 con 0x7f0a9009b460 2024-04-23T01:57:41.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.577+0000 7f0a96539640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a9009b460 0x7f0a90134f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:41.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.577+0000 7f0a95d38640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a901354d0 0x7f0a901315a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40298/0 (socket says 172.21.15.37:40298) 2024-04-23T01:57:41.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.577+0000 7f0a95d38640 1 -- 172.21.15.37:0/1388455896 learned_addr learned my addr 172.21.15.37:0/1388455896 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:57:41.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.578+0000 7f0a96539640 1 -- 172.21.15.37:0/1388455896 >> v1:172.21.15.37:6789/0 conn(0x7f0a901354d0 legacy=0x7f0a901315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:41.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.578+0000 7f0a96539640 1 -- 172.21.15.37:0/1388455896 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9009c8d0 con 0x7f0a9009b460 2024-04-23T01:57:41.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.578+0000 7f0a96539640 1 --2- 172.21.15.37:0/1388455896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9009b460 0x7f0a90134f90 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23111ae1e3b3d0f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:41.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.578+0000 7f0a95537640 1 -- 172.21.15.37:0/1388455896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a8000e040 con 0x7f0a9009b460 2024-04-23T01:57:41.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.578+0000 7f0a95537640 1 -- 172.21.15.37:0/1388455896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0a80007670 con 0x7f0a9009b460 2024-04-23T01:57:41.581 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.578+0000 7f0a95537640 1 -- 172.21.15.37:0/1388455896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a80007910 con 0x7f0a9009b460 2024-04-23T01:57:41.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 1 -- 172.21.15.37:0/1388455896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9009b460 msgr2=0x7f0a90134f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:41.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 1 --2- 172.21.15.37:0/1388455896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9009b460 0x7f0a90134f90 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:41.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 1 -- 172.21.15.37:0/1388455896 shutdown_connections 2024-04-23T01:57:41.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 1 --2- 172.21.15.37:0/1388455896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a9009b460 0x7f0a90134f90 unknown :-1 s=CLOSED pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:41.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 1 -- 172.21.15.37:0/1388455896 >> 172.21.15.37:0/1388455896 conn(0x7f0a900a3c00 msgr2=0x7f0a900a4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:41.582 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 1 -- 172.21.15.37:0/1388455896 shutdown_connections 2024-04-23T01:57:41.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 1 -- 172.21.15.37:0/1388455896 wait complete. 2024-04-23T01:57:41.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.579+0000 7f0a9879d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:57:41.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.581+0000 7f0a9879d640 1 Processor -- start 2024-04-23T01:57:41.583 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.581+0000 7f0a9879d640 1 -- start start 2024-04-23T01:57:41.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.583+0000 7f0a9879d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a901354d0 0x7f0a90120f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:41.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.583+0000 7f0a9879d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a90125110 con 0x7f0a901354d0 2024-04-23T01:57:41.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.583+0000 7f0a96539640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a901354d0 0x7f0a90120f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:41.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.583+0000 7f0a96539640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a901354d0 0x7f0a90120f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57104/0 (socket says 172.21.15.37:57104) 2024-04-23T01:57:41.585 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.583+0000 7f0a96539640 1 -- 172.21.15.37:0/824327884 learned_addr learned my addr 172.21.15.37:0/824327884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:57:41.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.583+0000 7f0a96539640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a90132070 con 0x7f0a901354d0 2024-04-23T01:57:41.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.584+0000 7f0a96539640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a901354d0 0x7f0a90120f10 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:41.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.584+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a8000e040 con 0x7f0a901354d0 2024-04-23T01:57:41.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.584+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0a80012ab0 con 0x7f0a901354d0 2024-04-23T01:57:41.586 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.584+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a90123400 con 0x7f0a901354d0 2024-04-23T01:57:41.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.584+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a80012d50 con 0x7f0a901354d0 2024-04-23T01:57:41.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.584+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a90124580 con 0x7f0a901354d0 2024-04-23T01:57:41.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.585+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a90123830 con 0x7f0a901354d0 2024-04-23T01:57:41.587 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.585+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0a800153f0 con 0x7f0a901354d0 2024-04-23T01:57:41.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.586+0000 7f0a8effd640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0a7c038980 0x7f0a7c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:57:41.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.586+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(714..714 src has 609..714) ==== 4179+0+0 (crc 0 0 0) 0x7f0a8004a110 con 0x7f0a901354d0 2024-04-23T01:57:41.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.586+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f0a7c03f330 con 0x7f0a901354d0 2024-04-23T01:57:41.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.586+0000 7f0a95d38640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0a7c038980 0x7f0a7c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:57:41.588 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.587+0000 7f0a95d38640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0a7c038980 0x7f0a7c03ae90 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:57:41.597 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.596+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f0a8000fe80 con 0x7f0a901354d0 2024-04-23T01:57:41.794 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:41.792+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"} v 0) -- 0x7f0a90132260 con 0x7f0a901354d0 2024-04-23T01:57:42.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:42.453+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v715) ==== 221+0+0 (crc 0 0 0) 0x7f0a80010280 con 0x7f0a901354d0 2024-04-23T01:57:42.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:42.454+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(715..715 src has 609..715) ==== 628+0+0 (crc 0 0 0) 0x7f0a80009210 con 0x7f0a901354d0 2024-04-23T01:57:42.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:42.454+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=716}) -- 0x7f0a7c03ffe0 con 0x7f0a901354d0 2024-04-23T01:57:42.568 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:42.566+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"} v 0) -- 0x7f0a90124de0 con 0x7f0a901354d0 2024-04-23T01:57:43.456 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.454+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 v716) ==== 221+0+0 (crc 0 0 0) 0x7f0a8000faa0 con 0x7f0a901354d0 2024-04-23T01:57:43.457 INFO:tasks.workunit.client.0.smithi037.stderr:set-quota max_objects = 0 for pool d506dafc-2d08-46f3-8878-f69f9e013c29 2024-04-23T01:57:43.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.454+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 <== mon.0 v2:172.21.15.37:3300/0 10 ==== osd_map(716..716 src has 609..716) ==== 628+0+0 (crc 0 0 0) 0x7f0a8000bdd0 con 0x7f0a901354d0 2024-04-23T01:57:43.457 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.454+0000 7f0a8effd640 1 -- 172.21.15.37:0/824327884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7f0a7c0403c0 con 0x7f0a901354d0 2024-04-23T01:57:43.458 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0a7c038980 msgr2=0x7f0a7c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0a7c038980 0x7f0a7c03ae90 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a901354d0 msgr2=0x7f0a90120f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a901354d0 0x7f0a90120f10 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 shutdown_connections 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0a7c038980 0x7f0a7c03ae90 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 --2- 172.21.15.37:0/824327884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a901354d0 0x7f0a90120f10 unknown :-1 s=CLOSED pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.456+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 >> 172.21.15.37:0/824327884 conn(0x7f0a900a3c00 msgr2=0x7f0a901335b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.457+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 shutdown_connections 2024-04-23T01:57:43.459 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:57:43.457+0000 7f0a9879d640 1 -- 172.21.15.37:0/824327884 wait complete. 2024-04-23T01:57:43.467 INFO:tasks.workunit.client.0.smithi037.stderr:+ sleep 30 2024-04-23T01:58:13.469 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool delete d506dafc-2d08-46f3-8878-f69f9e013c29 d506dafc-2d08-46f3-8878-f69f9e013c29 --yes-i-really-really-mean-it 2024-04-23T01:58:13.580 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.569+0000 7f0503554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:13.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.579+0000 7f0503554640 1 Processor -- start 2024-04-23T01:58:13.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.579+0000 7f0503554640 1 -- start start 2024-04-23T01:58:13.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f0503554640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04fc1318a0 0x7f04fc131cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:13.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f0503554640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc09c8e0 con 0x7f04fc0a2530 2024-04-23T01:58:13.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f0503554640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f04fc09abe0 con 0x7f04fc1318a0 2024-04-23T01:58:13.623 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f05012f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04fc1318a0 0x7f04fc131cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f0500aef640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f04fc0a2530 0x7f04fc0a2940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40218/0 (socket says 172.21.15.37:40218) 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f05012f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04fc1318a0 0x7f04fc131cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46236/0 (socket says 172.21.15.37:46236) 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f05012f0640 1 -- 172.21.15.37:0/2122345827 learned_addr learned my addr 172.21.15.37:0/2122345827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f05012f0640 1 -- 172.21.15.37:0/2122345827 >> v1:172.21.15.37:6789/0 conn(0x7f04fc0a2530 legacy=0x7f04fc0a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f05012f0640 1 -- 172.21.15.37:0/2122345827 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc131490 con 0x7f04fc1318a0 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.581+0000 7f04f3fff640 1 -- 172.21.15.37:0/2122345827 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595504209 0 0) 0x7f04fc09c8e0 con 0x7f04fc0a2530 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f05012f0640 1 --2- 172.21.15.37:0/2122345827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc1318a0 0x7f04fc131cb0 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0335acef65392e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f04f3fff640 1 -- 172.21.15.37:0/2122345827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f04f8009e50 con 0x7f04fc1318a0 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f04f3fff640 1 -- 172.21.15.37:0/2122345827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f04f800e230 con 0x7f04fc1318a0 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f04f3fff640 1 -- 172.21.15.37:0/2122345827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f04f800e4d0 con 0x7f04fc1318a0 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f0503554640 1 -- 172.21.15.37:0/2122345827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc1318a0 msgr2=0x7f04fc131cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f0503554640 1 --2- 172.21.15.37:0/2122345827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc1318a0 0x7f04fc131cb0 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:13.624 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f0503554640 1 -- 172.21.15.37:0/2122345827 shutdown_connections 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f0503554640 1 --2- 172.21.15.37:0/2122345827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc1318a0 0x7f04fc131cb0 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.582+0000 7f0503554640 1 -- 172.21.15.37:0/2122345827 >> 172.21.15.37:0/2122345827 conn(0x7f04fc06d3a0 msgr2=0x7f04fc06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.583+0000 7f0503554640 1 -- 172.21.15.37:0/2122345827 shutdown_connections 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.583+0000 7f0503554640 1 -- 172.21.15.37:0/2122345827 wait complete. 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.583+0000 7f0503554640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.585+0000 7f0503554640 1 Processor -- start 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.585+0000 7f0503554640 1 -- start start 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.586+0000 7f0503554640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc0a2530 0x7f04fc11ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.586+0000 7f0503554640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc11feb0 con 0x7f04fc0a2530 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.586+0000 7f05012f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc0a2530 0x7f04fc11ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.586+0000 7f05012f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc0a2530 0x7f04fc11ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46238/0 (socket says 172.21.15.37:46238) 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.586+0000 7f05012f0640 1 -- 172.21.15.37:0/4001977586 learned_addr learned my addr 172.21.15.37:0/4001977586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.587+0000 7f05012f0640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc122ce0 con 0x7f04fc0a2530 2024-04-23T01:58:13.625 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.587+0000 7f05012f0640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc0a2530 0x7f04fc11ed20 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.587+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f04f800ed70 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.587+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f04f800eed0 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.587+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc1220d0 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.587+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f04f8015550 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.587+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc1219b0 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.588+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f04f8015700 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.588+0000 7f04f1ffb640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f04e0038980 0x7f04e003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.588+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(716..716 src has 609..716) ==== 4179+0+0 (crc 0 0 0) 0x7f04f8049f60 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.588+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04fc122b40 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.589+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=717}) -- 0x7f04e003f330 con 0x7f04fc0a2530 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.589+0000 7f0500aef640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f04e0038980 0x7f04e003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.589+0000 7f0500aef640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f04e0038980 0x7f04e003ae90 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:13.626 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.594+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f04fc122b40 con 0x7f04fc0a2530 2024-04-23T01:58:13.782 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:13.780+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pool2": "d506dafc-2d08-46f3-8878-f69f9e013c29", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04fc122b40 con 0x7f04fc0a2530 2024-04-23T01:58:14.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.487+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pool2": "d506dafc-2d08-46f3-8878-f69f9e013c29", "yes_i_really_really_mean_it": true}]=0 pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' removed v717) ==== 248+0+0 (crc 0 0 0) 0x7f04fc122b40 con 0x7f04fc0a2530 2024-04-23T01:58:14.489 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.487+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(717..717 src has 609..717) ==== 296+0+0 (crc 0 0 0) 0x7f04f8010e40 con 0x7f04fc0a2530 2024-04-23T01:58:14.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.487+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7f04e003fd40 con 0x7f04fc0a2530 2024-04-23T01:58:14.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.717+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pool2": "d506dafc-2d08-46f3-8878-f69f9e013c29", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04fc122b40 con 0x7f04fc0a2530 2024-04-23T01:58:14.719 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.717+0000 7f04f1ffb640 1 -- 172.21.15.37:0/4001977586 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "d506dafc-2d08-46f3-8878-f69f9e013c29", "pool2": "d506dafc-2d08-46f3-8878-f69f9e013c29", "yes_i_really_really_mean_it": true}]=0 pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' does not exist v717) ==== 255+0+0 (crc 0 0 0) 0x7f04fc122b40 con 0x7f04fc0a2530 2024-04-23T01:58:14.719 INFO:tasks.workunit.client.0.smithi037.stderr:pool 'd506dafc-2d08-46f3-8878-f69f9e013c29' does not exist 2024-04-23T01:58:14.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.720+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f04e0038980 msgr2=0x7f04e003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:14.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.720+0000 7f0503554640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f04e0038980 0x7f04e003ae90 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:14.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.720+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc0a2530 msgr2=0x7f04fc11ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:14.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.720+0000 7f0503554640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc0a2530 0x7f04fc11ed20 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:14.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.721+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 shutdown_connections 2024-04-23T01:58:14.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.721+0000 7f0503554640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f04e0038980 0x7f04e003ae90 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:14.723 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.721+0000 7f0503554640 1 --2- 172.21.15.37:0/4001977586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04fc0a2530 0x7f04fc11ed20 unknown :-1 s=CLOSED pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:14.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.721+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 >> 172.21.15.37:0/4001977586 conn(0x7f04fc06d3a0 msgr2=0x7f04fc1347e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:14.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.721+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 shutdown_connections 2024-04-23T01:58:14.724 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.721+0000 7f0503554640 1 -- 172.21.15.37:0/4001977586 wait complete. 2024-04-23T01:58:14.740 INFO:tasks.workunit.client.0.smithi037.stderr:+ ceph osd pool delete 66e90510-9ce4-418d-804c-f8d1f71f3917 66e90510-9ce4-418d-804c-f8d1f71f3917 --yes-i-really-really-mean-it 2024-04-23T01:58:14.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.826+0000 7efc10d54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:14.837 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.836+0000 7efc10d54640 1 Processor -- start 2024-04-23T01:58:14.838 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.836+0000 7efc10d54640 1 -- start start 2024-04-23T01:58:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.837+0000 7efc10d54640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc0c135a30 0x7efc0c137e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.837+0000 7efc10d54640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0c0720d0 con 0x7efc0c12e510 2024-04-23T01:58:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.837+0000 7efc10d54640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efc0c12f030 con 0x7efc0c135a30 2024-04-23T01:58:14.840 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.837+0000 7efc0a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc0c12e510 0x7efc0c12e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40222/0 (socket says 172.21.15.37:40222) 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.837+0000 7efc0a59c640 1 -- 172.21.15.37:0/980639372 learned_addr learned my addr 172.21.15.37:0/980639372 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.837+0000 7efc09d9b640 1 --2- 172.21.15.37:0/980639372 >> v2:172.21.15.37:3300/0 conn(0x7efc0c135a30 0x7efc0c137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.838+0000 7efc09d9b640 1 -- 172.21.15.37:0/980639372 >> v1:172.21.15.37:6789/0 conn(0x7efc0c12e510 legacy=0x7efc0c12e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.838+0000 7efc09d9b640 1 -- 172.21.15.37:0/980639372 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c073a00 con 0x7efc0c135a30 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.838+0000 7efc09d9b640 1 --2- 172.21.15.37:0/980639372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c135a30 0x7efc0c137e50 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce331c1fc22f6f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.838+0000 7efc0959a640 1 -- 172.21.15.37:0/980639372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbf4009d90 con 0x7efc0c135a30 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.838+0000 7efc0959a640 1 -- 172.21.15.37:0/980639372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efbf400e230 con 0x7efc0c135a30 2024-04-23T01:58:14.841 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.838+0000 7efc0959a640 1 -- 172.21.15.37:0/980639372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbf400e4d0 con 0x7efc0c135a30 2024-04-23T01:58:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 1 -- 172.21.15.37:0/980639372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c135a30 msgr2=0x7efc0c137e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 1 --2- 172.21.15.37:0/980639372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c135a30 0x7efc0c137e50 crc :-1 s=READY pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 1 -- 172.21.15.37:0/980639372 shutdown_connections 2024-04-23T01:58:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 1 --2- 172.21.15.37:0/980639372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c135a30 0x7efc0c137e50 unknown :-1 s=CLOSED pgs=12951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 1 -- 172.21.15.37:0/980639372 >> 172.21.15.37:0/980639372 conn(0x7efc0c0a1850 msgr2=0x7efc0c0a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 1 -- 172.21.15.37:0/980639372 shutdown_connections 2024-04-23T01:58:14.842 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 1 -- 172.21.15.37:0/980639372 wait complete. 2024-04-23T01:58:14.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.839+0000 7efc10d54640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:14.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.841+0000 7efc10d54640 1 Processor -- start 2024-04-23T01:58:14.843 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.841+0000 7efc10d54640 1 -- start start 2024-04-23T01:58:14.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.843+0000 7efc10d54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c12e510 0x7efc0c11b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:14.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.843+0000 7efc10d54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c11e1c0 con 0x7efc0c12e510 2024-04-23T01:58:14.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.843+0000 7efc0a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c12e510 0x7efc0c11b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:14.846 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.843+0000 7efc0a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c12e510 0x7efc0c11b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46250/0 (socket says 172.21.15.37:46250) 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.843+0000 7efc0a59c640 1 -- 172.21.15.37:0/2418033094 learned_addr learned my addr 172.21.15.37:0/2418033094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.843+0000 7efc0a59c640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c12dfa0 con 0x7efc0c12e510 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.843+0000 7efc0a59c640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c12e510 0x7efc0c11b000 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.844+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbfc0070b0 con 0x7efc0c12e510 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.844+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efbfc007210 con 0x7efc0c12e510 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.844+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c11cfc0 con 0x7efc0c12e510 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.844+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efbfc007380 con 0x7efc0c12e510 2024-04-23T01:58:14.847 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.844+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c12dc00 con 0x7efc0c12e510 2024-04-23T01:58:14.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.845+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7efbfc007530 con 0x7efc0c12e510 2024-04-23T01:58:14.848 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.845+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0c11eac0 con 0x7efc0c12e510 2024-04-23T01:58:14.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.845+0000 7efc02ffd640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efbec038980 0x7efbec03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:14.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.845+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(717..717 src has 609..717) ==== 3791+0+0 (crc 0 0 0) 0x7efbfc048f70 con 0x7efc0c12e510 2024-04-23T01:58:14.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.845+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=718}) -- 0x7efbec03eb90 con 0x7efc0c12e510 2024-04-23T01:58:14.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.845+0000 7efc09d9b640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efbec038980 0x7efbec03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:14.849 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.846+0000 7efc09d9b640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efbec038980 0x7efbec03ae90 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:14.852 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:14.850+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7efbfc0092e0 con 0x7efc0c12e510 2024-04-23T01:58:15.038 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.036+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pool2": "66e90510-9ce4-418d-804c-f8d1f71f3917", "yes_i_really_really_mean_it": true} v 0) -- 0x7efc0c0697f0 con 0x7efc0c12e510 2024-04-23T01:58:15.490 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.488+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pool2": "66e90510-9ce4-418d-804c-f8d1f71f3917", "yes_i_really_really_mean_it": true}]=0 pool '66e90510-9ce4-418d-804c-f8d1f71f3917' removed v718) ==== 248+0+0 (crc 0 0 0) 0x7efbfc00d150 con 0x7efc0c12e510 2024-04-23T01:58:15.492 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.490+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(718..718 src has 609..718) ==== 296+0+0 (crc 0 0 0) 0x7efbfc00f750 con 0x7efc0c12e510 2024-04-23T01:58:15.493 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.491+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7efbec03f8e0 con 0x7efc0c12e510 2024-04-23T01:58:15.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.599+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pool2": "66e90510-9ce4-418d-804c-f8d1f71f3917", "yes_i_really_really_mean_it": true} v 0) -- 0x7efc0c0008d0 con 0x7efc0c12e510 2024-04-23T01:58:15.601 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.599+0000 7efc02ffd640 1 -- 172.21.15.37:0/2418033094 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "66e90510-9ce4-418d-804c-f8d1f71f3917", "pool2": "66e90510-9ce4-418d-804c-f8d1f71f3917", "yes_i_really_really_mean_it": true}]=0 pool '66e90510-9ce4-418d-804c-f8d1f71f3917' does not exist v718) ==== 255+0+0 (crc 0 0 0) 0x7efbfc00ddb0 con 0x7efc0c12e510 2024-04-23T01:58:15.602 INFO:tasks.workunit.client.0.smithi037.stderr:pool '66e90510-9ce4-418d-804c-f8d1f71f3917' does not exist 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efbec038980 msgr2=0x7efbec03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efbec038980 0x7efbec03ae90 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c12e510 msgr2=0x7efc0c11b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c12e510 0x7efc0c11b000 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 shutdown_connections 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efbec038980 0x7efbec03ae90 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 --2- 172.21.15.37:0/2418033094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0c12e510 0x7efc0c11b000 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 >> 172.21.15.37:0/2418033094 conn(0x7efc0c0a1850 msgr2=0x7efc0c070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.601+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 shutdown_connections 2024-04-23T01:58:15.604 INFO:tasks.workunit.client.0.smithi037.stderr:2024-04-23T01:58:15.602+0000 7efc10d54640 1 -- 172.21.15.37:0/2418033094 wait complete. 2024-04-23T01:58:15.613 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo OK 2024-04-23T01:58:15.614 INFO:tasks.workunit.client.0.smithi037.stdout:OK 2024-04-23T01:58:15.615 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T01:58:15.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T01:58:15.679 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-04-23T01:58:15.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T01:58:16.011 DEBUG:teuthology.parallel:result is None 2024-04-23T01:58:16.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T01:58:16.036 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T01:58:16.036 DEBUG:teuthology.orchestra.run.smithi037:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-23T01:58:16.101 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T01:58:16.102 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-23T01:58:16.111 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T01:58:16.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T01:58:16.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.248+0000 7f8ab0a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:16.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.253+0000 7f8ab0a2d640 1 Processor -- start 2024-04-23T01:58:16.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.253+0000 7f8ab0a2d640 1 -- start start 2024-04-23T01:58:16.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.254+0000 7f8ab0a2d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8aac09ee40 0x7f8aac09f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.254+0000 7f8ab0a2d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac06f0b0 con 0x7f8aac09f790 2024-04-23T01:58:16.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.254+0000 7f8ab0a2d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac073c50 con 0x7f8aac09ee40 2024-04-23T01:58:16.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.254+0000 7f8aaa59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8aac09ee40 0x7f8aac09f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.254+0000 7f8aa1d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8aac09f790 0x7f8aac1316d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40224/0 (socket says 172.21.15.37:40224) 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.254+0000 7f8aaa59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8aac09ee40 0x7f8aac09f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46252/0 (socket says 172.21.15.37:46252) 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.254+0000 7f8aa1d9b640 1 -- 172.21.15.37:0/1049027048 learned_addr learned my addr 172.21.15.37:0/1049027048 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.255+0000 7f8aaa59c640 1 -- 172.21.15.37:0/1049027048 >> v1:172.21.15.37:6789/0 conn(0x7f8aac09f790 legacy=0x7f8aac1316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.255+0000 7f8aaa59c640 1 -- 172.21.15.37:0/1049027048 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0a1120 con 0x7f8aac09ee40 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.255+0000 7f8aaa59c640 1 --2- 172.21.15.37:0/1049027048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac09f250 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9236836d29052607 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.255+0000 7f8aa9d9b640 1 -- 172.21.15.37:0/1049027048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a9c009d90 con 0x7f8aac09ee40 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.255+0000 7f8aa9d9b640 1 -- 172.21.15.37:0/1049027048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8a9c00e230 con 0x7f8aac09ee40 2024-04-23T01:58:16.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.255+0000 7f8aa9d9b640 1 -- 172.21.15.37:0/1049027048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a9c00e4d0 con 0x7f8aac09ee40 2024-04-23T01:58:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1049027048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 msgr2=0x7f8aac09f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 1 --2- 172.21.15.37:0/1049027048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac09f250 crc :-1 s=READY pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1049027048 shutdown_connections 2024-04-23T01:58:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 1 --2- 172.21.15.37:0/1049027048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac09f250 unknown :-1 s=CLOSED pgs=12954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1049027048 >> 172.21.15.37:0/1049027048 conn(0x7f8aac0a3be0 msgr2=0x7f8aac0a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1049027048 shutdown_connections 2024-04-23T01:58:16.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1049027048 wait complete. 2024-04-23T01:58:16.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.256+0000 7f8ab0a2d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:16.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.258+0000 7f8ab0a2d640 1 Processor -- start 2024-04-23T01:58:16.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.258+0000 7f8ab0a2d640 1 -- start start 2024-04-23T01:58:16.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.260+0000 7f8ab0a2d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac11e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.260+0000 7f8ab0a2d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac1217b0 con 0x7f8aac09ee40 2024-04-23T01:58:16.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.260+0000 7f8aaa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac11e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.260+0000 7f8aaa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac11e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46260/0 (socket says 172.21.15.37:46260) 2024-04-23T01:58:16.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.260+0000 7f8aaa59c640 1 -- 172.21.15.37:0/1803326353 learned_addr learned my addr 172.21.15.37:0/1803326353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:16.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.260+0000 7f8aaa59c640 1 -- 172.21.15.37:0/1803326353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac122230 con 0x7f8aac09ee40 2024-04-23T01:58:16.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.260+0000 7f8aaa59c640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac11e100 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.261+0000 7f8aa37fe640 1 -- 172.21.15.37:0/1803326353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a9c014750 con 0x7f8aac09ee40 2024-04-23T01:58:16.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.261+0000 7f8aa37fe640 1 -- 172.21.15.37:0/1803326353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8a9c0148b0 con 0x7f8aac09ee40 2024-04-23T01:58:16.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.261+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac074f80 con 0x7f8aac09ee40 2024-04-23T01:58:16.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.261+0000 7f8aa37fe640 1 -- 172.21.15.37:0/1803326353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8a9c014b50 con 0x7f8aac09ee40 2024-04-23T01:58:16.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.261+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac11fcd0 con 0x7f8aac09ee40 2024-04-23T01:58:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.262+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac063880 con 0x7f8aac09ee40 2024-04-23T01:58:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.262+0000 7f8aa37fe640 1 -- 172.21.15.37:0/1803326353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f8a9c014d50 con 0x7f8aac09ee40 2024-04-23T01:58:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.262+0000 7f8aa37fe640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8a8c038930 0x7f8a8c03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.262+0000 7f8aa37fe640 1 -- 172.21.15.37:0/1803326353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f8a9c019040 con 0x7f8aac09ee40 2024-04-23T01:58:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.262+0000 7f8aa1d9b640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8a8c038930 0x7f8a8c03ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.263+0000 7f8aa1d9b640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8a8c038930 0x7f8a8c03ae40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.267+0000 7f8aa37fe640 1 -- 172.21.15.37:0/1803326353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f8a9c018190 con 0x7f8aac09ee40 2024-04-23T01:58:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.449+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8aac06ec50 con 0x7f8a8c038930 2024-04-23T01:58:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.453+0000 7f8aa37fe640 1 -- 172.21.15.37:0/1803326353 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+108925 (crc 0 0 0) 0x7f8a94001250 con 0x7f8a8c038930 2024-04-23T01:58:16.456 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:58:16.457 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8a8c038930 msgr2=0x7f8a8c03ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8a8c038930 0x7f8a8c03ae40 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 msgr2=0x7f8aac11e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac11e100 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 shutdown_connections 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8a8c038930 0x7f8a8c03ae40 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 --2- 172.21.15.37:0/1803326353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aac09ee40 0x7f8aac11e100 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 >> 172.21.15.37:0/1803326353 conn(0x7f8aac0a3be0 msgr2=0x7f8aac1bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 shutdown_connections 2024-04-23T01:58:16.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.455+0000 7f8ab0a2d640 1 -- 172.21.15.37:0/1803326353 wait complete. 2024-04-23T01:58:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":1297,"stamp":"2024-04-23T01:58:16.037008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":289980,"kb_used_data":8668,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419140420,"statfs":{"total":429496729600,"available":429199790080,"internally_reserved":0,"allocated":8876032,"data_stored":3866505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002579"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.513550+0000","last_change":"2024-04-23T01:44:35.541884+0000","last_active":"2024-04-23T01:57:43.513550+0000","last_peered":"2024-04-23T01:57:43.513550+0000","last_clean":"2024-04-23T01:57:43.513550+0000","last_became_active":"2024-04-23T01:44:35.536828+0000","last_became_peered":"2024-04-23T01:44:35.536828+0000","last_unstale":"2024-04-23T01:57:43.513550+0000","last_undegraded":"2024-04-23T01:57:43.513550+0000","last_fullsized":"2024-04-23T01:57:43.513550+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.508293+0000","last_change":"2024-04-23T01:44:35.597862+0000","last_active":"2024-04-23T01:57:43.508293+0000","last_peered":"2024-04-23T01:57:43.508293+0000","last_clean":"2024-04-23T01:57:43.508293+0000","last_became_active":"2024-04-23T01:44:35.592920+0000","last_became_peered":"2024-04-23T01:44:35.592920+0000","last_unstale":"2024-04-23T01:57:43.508293+0000","last_undegraded":"2024-04-23T01:57:43.508293+0000","last_fullsized":"2024-04-23T01:57:43.508293+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.817795+0000","last_change":"2024-04-23T01:44:35.607049+0000","last_active":"2024-04-23T01:57:43.817795+0000","last_peered":"2024-04-23T01:57:43.817795+0000","last_clean":"2024-04-23T01:57:43.817795+0000","last_became_active":"2024-04-23T01:44:35.598001+0000","last_became_peered":"2024-04-23T01:44:35.598001+0000","last_unstale":"2024-04-23T01:57:43.817795+0000","last_undegraded":"2024-04-23T01:57:43.817795+0000","last_fullsized":"2024-04-23T01:57:43.817795+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.770406+0000","last_change":"2024-04-23T01:44:35.621029+0000","last_active":"2024-04-23T01:57:43.770406+0000","last_peered":"2024-04-23T01:57:43.770406+0000","last_clean":"2024-04-23T01:57:43.770406+0000","last_became_active":"2024-04-23T01:44:35.610632+0000","last_became_peered":"2024-04-23T01:44:35.610632+0000","last_unstale":"2024-04-23T01:57:43.770406+0000","last_undegraded":"2024-04-23T01:57:43.770406+0000","last_fullsized":"2024-04-23T01:57:43.770406+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.491966+0000","last_change":"2024-04-23T01:44:35.502927+0000","last_active":"2024-04-23T01:57:43.491966+0000","last_peered":"2024-04-23T01:57:43.491966+0000","last_clean":"2024-04-23T01:57:43.491966+0000","last_became_active":"2024-04-23T01:44:35.490300+0000","last_became_peered":"2024-04-23T01:44:35.490300+0000","last_unstale":"2024-04-23T01:57:43.491966+0000","last_undegraded":"2024-04-23T01:57:43.491966+0000","last_fullsized":"2024-04-23T01:57:43.491966+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.512124+0000","last_change":"2024-04-23T01:44:35.577689+0000","last_active":"2024-04-23T01:57:43.512124+0000","last_peered":"2024-04-23T01:57:43.512124+0000","last_clean":"2024-04-23T01:57:43.512124+0000","last_became_active":"2024-04-23T01:44:35.572629+0000","last_became_peered":"2024-04-23T01:44:35.572629+0000","last_unstale":"2024-04-23T01:57:43.512124+0000","last_undegraded":"2024-04-23T01:57:43.512124+0000","last_fullsized":"2024-04-23T01:57:43.512124+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1303,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.733518+0000","last_change":"2024-04-23T01:44:35.531053+0000","last_active":"2024-04-23T01:57:43.733518+0000","last_peered":"2024-04-23T01:57:43.733518+0000","last_clean":"2024-04-23T01:57:43.733518+0000","last_became_active":"2024-04-23T01:44:35.525053+0000","last_became_peered":"2024-04-23T01:44:35.525053+0000","last_unstale":"2024-04-23T01:57:43.733518+0000","last_undegraded":"2024-04-23T01:57:43.733518+0000","last_fullsized":"2024-04-23T01:57:43.733518+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.523481+0000","last_change":"2024-04-23T01:44:35.475519+0000","last_active":"2024-04-23T01:57:43.523481+0000","last_peered":"2024-04-23T01:57:43.523481+0000","last_clean":"2024-04-23T01:57:43.523481+0000","last_became_active":"2024-04-23T01:44:35.468130+0000","last_became_peered":"2024-04-23T01:44:35.468130+0000","last_unstale":"2024-04-23T01:57:43.523481+0000","last_undegraded":"2024-04-23T01:57:43.523481+0000","last_fullsized":"2024-04-23T01:57:43.523481+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.786976+0000","last_change":"2024-04-23T01:44:35.624145+0000","last_active":"2024-04-23T01:57:43.786976+0000","last_peered":"2024-04-23T01:57:43.786976+0000","last_clean":"2024-04-23T01:57:43.786976+0000","last_became_active":"2024-04-23T01:44:35.615580+0000","last_became_peered":"2024-04-23T01:44:35.615580+0000","last_unstale":"2024-04-23T01:57:43.786976+0000","last_undegraded":"2024-04-23T01:57:43.786976+0000","last_fullsized":"2024-04-23T01:57:43.786976+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.851756+0000","last_change":"2024-04-23T01:44:35.603892+0000","last_active":"2024-04-23T01:57:43.851756+0000","last_peered":"2024-04-23T01:57:43.851756+0000","last_clean":"2024-04-23T01:57:43.851756+0000","last_became_active":"2024-04-23T01:44:35.595827+0000","last_became_peered":"2024-04-23T01:44:35.595827+0000","last_unstale":"2024-04-23T01:57:43.851756+0000","last_undegraded":"2024-04-23T01:57:43.851756+0000","last_fullsized":"2024-04-23T01:57:43.851756+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.838556+0000","last_change":"2024-04-23T01:44:35.498234+0000","last_active":"2024-04-23T01:57:43.838556+0000","last_peered":"2024-04-23T01:57:43.838556+0000","last_clean":"2024-04-23T01:57:43.838556+0000","last_became_active":"2024-04-23T01:44:35.493377+0000","last_became_peered":"2024-04-23T01:44:35.493377+0000","last_unstale":"2024-04-23T01:57:43.838556+0000","last_undegraded":"2024-04-23T01:57:43.838556+0000","last_fullsized":"2024-04-23T01:57:43.838556+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.502171+0000","last_change":"2024-04-23T01:44:35.487445+0000","last_active":"2024-04-23T01:57:43.502171+0000","last_peered":"2024-04-23T01:57:43.502171+0000","last_clean":"2024-04-23T01:57:43.502171+0000","last_became_active":"2024-04-23T01:44:35.481772+0000","last_became_peered":"2024-04-23T01:44:35.481772+0000","last_unstale":"2024-04-23T01:57:43.502171+0000","last_undegraded":"2024-04-23T01:57:43.502171+0000","last_fullsized":"2024-04-23T01:57:43.502171+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.799440+0000","last_change":"2024-04-23T01:44:35.583076+0000","last_active":"2024-04-23T01:57:43.799440+0000","last_peered":"2024-04-23T01:57:43.799440+0000","last_clean":"2024-04-23T01:57:43.799440+0000","last_became_active":"2024-04-23T01:44:35.572973+0000","last_became_peered":"2024-04-23T01:44:35.572973+0000","last_unstale":"2024-04-23T01:57:43.799440+0000","last_undegraded":"2024-04-23T01:57:43.799440+0000","last_fullsized":"2024-04-23T01:57:43.799440+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.775791+0000","last_change":"2024-04-23T01:44:35.561524+0000","last_active":"2024-04-23T01:57:43.775791+0000","last_peered":"2024-04-23T01:57:43.775791+0000","last_clean":"2024-04-23T01:57:43.775791+0000","last_became_active":"2024-04-23T01:44:35.552435+0000","last_became_peered":"2024-04-23T01:44:35.552435+0000","last_unstale":"2024-04-23T01:57:43.775791+0000","last_undegraded":"2024-04-23T01:57:43.775791+0000","last_fullsized":"2024-04-23T01:57:43.775791+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.520070+0000","last_change":"2024-04-23T01:44:35.533102+0000","last_active":"2024-04-23T01:57:43.520070+0000","last_peered":"2024-04-23T01:57:43.520070+0000","last_clean":"2024-04-23T01:57:43.520070+0000","last_became_active":"2024-04-23T01:44:35.525485+0000","last_became_peered":"2024-04-23T01:44:35.525485+0000","last_unstale":"2024-04-23T01:57:43.520070+0000","last_undegraded":"2024-04-23T01:57:43.520070+0000","last_fullsized":"2024-04-23T01:57:43.520070+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1303,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.744107+0000","last_change":"2024-04-23T01:44:35.557707+0000","last_active":"2024-04-23T01:57:43.744107+0000","last_peered":"2024-04-23T01:57:43.744107+0000","last_clean":"2024-04-23T01:57:43.744107+0000","last_became_active":"2024-04-23T01:44:35.553565+0000","last_became_peered":"2024-04-23T01:44:35.553565+0000","last_unstale":"2024-04-23T01:57:43.744107+0000","last_undegraded":"2024-04-23T01:57:43.744107+0000","last_fullsized":"2024-04-23T01:57:43.744107+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.498572+0000","last_change":"2024-04-23T01:44:35.514978+0000","last_active":"2024-04-23T01:57:43.498572+0000","last_peered":"2024-04-23T01:57:43.498572+0000","last_clean":"2024-04-23T01:57:43.498572+0000","last_became_active":"2024-04-23T01:44:35.510739+0000","last_became_peered":"2024-04-23T01:44:35.510739+0000","last_unstale":"2024-04-23T01:57:43.498572+0000","last_undegraded":"2024-04-23T01:57:43.498572+0000","last_fullsized":"2024-04-23T01:57:43.498572+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.815553+0000","last_change":"2024-04-23T01:44:35.661139+0000","last_active":"2024-04-23T01:57:43.815553+0000","last_peered":"2024-04-23T01:57:43.815553+0000","last_clean":"2024-04-23T01:57:43.815553+0000","last_became_active":"2024-04-23T01:44:35.655691+0000","last_became_peered":"2024-04-23T01:44:35.655691+0000","last_unstale":"2024-04-23T01:57:43.815553+0000","last_undegraded":"2024-04-23T01:57:43.815553+0000","last_fullsized":"2024-04-23T01:57:43.815553+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.811267+0000","last_change":"2024-04-23T01:44:35.495357+0000","last_active":"2024-04-23T01:57:43.811267+0000","last_peered":"2024-04-23T01:57:43.811267+0000","last_clean":"2024-04-23T01:57:43.811267+0000","last_became_active":"2024-04-23T01:44:35.488384+0000","last_became_peered":"2024-04-23T01:44:35.488384+0000","last_unstale":"2024-04-23T01:57:43.811267+0000","last_undegraded":"2024-04-23T01:57:43.811267+0000","last_fullsized":"2024-04-23T01:57:43.811267+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.484205+0000","last_change":"2024-04-23T01:44:35.619539+0000","last_active":"2024-04-23T01:57:43.484205+0000","last_peered":"2024-04-23T01:57:43.484205+0000","last_clean":"2024-04-23T01:57:43.484205+0000","last_became_active":"2024-04-23T01:44:35.613157+0000","last_became_peered":"2024-04-23T01:44:35.613157+0000","last_unstale":"2024-04-23T01:57:43.484205+0000","last_undegraded":"2024-04-23T01:57:43.484205+0000","last_fullsized":"2024-04-23T01:57:43.484205+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.494029+0000","last_change":"2024-04-23T01:44:35.564324+0000","last_active":"2024-04-23T01:57:43.494029+0000","last_peered":"2024-04-23T01:57:43.494029+0000","last_clean":"2024-04-23T01:57:43.494029+0000","last_became_active":"2024-04-23T01:44:35.555769+0000","last_became_peered":"2024-04-23T01:44:35.555769+0000","last_unstale":"2024-04-23T01:57:43.494029+0000","last_undegraded":"2024-04-23T01:57:43.494029+0000","last_fullsized":"2024-04-23T01:57:43.494029+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.486490+0000","last_change":"2024-04-23T01:44:35.530323+0000","last_active":"2024-04-23T01:57:43.486490+0000","last_peered":"2024-04-23T01:57:43.486490+0000","last_clean":"2024-04-23T01:57:43.486490+0000","last_became_active":"2024-04-23T01:44:35.520575+0000","last_became_peered":"2024-04-23T01:44:35.520575+0000","last_unstale":"2024-04-23T01:57:43.486490+0000","last_undegraded":"2024-04-23T01:57:43.486490+0000","last_fullsized":"2024-04-23T01:57:43.486490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.826060+0000","last_change":"2024-04-23T01:44:35.633303+0000","last_active":"2024-04-23T01:57:43.826060+0000","last_peered":"2024-04-23T01:57:43.826060+0000","last_clean":"2024-04-23T01:57:43.826060+0000","last_became_active":"2024-04-23T01:44:35.625265+0000","last_became_peered":"2024-04-23T01:44:35.625265+0000","last_unstale":"2024-04-23T01:57:43.826060+0000","last_undegraded":"2024-04-23T01:57:43.826060+0000","last_fullsized":"2024-04-23T01:57:43.826060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.847209+0000","last_change":"2024-04-23T01:44:35.630312+0000","last_active":"2024-04-23T01:57:43.847209+0000","last_peered":"2024-04-23T01:57:43.847209+0000","last_clean":"2024-04-23T01:57:43.847209+0000","last_became_active":"2024-04-23T01:44:35.617649+0000","last_became_peered":"2024-04-23T01:44:35.617649+0000","last_unstale":"2024-04-23T01:57:43.847209+0000","last_undegraded":"2024-04-23T01:57:43.847209+0000","last_fullsized":"2024-04-23T01:57:43.847209+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.828881+0000","last_change":"2024-04-23T01:44:35.620547+0000","last_active":"2024-04-23T01:57:43.828881+0000","last_peered":"2024-04-23T01:57:43.828881+0000","last_clean":"2024-04-23T01:57:43.828881+0000","last_became_active":"2024-04-23T01:44:35.610600+0000","last_became_peered":"2024-04-23T01:44:35.610600+0000","last_unstale":"2024-04-23T01:57:43.828881+0000","last_undegraded":"2024-04-23T01:57:43.828881+0000","last_fullsized":"2024-04-23T01:57:43.828881+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.497146+0000","last_change":"2024-04-23T01:44:35.506423+0000","last_active":"2024-04-23T01:57:43.497146+0000","last_peered":"2024-04-23T01:57:43.497146+0000","last_clean":"2024-04-23T01:57:43.497146+0000","last_became_active":"2024-04-23T01:44:35.498971+0000","last_became_peered":"2024-04-23T01:44:35.498971+0000","last_unstale":"2024-04-23T01:57:43.497146+0000","last_undegraded":"2024-04-23T01:57:43.497146+0000","last_fullsized":"2024-04-23T01:57:43.497146+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.841667+0000","last_change":"2024-04-23T01:44:35.666017+0000","last_active":"2024-04-23T01:57:43.841667+0000","last_peered":"2024-04-23T01:57:43.841667+0000","last_clean":"2024-04-23T01:57:43.841667+0000","last_became_active":"2024-04-23T01:44:35.661648+0000","last_became_peered":"2024-04-23T01:44:35.661648+0000","last_unstale":"2024-04-23T01:57:43.841667+0000","last_undegraded":"2024-04-23T01:57:43.841667+0000","last_fullsized":"2024-04-23T01:57:43.841667+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.505608+0000","last_change":"2024-04-23T01:44:35.551930+0000","last_active":"2024-04-23T01:57:43.505608+0000","last_peered":"2024-04-23T01:57:43.505608+0000","last_clean":"2024-04-23T01:57:43.505608+0000","last_became_active":"2024-04-23T01:44:35.546395+0000","last_became_peered":"2024-04-23T01:44:35.546395+0000","last_unstale":"2024-04-23T01:57:43.505608+0000","last_undegraded":"2024-04-23T01:57:43.505608+0000","last_fullsized":"2024-04-23T01:57:43.505608+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.515284+0000","last_change":"2024-04-23T01:44:35.567435+0000","last_active":"2024-04-23T01:57:43.515284+0000","last_peered":"2024-04-23T01:57:43.515284+0000","last_clean":"2024-04-23T01:57:43.515284+0000","last_became_active":"2024-04-23T01:44:35.560107+0000","last_became_peered":"2024-04-23T01:44:35.560107+0000","last_unstale":"2024-04-23T01:57:43.515284+0000","last_undegraded":"2024-04-23T01:57:43.515284+0000","last_fullsized":"2024-04-23T01:57:43.515284+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.524670+0000","last_change":"2024-04-23T01:44:35.590627+0000","last_active":"2024-04-23T01:57:43.524670+0000","last_peered":"2024-04-23T01:57:43.524670+0000","last_clean":"2024-04-23T01:57:43.524670+0000","last_became_active":"2024-04-23T01:44:35.585680+0000","last_became_peered":"2024-04-23T01:44:35.585680+0000","last_unstale":"2024-04-23T01:57:43.524670+0000","last_undegraded":"2024-04-23T01:57:43.524670+0000","last_fullsized":"2024-04-23T01:57:43.524670+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1306,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.478143+0000","last_change":"2024-04-23T01:44:35.631346+0000","last_active":"2024-04-23T01:57:43.478143+0000","last_peered":"2024-04-23T01:57:43.478143+0000","last_clean":"2024-04-23T01:57:43.478143+0000","last_became_active":"2024-04-23T01:44:35.625747+0000","last_became_peered":"2024-04-23T01:44:35.625747+0000","last_unstale":"2024-04-23T01:57:43.478143+0000","last_undegraded":"2024-04-23T01:57:43.478143+0000","last_fullsized":"2024-04-23T01:57:43.478143+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.856874+0000","last_change":"2024-04-23T01:44:35.567181+0000","last_active":"2024-04-23T01:57:43.856874+0000","last_peered":"2024-04-23T01:57:43.856874+0000","last_clean":"2024-04-23T01:57:43.856874+0000","last_became_active":"2024-04-23T01:44:35.558674+0000","last_became_peered":"2024-04-23T01:44:35.558674+0000","last_unstale":"2024-04-23T01:57:43.856874+0000","last_undegraded":"2024-04-23T01:57:43.856874+0000","last_fullsized":"2024-04-23T01:57:43.856874+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.474398+0000","last_change":"2024-04-23T01:38:48.861947+0000","last_active":"2024-04-23T01:57:43.474398+0000","last_peered":"2024-04-23T01:57:43.474398+0000","last_clean":"2024-04-23T01:57:43.474398+0000","last_became_active":"2024-04-23T01:38:48.855491+0000","last_became_peered":"2024-04-23T01:38:48.855491+0000","last_unstale":"2024-04-23T01:57:43.474398+0000","last_undegraded":"2024-04-23T01:57:43.474398+0000","last_fullsized":"2024-04-23T01:57:43.474398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.930350+0000","last_change":"2024-04-23T01:38:48.864893+0000","last_active":"2024-04-23T01:57:43.930350+0000","last_peered":"2024-04-23T01:57:43.930350+0000","last_clean":"2024-04-23T01:57:43.930350+0000","last_became_active":"2024-04-23T01:38:48.859341+0000","last_became_peered":"2024-04-23T01:38:48.859341+0000","last_unstale":"2024-04-23T01:57:43.930350+0000","last_undegraded":"2024-04-23T01:57:43.930350+0000","last_fullsized":"2024-04-23T01:57:43.930350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.789903+0000","last_change":"2024-04-23T01:38:48.878113+0000","last_active":"2024-04-23T01:57:43.789903+0000","last_peered":"2024-04-23T01:57:43.789903+0000","last_clean":"2024-04-23T01:57:43.789903+0000","last_became_active":"2024-04-23T01:38:48.868717+0000","last_became_peered":"2024-04-23T01:38:48.868717+0000","last_unstale":"2024-04-23T01:57:43.789903+0000","last_undegraded":"2024-04-23T01:57:43.789903+0000","last_fullsized":"2024-04-23T01:57:43.789903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.910456+0000","last_change":"2024-04-23T01:38:48.865866+0000","last_active":"2024-04-23T01:57:43.910456+0000","last_peered":"2024-04-23T01:57:43.910456+0000","last_clean":"2024-04-23T01:57:43.910456+0000","last_became_active":"2024-04-23T01:38:48.860354+0000","last_became_peered":"2024-04-23T01:38:48.860354+0000","last_unstale":"2024-04-23T01:57:43.910456+0000","last_undegraded":"2024-04-23T01:57:43.910456+0000","last_fullsized":"2024-04-23T01:57:43.910456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.569618+0000","last_change":"2024-04-23T01:38:48.884633+0000","last_active":"2024-04-23T01:57:43.569618+0000","last_peered":"2024-04-23T01:57:43.569618+0000","last_clean":"2024-04-23T01:57:43.569618+0000","last_became_active":"2024-04-23T01:38:48.879351+0000","last_became_peered":"2024-04-23T01:38:48.879351+0000","last_unstale":"2024-04-23T01:57:43.569618+0000","last_undegraded":"2024-04-23T01:57:43.569618+0000","last_fullsized":"2024-04-23T01:57:43.569618+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1885,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.720525+0000","last_change":"2024-04-23T01:38:48.887592+0000","last_active":"2024-04-23T01:57:43.720525+0000","last_peered":"2024-04-23T01:57:43.720525+0000","last_clean":"2024-04-23T01:57:43.720525+0000","last_became_active":"2024-04-23T01:38:48.883647+0000","last_became_peered":"2024-04-23T01:38:48.883647+0000","last_unstale":"2024-04-23T01:57:43.720525+0000","last_undegraded":"2024-04-23T01:57:43.720525+0000","last_fullsized":"2024-04-23T01:57:43.720525+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.502987+0000","last_change":"2024-04-23T01:38:48.858269+0000","last_active":"2024-04-23T01:57:43.502987+0000","last_peered":"2024-04-23T01:57:43.502987+0000","last_clean":"2024-04-23T01:57:43.502987+0000","last_became_active":"2024-04-23T01:38:48.849449+0000","last_became_peered":"2024-04-23T01:38:48.849449+0000","last_unstale":"2024-04-23T01:57:43.502987+0000","last_undegraded":"2024-04-23T01:57:43.502987+0000","last_fullsized":"2024-04-23T01:57:43.502987+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.495058+0000","last_change":"2024-04-23T01:38:48.872508+0000","last_active":"2024-04-23T01:57:43.495058+0000","last_peered":"2024-04-23T01:57:43.495058+0000","last_clean":"2024-04-23T01:57:43.495058+0000","last_became_active":"2024-04-23T01:38:48.866529+0000","last_became_peered":"2024-04-23T01:38:48.866529+0000","last_unstale":"2024-04-23T01:57:43.495058+0000","last_undegraded":"2024-04-23T01:57:43.495058+0000","last_fullsized":"2024-04-23T01:57:43.495058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2022,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.778951+0000","last_change":"2024-04-23T01:38:46.833335+0000","last_active":"2024-04-23T01:57:43.778951+0000","last_peered":"2024-04-23T01:57:43.778951+0000","last_clean":"2024-04-23T01:57:43.778951+0000","last_became_active":"2024-04-23T01:38:46.827916+0000","last_became_peered":"2024-04-23T01:38:46.827916+0000","last_unstale":"2024-04-23T01:57:43.778951+0000","last_undegraded":"2024-04-23T01:57:43.778951+0000","last_fullsized":"2024-04-23T01:57:43.778951+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_clean_scrub_stamp":"2024-04-23T01:38:45.784723+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77968,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779632,"statfs":{"total":107374182400,"available":107294343168,"internally_reserved":0,"allocated":2498560,"data_stored":1238414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":69060,"kb_used_data":1852,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104788540,"statfs":{"total":107374182400,"available":107303464960,"internally_reserved":0,"allocated":1896448,"data_stored":651427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":78004,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779596,"statfs":{"total":107374182400,"available":107294306304,"internally_reserved":0,"allocated":2535424,"data_stored":1289415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792652,"statfs":{"total":107374182400,"available":107307675648,"internally_reserved":0,"allocated":1945600,"data_stored":687249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T01:58:16.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T01:58:16.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.576+0000 7f794d59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:16.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.581+0000 7f794d59d640 1 Processor -- start 2024-04-23T01:58:16.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.581+0000 7f794d59d640 1 -- start start 2024-04-23T01:58:16.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f794d59d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7948134dc0 0x7f79481371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f794d59d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794812c280 con 0x7f794812b760 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f794d59d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f794809ce80 con 0x7f7948134dc0 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f79467fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7948134dc0 0x7f79481371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f79467fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7948134dc0 0x7f79481371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46274/0 (socket says 172.21.15.37:46274) 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f79467fc640 1 -- 172.21.15.37:0/177511827 learned_addr learned my addr 172.21.15.37:0/177511827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f7946ffd640 1 --1- 172.21.15.37:0/177511827 >> v1:172.21.15.37:6789/0 conn(0x7f794812b760 0x7f794812bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40228/0 (socket says 172.21.15.37:40228) 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f79467fc640 1 -- 172.21.15.37:0/177511827 >> v1:172.21.15.37:6789/0 conn(0x7f794812b760 legacy=0x7f794812bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f79467fc640 1 -- 172.21.15.37:0/177511827 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794809dd50 con 0x7f7948134dc0 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f79467fc640 1 --2- 172.21.15.37:0/177511827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7948134dc0 0x7f79481371e0 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871592e9966c4a1a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.583+0000 7f7945ffb640 1 -- 172.21.15.37:0/177511827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7930009e50 con 0x7f7948134dc0 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f7945ffb640 1 -- 172.21.15.37:0/177511827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f793000e230 con 0x7f7948134dc0 2024-04-23T01:58:16.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f7945ffb640 1 -- 172.21.15.37:0/177511827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f793000e4d0 con 0x7f7948134dc0 2024-04-23T01:58:16.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f794d59d640 1 -- 172.21.15.37:0/177511827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7948134dc0 msgr2=0x7f79481371e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f794d59d640 1 --2- 172.21.15.37:0/177511827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7948134dc0 0x7f79481371e0 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f794d59d640 1 -- 172.21.15.37:0/177511827 shutdown_connections 2024-04-23T01:58:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f794d59d640 1 --2- 172.21.15.37:0/177511827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7948134dc0 0x7f79481371e0 unknown :-1 s=CLOSED pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f794d59d640 1 -- 172.21.15.37:0/177511827 >> 172.21.15.37:0/177511827 conn(0x7f79480a0950 msgr2=0x7f79480a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f794d59d640 1 -- 172.21.15.37:0/177511827 shutdown_connections 2024-04-23T01:58:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.584+0000 7f794d59d640 1 -- 172.21.15.37:0/177511827 wait complete. 2024-04-23T01:58:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.585+0000 7f794d59d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.586+0000 7f794d59d640 1 Processor -- start 2024-04-23T01:58:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.586+0000 7f794d59d640 1 -- start start 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.588+0000 7f794d59d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f794812b760 0x7f79481c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.588+0000 7f794d59d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7948070990 con 0x7f794812b760 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.588+0000 7f7946ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f794812b760 0x7f79481c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.588+0000 7f7946ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f794812b760 0x7f79481c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46280/0 (socket says 172.21.15.37:46280) 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.588+0000 7f7946ffd640 1 -- 172.21.15.37:0/882389895 learned_addr learned my addr 172.21.15.37:0/882389895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.588+0000 7f7946ffd640 1 -- 172.21.15.37:0/882389895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794812b220 con 0x7f794812b760 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.589+0000 7f7946ffd640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f794812b760 0x7f79481c5310 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.589+0000 7f793f7fe640 1 -- 172.21.15.37:0/882389895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79380070b0 con 0x7f794812b760 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.589+0000 7f793f7fe640 1 -- 172.21.15.37:0/882389895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7938007210 con 0x7f794812b760 2024-04-23T01:58:16.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.589+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79480705f0 con 0x7f794812b760 2024-04-23T01:58:16.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.589+0000 7f793f7fe640 1 -- 172.21.15.37:0/882389895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79380074b0 con 0x7f794812b760 2024-04-23T01:58:16.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.589+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f794811a7a0 con 0x7f794812b760 2024-04-23T01:58:16.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.590+0000 7f793f7fe640 1 -- 172.21.15.37:0/882389895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7938007660 con 0x7f794812b760 2024-04-23T01:58:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.590+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79480707e0 con 0x7f794812b760 2024-04-23T01:58:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.590+0000 7f793f7fe640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7928038980 0x7f792803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.590+0000 7f793f7fe640 1 -- 172.21.15.37:0/882389895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f7938048e20 con 0x7f794812b760 2024-04-23T01:58:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.590+0000 7f79467fc640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7928038980 0x7f792803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.591+0000 7f79467fc640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7928038980 0x7f792803ae90 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.595+0000 7f793f7fe640 1 -- 172.21.15.37:0/882389895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f79380092c0 con 0x7f794812b760 2024-04-23T01:58:16.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.781+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f794811ad00 con 0x7f7928038980 2024-04-23T01:58:16.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.785+0000 7f793f7fe640 1 -- 172.21.15.37:0/882389895 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+108925 (crc 0 0 0) 0x7f794811ad00 con 0x7f7928038980 2024-04-23T01:58:16.788 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:58:16.788 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7928038980 msgr2=0x7f792803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7928038980 0x7f792803ae90 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f794812b760 msgr2=0x7f79481c5310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f794812b760 0x7f79481c5310 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 shutdown_connections 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7928038980 0x7f792803ae90 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 --2- 172.21.15.37:0/882389895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f794812b760 0x7f79481c5310 unknown :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 >> 172.21.15.37:0/882389895 conn(0x7f79480a0950 msgr2=0x7f794812c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 shutdown_connections 2024-04-23T01:58:16.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.787+0000 7f794d59d640 1 -- 172.21.15.37:0/882389895 wait complete. 2024-04-23T01:58:16.801 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":1297,"stamp":"2024-04-23T01:58:16.037008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":289980,"kb_used_data":8668,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419140420,"statfs":{"total":429496729600,"available":429199790080,"internally_reserved":0,"allocated":8876032,"data_stored":3866505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002579"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.513550+0000","last_change":"2024-04-23T01:44:35.541884+0000","last_active":"2024-04-23T01:57:43.513550+0000","last_peered":"2024-04-23T01:57:43.513550+0000","last_clean":"2024-04-23T01:57:43.513550+0000","last_became_active":"2024-04-23T01:44:35.536828+0000","last_became_peered":"2024-04-23T01:44:35.536828+0000","last_unstale":"2024-04-23T01:57:43.513550+0000","last_undegraded":"2024-04-23T01:57:43.513550+0000","last_fullsized":"2024-04-23T01:57:43.513550+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.508293+0000","last_change":"2024-04-23T01:44:35.597862+0000","last_active":"2024-04-23T01:57:43.508293+0000","last_peered":"2024-04-23T01:57:43.508293+0000","last_clean":"2024-04-23T01:57:43.508293+0000","last_became_active":"2024-04-23T01:44:35.592920+0000","last_became_peered":"2024-04-23T01:44:35.592920+0000","last_unstale":"2024-04-23T01:57:43.508293+0000","last_undegraded":"2024-04-23T01:57:43.508293+0000","last_fullsized":"2024-04-23T01:57:43.508293+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.817795+0000","last_change":"2024-04-23T01:44:35.607049+0000","last_active":"2024-04-23T01:57:43.817795+0000","last_peered":"2024-04-23T01:57:43.817795+0000","last_clean":"2024-04-23T01:57:43.817795+0000","last_became_active":"2024-04-23T01:44:35.598001+0000","last_became_peered":"2024-04-23T01:44:35.598001+0000","last_unstale":"2024-04-23T01:57:43.817795+0000","last_undegraded":"2024-04-23T01:57:43.817795+0000","last_fullsized":"2024-04-23T01:57:43.817795+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.770406+0000","last_change":"2024-04-23T01:44:35.621029+0000","last_active":"2024-04-23T01:57:43.770406+0000","last_peered":"2024-04-23T01:57:43.770406+0000","last_clean":"2024-04-23T01:57:43.770406+0000","last_became_active":"2024-04-23T01:44:35.610632+0000","last_became_peered":"2024-04-23T01:44:35.610632+0000","last_unstale":"2024-04-23T01:57:43.770406+0000","last_undegraded":"2024-04-23T01:57:43.770406+0000","last_fullsized":"2024-04-23T01:57:43.770406+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.491966+0000","last_change":"2024-04-23T01:44:35.502927+0000","last_active":"2024-04-23T01:57:43.491966+0000","last_peered":"2024-04-23T01:57:43.491966+0000","last_clean":"2024-04-23T01:57:43.491966+0000","last_became_active":"2024-04-23T01:44:35.490300+0000","last_became_peered":"2024-04-23T01:44:35.490300+0000","last_unstale":"2024-04-23T01:57:43.491966+0000","last_undegraded":"2024-04-23T01:57:43.491966+0000","last_fullsized":"2024-04-23T01:57:43.491966+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.512124+0000","last_change":"2024-04-23T01:44:35.577689+0000","last_active":"2024-04-23T01:57:43.512124+0000","last_peered":"2024-04-23T01:57:43.512124+0000","last_clean":"2024-04-23T01:57:43.512124+0000","last_became_active":"2024-04-23T01:44:35.572629+0000","last_became_peered":"2024-04-23T01:44:35.572629+0000","last_unstale":"2024-04-23T01:57:43.512124+0000","last_undegraded":"2024-04-23T01:57:43.512124+0000","last_fullsized":"2024-04-23T01:57:43.512124+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1303,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.733518+0000","last_change":"2024-04-23T01:44:35.531053+0000","last_active":"2024-04-23T01:57:43.733518+0000","last_peered":"2024-04-23T01:57:43.733518+0000","last_clean":"2024-04-23T01:57:43.733518+0000","last_became_active":"2024-04-23T01:44:35.525053+0000","last_became_peered":"2024-04-23T01:44:35.525053+0000","last_unstale":"2024-04-23T01:57:43.733518+0000","last_undegraded":"2024-04-23T01:57:43.733518+0000","last_fullsized":"2024-04-23T01:57:43.733518+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.523481+0000","last_change":"2024-04-23T01:44:35.475519+0000","last_active":"2024-04-23T01:57:43.523481+0000","last_peered":"2024-04-23T01:57:43.523481+0000","last_clean":"2024-04-23T01:57:43.523481+0000","last_became_active":"2024-04-23T01:44:35.468130+0000","last_became_peered":"2024-04-23T01:44:35.468130+0000","last_unstale":"2024-04-23T01:57:43.523481+0000","last_undegraded":"2024-04-23T01:57:43.523481+0000","last_fullsized":"2024-04-23T01:57:43.523481+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.786976+0000","last_change":"2024-04-23T01:44:35.624145+0000","last_active":"2024-04-23T01:57:43.786976+0000","last_peered":"2024-04-23T01:57:43.786976+0000","last_clean":"2024-04-23T01:57:43.786976+0000","last_became_active":"2024-04-23T01:44:35.615580+0000","last_became_peered":"2024-04-23T01:44:35.615580+0000","last_unstale":"2024-04-23T01:57:43.786976+0000","last_undegraded":"2024-04-23T01:57:43.786976+0000","last_fullsized":"2024-04-23T01:57:43.786976+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.851756+0000","last_change":"2024-04-23T01:44:35.603892+0000","last_active":"2024-04-23T01:57:43.851756+0000","last_peered":"2024-04-23T01:57:43.851756+0000","last_clean":"2024-04-23T01:57:43.851756+0000","last_became_active":"2024-04-23T01:44:35.595827+0000","last_became_peered":"2024-04-23T01:44:35.595827+0000","last_unstale":"2024-04-23T01:57:43.851756+0000","last_undegraded":"2024-04-23T01:57:43.851756+0000","last_fullsized":"2024-04-23T01:57:43.851756+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.838556+0000","last_change":"2024-04-23T01:44:35.498234+0000","last_active":"2024-04-23T01:57:43.838556+0000","last_peered":"2024-04-23T01:57:43.838556+0000","last_clean":"2024-04-23T01:57:43.838556+0000","last_became_active":"2024-04-23T01:44:35.493377+0000","last_became_peered":"2024-04-23T01:44:35.493377+0000","last_unstale":"2024-04-23T01:57:43.838556+0000","last_undegraded":"2024-04-23T01:57:43.838556+0000","last_fullsized":"2024-04-23T01:57:43.838556+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.502171+0000","last_change":"2024-04-23T01:44:35.487445+0000","last_active":"2024-04-23T01:57:43.502171+0000","last_peered":"2024-04-23T01:57:43.502171+0000","last_clean":"2024-04-23T01:57:43.502171+0000","last_became_active":"2024-04-23T01:44:35.481772+0000","last_became_peered":"2024-04-23T01:44:35.481772+0000","last_unstale":"2024-04-23T01:57:43.502171+0000","last_undegraded":"2024-04-23T01:57:43.502171+0000","last_fullsized":"2024-04-23T01:57:43.502171+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.799440+0000","last_change":"2024-04-23T01:44:35.583076+0000","last_active":"2024-04-23T01:57:43.799440+0000","last_peered":"2024-04-23T01:57:43.799440+0000","last_clean":"2024-04-23T01:57:43.799440+0000","last_became_active":"2024-04-23T01:44:35.572973+0000","last_became_peered":"2024-04-23T01:44:35.572973+0000","last_unstale":"2024-04-23T01:57:43.799440+0000","last_undegraded":"2024-04-23T01:57:43.799440+0000","last_fullsized":"2024-04-23T01:57:43.799440+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.775791+0000","last_change":"2024-04-23T01:44:35.561524+0000","last_active":"2024-04-23T01:57:43.775791+0000","last_peered":"2024-04-23T01:57:43.775791+0000","last_clean":"2024-04-23T01:57:43.775791+0000","last_became_active":"2024-04-23T01:44:35.552435+0000","last_became_peered":"2024-04-23T01:44:35.552435+0000","last_unstale":"2024-04-23T01:57:43.775791+0000","last_undegraded":"2024-04-23T01:57:43.775791+0000","last_fullsized":"2024-04-23T01:57:43.775791+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.520070+0000","last_change":"2024-04-23T01:44:35.533102+0000","last_active":"2024-04-23T01:57:43.520070+0000","last_peered":"2024-04-23T01:57:43.520070+0000","last_clean":"2024-04-23T01:57:43.520070+0000","last_became_active":"2024-04-23T01:44:35.525485+0000","last_became_peered":"2024-04-23T01:44:35.525485+0000","last_unstale":"2024-04-23T01:57:43.520070+0000","last_undegraded":"2024-04-23T01:57:43.520070+0000","last_fullsized":"2024-04-23T01:57:43.520070+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1303,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.744107+0000","last_change":"2024-04-23T01:44:35.557707+0000","last_active":"2024-04-23T01:57:43.744107+0000","last_peered":"2024-04-23T01:57:43.744107+0000","last_clean":"2024-04-23T01:57:43.744107+0000","last_became_active":"2024-04-23T01:44:35.553565+0000","last_became_peered":"2024-04-23T01:44:35.553565+0000","last_unstale":"2024-04-23T01:57:43.744107+0000","last_undegraded":"2024-04-23T01:57:43.744107+0000","last_fullsized":"2024-04-23T01:57:43.744107+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.498572+0000","last_change":"2024-04-23T01:44:35.514978+0000","last_active":"2024-04-23T01:57:43.498572+0000","last_peered":"2024-04-23T01:57:43.498572+0000","last_clean":"2024-04-23T01:57:43.498572+0000","last_became_active":"2024-04-23T01:44:35.510739+0000","last_became_peered":"2024-04-23T01:44:35.510739+0000","last_unstale":"2024-04-23T01:57:43.498572+0000","last_undegraded":"2024-04-23T01:57:43.498572+0000","last_fullsized":"2024-04-23T01:57:43.498572+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.815553+0000","last_change":"2024-04-23T01:44:35.661139+0000","last_active":"2024-04-23T01:57:43.815553+0000","last_peered":"2024-04-23T01:57:43.815553+0000","last_clean":"2024-04-23T01:57:43.815553+0000","last_became_active":"2024-04-23T01:44:35.655691+0000","last_became_peered":"2024-04-23T01:44:35.655691+0000","last_unstale":"2024-04-23T01:57:43.815553+0000","last_undegraded":"2024-04-23T01:57:43.815553+0000","last_fullsized":"2024-04-23T01:57:43.815553+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.811267+0000","last_change":"2024-04-23T01:44:35.495357+0000","last_active":"2024-04-23T01:57:43.811267+0000","last_peered":"2024-04-23T01:57:43.811267+0000","last_clean":"2024-04-23T01:57:43.811267+0000","last_became_active":"2024-04-23T01:44:35.488384+0000","last_became_peered":"2024-04-23T01:44:35.488384+0000","last_unstale":"2024-04-23T01:57:43.811267+0000","last_undegraded":"2024-04-23T01:57:43.811267+0000","last_fullsized":"2024-04-23T01:57:43.811267+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.484205+0000","last_change":"2024-04-23T01:44:35.619539+0000","last_active":"2024-04-23T01:57:43.484205+0000","last_peered":"2024-04-23T01:57:43.484205+0000","last_clean":"2024-04-23T01:57:43.484205+0000","last_became_active":"2024-04-23T01:44:35.613157+0000","last_became_peered":"2024-04-23T01:44:35.613157+0000","last_unstale":"2024-04-23T01:57:43.484205+0000","last_undegraded":"2024-04-23T01:57:43.484205+0000","last_fullsized":"2024-04-23T01:57:43.484205+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.494029+0000","last_change":"2024-04-23T01:44:35.564324+0000","last_active":"2024-04-23T01:57:43.494029+0000","last_peered":"2024-04-23T01:57:43.494029+0000","last_clean":"2024-04-23T01:57:43.494029+0000","last_became_active":"2024-04-23T01:44:35.555769+0000","last_became_peered":"2024-04-23T01:44:35.555769+0000","last_unstale":"2024-04-23T01:57:43.494029+0000","last_undegraded":"2024-04-23T01:57:43.494029+0000","last_fullsized":"2024-04-23T01:57:43.494029+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.486490+0000","last_change":"2024-04-23T01:44:35.530323+0000","last_active":"2024-04-23T01:57:43.486490+0000","last_peered":"2024-04-23T01:57:43.486490+0000","last_clean":"2024-04-23T01:57:43.486490+0000","last_became_active":"2024-04-23T01:44:35.520575+0000","last_became_peered":"2024-04-23T01:44:35.520575+0000","last_unstale":"2024-04-23T01:57:43.486490+0000","last_undegraded":"2024-04-23T01:57:43.486490+0000","last_fullsized":"2024-04-23T01:57:43.486490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.826060+0000","last_change":"2024-04-23T01:44:35.633303+0000","last_active":"2024-04-23T01:57:43.826060+0000","last_peered":"2024-04-23T01:57:43.826060+0000","last_clean":"2024-04-23T01:57:43.826060+0000","last_became_active":"2024-04-23T01:44:35.625265+0000","last_became_peered":"2024-04-23T01:44:35.625265+0000","last_unstale":"2024-04-23T01:57:43.826060+0000","last_undegraded":"2024-04-23T01:57:43.826060+0000","last_fullsized":"2024-04-23T01:57:43.826060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.847209+0000","last_change":"2024-04-23T01:44:35.630312+0000","last_active":"2024-04-23T01:57:43.847209+0000","last_peered":"2024-04-23T01:57:43.847209+0000","last_clean":"2024-04-23T01:57:43.847209+0000","last_became_active":"2024-04-23T01:44:35.617649+0000","last_became_peered":"2024-04-23T01:44:35.617649+0000","last_unstale":"2024-04-23T01:57:43.847209+0000","last_undegraded":"2024-04-23T01:57:43.847209+0000","last_fullsized":"2024-04-23T01:57:43.847209+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.828881+0000","last_change":"2024-04-23T01:44:35.620547+0000","last_active":"2024-04-23T01:57:43.828881+0000","last_peered":"2024-04-23T01:57:43.828881+0000","last_clean":"2024-04-23T01:57:43.828881+0000","last_became_active":"2024-04-23T01:44:35.610600+0000","last_became_peered":"2024-04-23T01:44:35.610600+0000","last_unstale":"2024-04-23T01:57:43.828881+0000","last_undegraded":"2024-04-23T01:57:43.828881+0000","last_fullsized":"2024-04-23T01:57:43.828881+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.497146+0000","last_change":"2024-04-23T01:44:35.506423+0000","last_active":"2024-04-23T01:57:43.497146+0000","last_peered":"2024-04-23T01:57:43.497146+0000","last_clean":"2024-04-23T01:57:43.497146+0000","last_became_active":"2024-04-23T01:44:35.498971+0000","last_became_peered":"2024-04-23T01:44:35.498971+0000","last_unstale":"2024-04-23T01:57:43.497146+0000","last_undegraded":"2024-04-23T01:57:43.497146+0000","last_fullsized":"2024-04-23T01:57:43.497146+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.841667+0000","last_change":"2024-04-23T01:44:35.666017+0000","last_active":"2024-04-23T01:57:43.841667+0000","last_peered":"2024-04-23T01:57:43.841667+0000","last_clean":"2024-04-23T01:57:43.841667+0000","last_became_active":"2024-04-23T01:44:35.661648+0000","last_became_peered":"2024-04-23T01:44:35.661648+0000","last_unstale":"2024-04-23T01:57:43.841667+0000","last_undegraded":"2024-04-23T01:57:43.841667+0000","last_fullsized":"2024-04-23T01:57:43.841667+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.505608+0000","last_change":"2024-04-23T01:44:35.551930+0000","last_active":"2024-04-23T01:57:43.505608+0000","last_peered":"2024-04-23T01:57:43.505608+0000","last_clean":"2024-04-23T01:57:43.505608+0000","last_became_active":"2024-04-23T01:44:35.546395+0000","last_became_peered":"2024-04-23T01:44:35.546395+0000","last_unstale":"2024-04-23T01:57:43.505608+0000","last_undegraded":"2024-04-23T01:57:43.505608+0000","last_fullsized":"2024-04-23T01:57:43.505608+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.515284+0000","last_change":"2024-04-23T01:44:35.567435+0000","last_active":"2024-04-23T01:57:43.515284+0000","last_peered":"2024-04-23T01:57:43.515284+0000","last_clean":"2024-04-23T01:57:43.515284+0000","last_became_active":"2024-04-23T01:44:35.560107+0000","last_became_peered":"2024-04-23T01:44:35.560107+0000","last_unstale":"2024-04-23T01:57:43.515284+0000","last_undegraded":"2024-04-23T01:57:43.515284+0000","last_fullsized":"2024-04-23T01:57:43.515284+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.524670+0000","last_change":"2024-04-23T01:44:35.590627+0000","last_active":"2024-04-23T01:57:43.524670+0000","last_peered":"2024-04-23T01:57:43.524670+0000","last_clean":"2024-04-23T01:57:43.524670+0000","last_became_active":"2024-04-23T01:44:35.585680+0000","last_became_peered":"2024-04-23T01:44:35.585680+0000","last_unstale":"2024-04-23T01:57:43.524670+0000","last_undegraded":"2024-04-23T01:57:43.524670+0000","last_fullsized":"2024-04-23T01:57:43.524670+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1306,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.478143+0000","last_change":"2024-04-23T01:44:35.631346+0000","last_active":"2024-04-23T01:57:43.478143+0000","last_peered":"2024-04-23T01:57:43.478143+0000","last_clean":"2024-04-23T01:57:43.478143+0000","last_became_active":"2024-04-23T01:44:35.625747+0000","last_became_peered":"2024-04-23T01:44:35.625747+0000","last_unstale":"2024-04-23T01:57:43.478143+0000","last_undegraded":"2024-04-23T01:57:43.478143+0000","last_fullsized":"2024-04-23T01:57:43.478143+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.856874+0000","last_change":"2024-04-23T01:44:35.567181+0000","last_active":"2024-04-23T01:57:43.856874+0000","last_peered":"2024-04-23T01:57:43.856874+0000","last_clean":"2024-04-23T01:57:43.856874+0000","last_became_active":"2024-04-23T01:44:35.558674+0000","last_became_peered":"2024-04-23T01:44:35.558674+0000","last_unstale":"2024-04-23T01:57:43.856874+0000","last_undegraded":"2024-04-23T01:57:43.856874+0000","last_fullsized":"2024-04-23T01:57:43.856874+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.474398+0000","last_change":"2024-04-23T01:38:48.861947+0000","last_active":"2024-04-23T01:57:43.474398+0000","last_peered":"2024-04-23T01:57:43.474398+0000","last_clean":"2024-04-23T01:57:43.474398+0000","last_became_active":"2024-04-23T01:38:48.855491+0000","last_became_peered":"2024-04-23T01:38:48.855491+0000","last_unstale":"2024-04-23T01:57:43.474398+0000","last_undegraded":"2024-04-23T01:57:43.474398+0000","last_fullsized":"2024-04-23T01:57:43.474398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.930350+0000","last_change":"2024-04-23T01:38:48.864893+0000","last_active":"2024-04-23T01:57:43.930350+0000","last_peered":"2024-04-23T01:57:43.930350+0000","last_clean":"2024-04-23T01:57:43.930350+0000","last_became_active":"2024-04-23T01:38:48.859341+0000","last_became_peered":"2024-04-23T01:38:48.859341+0000","last_unstale":"2024-04-23T01:57:43.930350+0000","last_undegraded":"2024-04-23T01:57:43.930350+0000","last_fullsized":"2024-04-23T01:57:43.930350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.789903+0000","last_change":"2024-04-23T01:38:48.878113+0000","last_active":"2024-04-23T01:57:43.789903+0000","last_peered":"2024-04-23T01:57:43.789903+0000","last_clean":"2024-04-23T01:57:43.789903+0000","last_became_active":"2024-04-23T01:38:48.868717+0000","last_became_peered":"2024-04-23T01:38:48.868717+0000","last_unstale":"2024-04-23T01:57:43.789903+0000","last_undegraded":"2024-04-23T01:57:43.789903+0000","last_fullsized":"2024-04-23T01:57:43.789903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.910456+0000","last_change":"2024-04-23T01:38:48.865866+0000","last_active":"2024-04-23T01:57:43.910456+0000","last_peered":"2024-04-23T01:57:43.910456+0000","last_clean":"2024-04-23T01:57:43.910456+0000","last_became_active":"2024-04-23T01:38:48.860354+0000","last_became_peered":"2024-04-23T01:38:48.860354+0000","last_unstale":"2024-04-23T01:57:43.910456+0000","last_undegraded":"2024-04-23T01:57:43.910456+0000","last_fullsized":"2024-04-23T01:57:43.910456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.569618+0000","last_change":"2024-04-23T01:38:48.884633+0000","last_active":"2024-04-23T01:57:43.569618+0000","last_peered":"2024-04-23T01:57:43.569618+0000","last_clean":"2024-04-23T01:57:43.569618+0000","last_became_active":"2024-04-23T01:38:48.879351+0000","last_became_peered":"2024-04-23T01:38:48.879351+0000","last_unstale":"2024-04-23T01:57:43.569618+0000","last_undegraded":"2024-04-23T01:57:43.569618+0000","last_fullsized":"2024-04-23T01:57:43.569618+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1885,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.720525+0000","last_change":"2024-04-23T01:38:48.887592+0000","last_active":"2024-04-23T01:57:43.720525+0000","last_peered":"2024-04-23T01:57:43.720525+0000","last_clean":"2024-04-23T01:57:43.720525+0000","last_became_active":"2024-04-23T01:38:48.883647+0000","last_became_peered":"2024-04-23T01:38:48.883647+0000","last_unstale":"2024-04-23T01:57:43.720525+0000","last_undegraded":"2024-04-23T01:57:43.720525+0000","last_fullsized":"2024-04-23T01:57:43.720525+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.502987+0000","last_change":"2024-04-23T01:38:48.858269+0000","last_active":"2024-04-23T01:57:43.502987+0000","last_peered":"2024-04-23T01:57:43.502987+0000","last_clean":"2024-04-23T01:57:43.502987+0000","last_became_active":"2024-04-23T01:38:48.849449+0000","last_became_peered":"2024-04-23T01:38:48.849449+0000","last_unstale":"2024-04-23T01:57:43.502987+0000","last_undegraded":"2024-04-23T01:57:43.502987+0000","last_fullsized":"2024-04-23T01:57:43.502987+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.495058+0000","last_change":"2024-04-23T01:38:48.872508+0000","last_active":"2024-04-23T01:57:43.495058+0000","last_peered":"2024-04-23T01:57:43.495058+0000","last_clean":"2024-04-23T01:57:43.495058+0000","last_became_active":"2024-04-23T01:38:48.866529+0000","last_became_peered":"2024-04-23T01:38:48.866529+0000","last_unstale":"2024-04-23T01:57:43.495058+0000","last_undegraded":"2024-04-23T01:57:43.495058+0000","last_fullsized":"2024-04-23T01:57:43.495058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2022,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.778951+0000","last_change":"2024-04-23T01:38:46.833335+0000","last_active":"2024-04-23T01:57:43.778951+0000","last_peered":"2024-04-23T01:57:43.778951+0000","last_clean":"2024-04-23T01:57:43.778951+0000","last_became_active":"2024-04-23T01:38:46.827916+0000","last_became_peered":"2024-04-23T01:38:46.827916+0000","last_unstale":"2024-04-23T01:57:43.778951+0000","last_undegraded":"2024-04-23T01:57:43.778951+0000","last_fullsized":"2024-04-23T01:57:43.778951+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_clean_scrub_stamp":"2024-04-23T01:38:45.784723+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77968,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779632,"statfs":{"total":107374182400,"available":107294343168,"internally_reserved":0,"allocated":2498560,"data_stored":1238414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":69060,"kb_used_data":1852,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104788540,"statfs":{"total":107374182400,"available":107303464960,"internally_reserved":0,"allocated":1896448,"data_stored":651427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":78004,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779596,"statfs":{"total":107374182400,"available":107294306304,"internally_reserved":0,"allocated":2535424,"data_stored":1289415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792652,"statfs":{"total":107374182400,"available":107307675648,"internally_reserved":0,"allocated":1945600,"data_stored":687249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T01:58:16.802 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T01:58:16.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T01:58:16.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.907+0000 7fc62471d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.912+0000 7fc62471d640 1 Processor -- start 2024-04-23T01:58:16.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.913+0000 7fc62471d640 1 -- start start 2024-04-23T01:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.914+0000 7fc62471d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc61c0a01e0 0x7fc61c138120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.914+0000 7fc62471d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc61c06dda0 con 0x7fc61c09f6c0 2024-04-23T01:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.914+0000 7fc62471d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc61c06e2e0 con 0x7fc61c0a01e0 2024-04-23T01:58:16.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.914+0000 7fc621cb8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc61c0a01e0 0x7fc61c138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.914+0000 7fc621cb8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc61c0a01e0 0x7fc61c138120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46294/0 (socket says 172.21.15.37:46294) 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.914+0000 7fc621cb8640 1 -- 172.21.15.37:0/1382760643 learned_addr learned my addr 172.21.15.37:0/1382760643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.914+0000 7fc6224b9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc61c09f6c0 0x7fc61c09fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40240/0 (socket says 172.21.15.37:40240) 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.915+0000 7fc621cb8640 1 -- 172.21.15.37:0/1382760643 >> v1:172.21.15.37:6789/0 conn(0x7fc61c09f6c0 legacy=0x7fc61c09fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.915+0000 7fc6214b7640 1 -- 172.21.15.37:0/1382760643 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048149412 0 0) 0x7fc61c06dda0 con 0x7fc61c09f6c0 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.915+0000 7fc621cb8640 1 -- 172.21.15.37:0/1382760643 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c06d920 con 0x7fc61c0a01e0 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.915+0000 7fc621cb8640 1 --2- 172.21.15.37:0/1382760643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c0a01e0 0x7fc61c138120 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9380d59b108e72a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.915+0000 7fc6214b7640 1 -- 172.21.15.37:0/1382760643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc610009e50 con 0x7fc61c0a01e0 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.915+0000 7fc6214b7640 1 -- 172.21.15.37:0/1382760643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc61000e230 con 0x7fc61c0a01e0 2024-04-23T01:58:16.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.915+0000 7fc6214b7640 1 -- 172.21.15.37:0/1382760643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc61000e4d0 con 0x7fc61c0a01e0 2024-04-23T01:58:16.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 1 -- 172.21.15.37:0/1382760643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c0a01e0 msgr2=0x7fc61c138120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:16.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 1 --2- 172.21.15.37:0/1382760643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c0a01e0 0x7fc61c138120 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 1 -- 172.21.15.37:0/1382760643 shutdown_connections 2024-04-23T01:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 1 --2- 172.21.15.37:0/1382760643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c0a01e0 0x7fc61c138120 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 1 -- 172.21.15.37:0/1382760643 >> 172.21.15.37:0/1382760643 conn(0x7fc61c0a0950 msgr2=0x7fc61c0a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 1 -- 172.21.15.37:0/1382760643 shutdown_connections 2024-04-23T01:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 1 -- 172.21.15.37:0/1382760643 wait complete. 2024-04-23T01:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.916+0000 7fc62471d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.918+0000 7fc62471d640 1 Processor -- start 2024-04-23T01:58:16.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.918+0000 7fc62471d640 1 -- start start 2024-04-23T01:58:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.919+0000 7fc62471d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c09f6c0 0x7fc61c11d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.919+0000 7fc62471d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc61c11ec40 con 0x7fc61c09f6c0 2024-04-23T01:58:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.919+0000 7fc6224b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c09f6c0 0x7fc61c11d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc6224b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c09f6c0 0x7fc61c11d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46308/0 (socket says 172.21.15.37:46308) 2024-04-23T01:58:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc6224b9640 1 -- 172.21.15.37:0/2664205869 learned_addr learned my addr 172.21.15.37:0/2664205869 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:16.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc6224b9640 1 -- 172.21.15.37:0/2664205869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61c11d260 con 0x7fc61c09f6c0 2024-04-23T01:58:16.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc6224b9640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c09f6c0 0x7fc61c11d8b0 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc61affd640 1 -- 172.21.15.37:0/2664205869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc614004b80 con 0x7fc61c09f6c0 2024-04-23T01:58:16.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61c11e850 con 0x7fc61c09f6c0 2024-04-23T01:58:16.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc61affd640 1 -- 172.21.15.37:0/2664205869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc614004ce0 con 0x7fc61c09f6c0 2024-04-23T01:58:16.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc61affd640 1 -- 172.21.15.37:0/2664205869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc614007120 con 0x7fc61c09f6c0 2024-04-23T01:58:16.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.920+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc61c11f710 con 0x7fc61c09f6c0 2024-04-23T01:58:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.921+0000 7fc61affd640 1 -- 172.21.15.37:0/2664205869 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc614007320 con 0x7fc61c09f6c0 2024-04-23T01:58:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.921+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61c11f0f0 con 0x7fc61c09f6c0 2024-04-23T01:58:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.921+0000 7fc61affd640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc608038930 0x7fc60803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.921+0000 7fc61affd640 1 -- 172.21.15.37:0/2664205869 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7fc6140486f0 con 0x7fc61c09f6c0 2024-04-23T01:58:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.922+0000 7fc621cb8640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc608038930 0x7fc60803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:16.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.922+0000 7fc621cb8640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc608038930 0x7fc60803ae40 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:16.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:16.927+0000 7fc61affd640 1 -- 172.21.15.37:0/2664205869 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc61c11f0f0 con 0x7fc61c09f6c0 2024-04-23T01:58:17.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.148+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc61c09d620 con 0x7fc608038930 2024-04-23T01:58:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.151+0000 7fc61affd640 1 -- 172.21.15.37:0/2664205869 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+108925 (crc 0 0 0) 0x7fc61000e4a0 con 0x7fc608038930 2024-04-23T01:58:17.154 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:58:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-23T01:58:17.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc608038930 msgr2=0x7fc60803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc608038930 0x7fc60803ae40 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c09f6c0 msgr2=0x7fc61c11d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c09f6c0 0x7fc61c11d8b0 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 shutdown_connections 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc608038930 0x7fc60803ae40 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 --2- 172.21.15.37:0/2664205869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc61c09f6c0 0x7fc61c11d8b0 unknown :-1 s=CLOSED pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 >> 172.21.15.37:0/2664205869 conn(0x7fc61c0a0950 msgr2=0x7fc61c1318e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 shutdown_connections 2024-04-23T01:58:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.155+0000 7fc62471d640 1 -- 172.21.15.37:0/2664205869 wait complete. 2024-04-23T01:58:17.177 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":1297,"stamp":"2024-04-23T01:58:16.037008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":289980,"kb_used_data":8668,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419140420,"statfs":{"total":429496729600,"available":429199790080,"internally_reserved":0,"allocated":8876032,"data_stored":3866505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002579"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.513550+0000","last_change":"2024-04-23T01:44:35.541884+0000","last_active":"2024-04-23T01:57:43.513550+0000","last_peered":"2024-04-23T01:57:43.513550+0000","last_clean":"2024-04-23T01:57:43.513550+0000","last_became_active":"2024-04-23T01:44:35.536828+0000","last_became_peered":"2024-04-23T01:44:35.536828+0000","last_unstale":"2024-04-23T01:57:43.513550+0000","last_undegraded":"2024-04-23T01:57:43.513550+0000","last_fullsized":"2024-04-23T01:57:43.513550+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.508293+0000","last_change":"2024-04-23T01:44:35.597862+0000","last_active":"2024-04-23T01:57:43.508293+0000","last_peered":"2024-04-23T01:57:43.508293+0000","last_clean":"2024-04-23T01:57:43.508293+0000","last_became_active":"2024-04-23T01:44:35.592920+0000","last_became_peered":"2024-04-23T01:44:35.592920+0000","last_unstale":"2024-04-23T01:57:43.508293+0000","last_undegraded":"2024-04-23T01:57:43.508293+0000","last_fullsized":"2024-04-23T01:57:43.508293+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.817795+0000","last_change":"2024-04-23T01:44:35.607049+0000","last_active":"2024-04-23T01:57:43.817795+0000","last_peered":"2024-04-23T01:57:43.817795+0000","last_clean":"2024-04-23T01:57:43.817795+0000","last_became_active":"2024-04-23T01:44:35.598001+0000","last_became_peered":"2024-04-23T01:44:35.598001+0000","last_unstale":"2024-04-23T01:57:43.817795+0000","last_undegraded":"2024-04-23T01:57:43.817795+0000","last_fullsized":"2024-04-23T01:57:43.817795+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.770406+0000","last_change":"2024-04-23T01:44:35.621029+0000","last_active":"2024-04-23T01:57:43.770406+0000","last_peered":"2024-04-23T01:57:43.770406+0000","last_clean":"2024-04-23T01:57:43.770406+0000","last_became_active":"2024-04-23T01:44:35.610632+0000","last_became_peered":"2024-04-23T01:44:35.610632+0000","last_unstale":"2024-04-23T01:57:43.770406+0000","last_undegraded":"2024-04-23T01:57:43.770406+0000","last_fullsized":"2024-04-23T01:57:43.770406+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.491966+0000","last_change":"2024-04-23T01:44:35.502927+0000","last_active":"2024-04-23T01:57:43.491966+0000","last_peered":"2024-04-23T01:57:43.491966+0000","last_clean":"2024-04-23T01:57:43.491966+0000","last_became_active":"2024-04-23T01:44:35.490300+0000","last_became_peered":"2024-04-23T01:44:35.490300+0000","last_unstale":"2024-04-23T01:57:43.491966+0000","last_undegraded":"2024-04-23T01:57:43.491966+0000","last_fullsized":"2024-04-23T01:57:43.491966+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.512124+0000","last_change":"2024-04-23T01:44:35.577689+0000","last_active":"2024-04-23T01:57:43.512124+0000","last_peered":"2024-04-23T01:57:43.512124+0000","last_clean":"2024-04-23T01:57:43.512124+0000","last_became_active":"2024-04-23T01:44:35.572629+0000","last_became_peered":"2024-04-23T01:44:35.572629+0000","last_unstale":"2024-04-23T01:57:43.512124+0000","last_undegraded":"2024-04-23T01:57:43.512124+0000","last_fullsized":"2024-04-23T01:57:43.512124+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1303,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.733518+0000","last_change":"2024-04-23T01:44:35.531053+0000","last_active":"2024-04-23T01:57:43.733518+0000","last_peered":"2024-04-23T01:57:43.733518+0000","last_clean":"2024-04-23T01:57:43.733518+0000","last_became_active":"2024-04-23T01:44:35.525053+0000","last_became_peered":"2024-04-23T01:44:35.525053+0000","last_unstale":"2024-04-23T01:57:43.733518+0000","last_undegraded":"2024-04-23T01:57:43.733518+0000","last_fullsized":"2024-04-23T01:57:43.733518+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.523481+0000","last_change":"2024-04-23T01:44:35.475519+0000","last_active":"2024-04-23T01:57:43.523481+0000","last_peered":"2024-04-23T01:57:43.523481+0000","last_clean":"2024-04-23T01:57:43.523481+0000","last_became_active":"2024-04-23T01:44:35.468130+0000","last_became_peered":"2024-04-23T01:44:35.468130+0000","last_unstale":"2024-04-23T01:57:43.523481+0000","last_undegraded":"2024-04-23T01:57:43.523481+0000","last_fullsized":"2024-04-23T01:57:43.523481+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.786976+0000","last_change":"2024-04-23T01:44:35.624145+0000","last_active":"2024-04-23T01:57:43.786976+0000","last_peered":"2024-04-23T01:57:43.786976+0000","last_clean":"2024-04-23T01:57:43.786976+0000","last_became_active":"2024-04-23T01:44:35.615580+0000","last_became_peered":"2024-04-23T01:44:35.615580+0000","last_unstale":"2024-04-23T01:57:43.786976+0000","last_undegraded":"2024-04-23T01:57:43.786976+0000","last_fullsized":"2024-04-23T01:57:43.786976+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.851756+0000","last_change":"2024-04-23T01:44:35.603892+0000","last_active":"2024-04-23T01:57:43.851756+0000","last_peered":"2024-04-23T01:57:43.851756+0000","last_clean":"2024-04-23T01:57:43.851756+0000","last_became_active":"2024-04-23T01:44:35.595827+0000","last_became_peered":"2024-04-23T01:44:35.595827+0000","last_unstale":"2024-04-23T01:57:43.851756+0000","last_undegraded":"2024-04-23T01:57:43.851756+0000","last_fullsized":"2024-04-23T01:57:43.851756+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.838556+0000","last_change":"2024-04-23T01:44:35.498234+0000","last_active":"2024-04-23T01:57:43.838556+0000","last_peered":"2024-04-23T01:57:43.838556+0000","last_clean":"2024-04-23T01:57:43.838556+0000","last_became_active":"2024-04-23T01:44:35.493377+0000","last_became_peered":"2024-04-23T01:44:35.493377+0000","last_unstale":"2024-04-23T01:57:43.838556+0000","last_undegraded":"2024-04-23T01:57:43.838556+0000","last_fullsized":"2024-04-23T01:57:43.838556+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.502171+0000","last_change":"2024-04-23T01:44:35.487445+0000","last_active":"2024-04-23T01:57:43.502171+0000","last_peered":"2024-04-23T01:57:43.502171+0000","last_clean":"2024-04-23T01:57:43.502171+0000","last_became_active":"2024-04-23T01:44:35.481772+0000","last_became_peered":"2024-04-23T01:44:35.481772+0000","last_unstale":"2024-04-23T01:57:43.502171+0000","last_undegraded":"2024-04-23T01:57:43.502171+0000","last_fullsized":"2024-04-23T01:57:43.502171+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.799440+0000","last_change":"2024-04-23T01:44:35.583076+0000","last_active":"2024-04-23T01:57:43.799440+0000","last_peered":"2024-04-23T01:57:43.799440+0000","last_clean":"2024-04-23T01:57:43.799440+0000","last_became_active":"2024-04-23T01:44:35.572973+0000","last_became_peered":"2024-04-23T01:44:35.572973+0000","last_unstale":"2024-04-23T01:57:43.799440+0000","last_undegraded":"2024-04-23T01:57:43.799440+0000","last_fullsized":"2024-04-23T01:57:43.799440+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.775791+0000","last_change":"2024-04-23T01:44:35.561524+0000","last_active":"2024-04-23T01:57:43.775791+0000","last_peered":"2024-04-23T01:57:43.775791+0000","last_clean":"2024-04-23T01:57:43.775791+0000","last_became_active":"2024-04-23T01:44:35.552435+0000","last_became_peered":"2024-04-23T01:44:35.552435+0000","last_unstale":"2024-04-23T01:57:43.775791+0000","last_undegraded":"2024-04-23T01:57:43.775791+0000","last_fullsized":"2024-04-23T01:57:43.775791+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.520070+0000","last_change":"2024-04-23T01:44:35.533102+0000","last_active":"2024-04-23T01:57:43.520070+0000","last_peered":"2024-04-23T01:57:43.520070+0000","last_clean":"2024-04-23T01:57:43.520070+0000","last_became_active":"2024-04-23T01:44:35.525485+0000","last_became_peered":"2024-04-23T01:44:35.525485+0000","last_unstale":"2024-04-23T01:57:43.520070+0000","last_undegraded":"2024-04-23T01:57:43.520070+0000","last_fullsized":"2024-04-23T01:57:43.520070+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1303,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.744107+0000","last_change":"2024-04-23T01:44:35.557707+0000","last_active":"2024-04-23T01:57:43.744107+0000","last_peered":"2024-04-23T01:57:43.744107+0000","last_clean":"2024-04-23T01:57:43.744107+0000","last_became_active":"2024-04-23T01:44:35.553565+0000","last_became_peered":"2024-04-23T01:44:35.553565+0000","last_unstale":"2024-04-23T01:57:43.744107+0000","last_undegraded":"2024-04-23T01:57:43.744107+0000","last_fullsized":"2024-04-23T01:57:43.744107+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.498572+0000","last_change":"2024-04-23T01:44:35.514978+0000","last_active":"2024-04-23T01:57:43.498572+0000","last_peered":"2024-04-23T01:57:43.498572+0000","last_clean":"2024-04-23T01:57:43.498572+0000","last_became_active":"2024-04-23T01:44:35.510739+0000","last_became_peered":"2024-04-23T01:44:35.510739+0000","last_unstale":"2024-04-23T01:57:43.498572+0000","last_undegraded":"2024-04-23T01:57:43.498572+0000","last_fullsized":"2024-04-23T01:57:43.498572+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.815553+0000","last_change":"2024-04-23T01:44:35.661139+0000","last_active":"2024-04-23T01:57:43.815553+0000","last_peered":"2024-04-23T01:57:43.815553+0000","last_clean":"2024-04-23T01:57:43.815553+0000","last_became_active":"2024-04-23T01:44:35.655691+0000","last_became_peered":"2024-04-23T01:44:35.655691+0000","last_unstale":"2024-04-23T01:57:43.815553+0000","last_undegraded":"2024-04-23T01:57:43.815553+0000","last_fullsized":"2024-04-23T01:57:43.815553+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1301,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.811267+0000","last_change":"2024-04-23T01:44:35.495357+0000","last_active":"2024-04-23T01:57:43.811267+0000","last_peered":"2024-04-23T01:57:43.811267+0000","last_clean":"2024-04-23T01:57:43.811267+0000","last_became_active":"2024-04-23T01:44:35.488384+0000","last_became_peered":"2024-04-23T01:44:35.488384+0000","last_unstale":"2024-04-23T01:57:43.811267+0000","last_undegraded":"2024-04-23T01:57:43.811267+0000","last_fullsized":"2024-04-23T01:57:43.811267+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.484205+0000","last_change":"2024-04-23T01:44:35.619539+0000","last_active":"2024-04-23T01:57:43.484205+0000","last_peered":"2024-04-23T01:57:43.484205+0000","last_clean":"2024-04-23T01:57:43.484205+0000","last_became_active":"2024-04-23T01:44:35.613157+0000","last_became_peered":"2024-04-23T01:44:35.613157+0000","last_unstale":"2024-04-23T01:57:43.484205+0000","last_undegraded":"2024-04-23T01:57:43.484205+0000","last_fullsized":"2024-04-23T01:57:43.484205+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.494029+0000","last_change":"2024-04-23T01:44:35.564324+0000","last_active":"2024-04-23T01:57:43.494029+0000","last_peered":"2024-04-23T01:57:43.494029+0000","last_clean":"2024-04-23T01:57:43.494029+0000","last_became_active":"2024-04-23T01:44:35.555769+0000","last_became_peered":"2024-04-23T01:44:35.555769+0000","last_unstale":"2024-04-23T01:57:43.494029+0000","last_undegraded":"2024-04-23T01:57:43.494029+0000","last_fullsized":"2024-04-23T01:57:43.494029+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.486490+0000","last_change":"2024-04-23T01:44:35.530323+0000","last_active":"2024-04-23T01:57:43.486490+0000","last_peered":"2024-04-23T01:57:43.486490+0000","last_clean":"2024-04-23T01:57:43.486490+0000","last_became_active":"2024-04-23T01:44:35.520575+0000","last_became_peered":"2024-04-23T01:44:35.520575+0000","last_unstale":"2024-04-23T01:57:43.486490+0000","last_undegraded":"2024-04-23T01:57:43.486490+0000","last_fullsized":"2024-04-23T01:57:43.486490+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.826060+0000","last_change":"2024-04-23T01:44:35.633303+0000","last_active":"2024-04-23T01:57:43.826060+0000","last_peered":"2024-04-23T01:57:43.826060+0000","last_clean":"2024-04-23T01:57:43.826060+0000","last_became_active":"2024-04-23T01:44:35.625265+0000","last_became_peered":"2024-04-23T01:44:35.625265+0000","last_unstale":"2024-04-23T01:57:43.826060+0000","last_undegraded":"2024-04-23T01:57:43.826060+0000","last_fullsized":"2024-04-23T01:57:43.826060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.847209+0000","last_change":"2024-04-23T01:44:35.630312+0000","last_active":"2024-04-23T01:57:43.847209+0000","last_peered":"2024-04-23T01:57:43.847209+0000","last_clean":"2024-04-23T01:57:43.847209+0000","last_became_active":"2024-04-23T01:44:35.617649+0000","last_became_peered":"2024-04-23T01:44:35.617649+0000","last_unstale":"2024-04-23T01:57:43.847209+0000","last_undegraded":"2024-04-23T01:57:43.847209+0000","last_fullsized":"2024-04-23T01:57:43.847209+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.828881+0000","last_change":"2024-04-23T01:44:35.620547+0000","last_active":"2024-04-23T01:57:43.828881+0000","last_peered":"2024-04-23T01:57:43.828881+0000","last_clean":"2024-04-23T01:57:43.828881+0000","last_became_active":"2024-04-23T01:44:35.610600+0000","last_became_peered":"2024-04-23T01:44:35.610600+0000","last_unstale":"2024-04-23T01:57:43.828881+0000","last_undegraded":"2024-04-23T01:57:43.828881+0000","last_fullsized":"2024-04-23T01:57:43.828881+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.497146+0000","last_change":"2024-04-23T01:44:35.506423+0000","last_active":"2024-04-23T01:57:43.497146+0000","last_peered":"2024-04-23T01:57:43.497146+0000","last_clean":"2024-04-23T01:57:43.497146+0000","last_became_active":"2024-04-23T01:44:35.498971+0000","last_became_peered":"2024-04-23T01:44:35.498971+0000","last_unstale":"2024-04-23T01:57:43.497146+0000","last_undegraded":"2024-04-23T01:57:43.497146+0000","last_fullsized":"2024-04-23T01:57:43.497146+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.841667+0000","last_change":"2024-04-23T01:44:35.666017+0000","last_active":"2024-04-23T01:57:43.841667+0000","last_peered":"2024-04-23T01:57:43.841667+0000","last_clean":"2024-04-23T01:57:43.841667+0000","last_became_active":"2024-04-23T01:44:35.661648+0000","last_became_peered":"2024-04-23T01:44:35.661648+0000","last_unstale":"2024-04-23T01:57:43.841667+0000","last_undegraded":"2024-04-23T01:57:43.841667+0000","last_fullsized":"2024-04-23T01:57:43.841667+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.505608+0000","last_change":"2024-04-23T01:44:35.551930+0000","last_active":"2024-04-23T01:57:43.505608+0000","last_peered":"2024-04-23T01:57:43.505608+0000","last_clean":"2024-04-23T01:57:43.505608+0000","last_became_active":"2024-04-23T01:44:35.546395+0000","last_became_peered":"2024-04-23T01:44:35.546395+0000","last_unstale":"2024-04-23T01:57:43.505608+0000","last_undegraded":"2024-04-23T01:57:43.505608+0000","last_fullsized":"2024-04-23T01:57:43.505608+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.515284+0000","last_change":"2024-04-23T01:44:35.567435+0000","last_active":"2024-04-23T01:57:43.515284+0000","last_peered":"2024-04-23T01:57:43.515284+0000","last_clean":"2024-04-23T01:57:43.515284+0000","last_became_active":"2024-04-23T01:44:35.560107+0000","last_became_peered":"2024-04-23T01:44:35.560107+0000","last_unstale":"2024-04-23T01:57:43.515284+0000","last_undegraded":"2024-04-23T01:57:43.515284+0000","last_fullsized":"2024-04-23T01:57:43.515284+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1293,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.524670+0000","last_change":"2024-04-23T01:44:35.590627+0000","last_active":"2024-04-23T01:57:43.524670+0000","last_peered":"2024-04-23T01:57:43.524670+0000","last_clean":"2024-04-23T01:57:43.524670+0000","last_became_active":"2024-04-23T01:44:35.585680+0000","last_became_peered":"2024-04-23T01:44:35.585680+0000","last_unstale":"2024-04-23T01:57:43.524670+0000","last_undegraded":"2024-04-23T01:57:43.524670+0000","last_fullsized":"2024-04-23T01:57:43.524670+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1306,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.478143+0000","last_change":"2024-04-23T01:44:35.631346+0000","last_active":"2024-04-23T01:57:43.478143+0000","last_peered":"2024-04-23T01:57:43.478143+0000","last_clean":"2024-04-23T01:57:43.478143+0000","last_became_active":"2024-04-23T01:44:35.625747+0000","last_became_peered":"2024-04-23T01:44:35.625747+0000","last_unstale":"2024-04-23T01:57:43.478143+0000","last_undegraded":"2024-04-23T01:57:43.478143+0000","last_fullsized":"2024-04-23T01:57:43.478143+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1287,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.856874+0000","last_change":"2024-04-23T01:44:35.567181+0000","last_active":"2024-04-23T01:57:43.856874+0000","last_peered":"2024-04-23T01:57:43.856874+0000","last_clean":"2024-04-23T01:57:43.856874+0000","last_became_active":"2024-04-23T01:44:35.558674+0000","last_became_peered":"2024-04-23T01:44:35.558674+0000","last_unstale":"2024-04-23T01:57:43.856874+0000","last_undegraded":"2024-04-23T01:57:43.856874+0000","last_fullsized":"2024-04-23T01:57:43.856874+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.474398+0000","last_change":"2024-04-23T01:38:48.861947+0000","last_active":"2024-04-23T01:57:43.474398+0000","last_peered":"2024-04-23T01:57:43.474398+0000","last_clean":"2024-04-23T01:57:43.474398+0000","last_became_active":"2024-04-23T01:38:48.855491+0000","last_became_peered":"2024-04-23T01:38:48.855491+0000","last_unstale":"2024-04-23T01:57:43.474398+0000","last_undegraded":"2024-04-23T01:57:43.474398+0000","last_fullsized":"2024-04-23T01:57:43.474398+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.930350+0000","last_change":"2024-04-23T01:38:48.864893+0000","last_active":"2024-04-23T01:57:43.930350+0000","last_peered":"2024-04-23T01:57:43.930350+0000","last_clean":"2024-04-23T01:57:43.930350+0000","last_became_active":"2024-04-23T01:38:48.859341+0000","last_became_peered":"2024-04-23T01:38:48.859341+0000","last_unstale":"2024-04-23T01:57:43.930350+0000","last_undegraded":"2024-04-23T01:57:43.930350+0000","last_fullsized":"2024-04-23T01:57:43.930350+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.789903+0000","last_change":"2024-04-23T01:38:48.878113+0000","last_active":"2024-04-23T01:57:43.789903+0000","last_peered":"2024-04-23T01:57:43.789903+0000","last_clean":"2024-04-23T01:57:43.789903+0000","last_became_active":"2024-04-23T01:38:48.868717+0000","last_became_peered":"2024-04-23T01:38:48.868717+0000","last_unstale":"2024-04-23T01:57:43.789903+0000","last_undegraded":"2024-04-23T01:57:43.789903+0000","last_fullsized":"2024-04-23T01:57:43.789903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1889,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.910456+0000","last_change":"2024-04-23T01:38:48.865866+0000","last_active":"2024-04-23T01:57:43.910456+0000","last_peered":"2024-04-23T01:57:43.910456+0000","last_clean":"2024-04-23T01:57:43.910456+0000","last_became_active":"2024-04-23T01:38:48.860354+0000","last_became_peered":"2024-04-23T01:38:48.860354+0000","last_unstale":"2024-04-23T01:57:43.910456+0000","last_undegraded":"2024-04-23T01:57:43.910456+0000","last_fullsized":"2024-04-23T01:57:43.910456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.569618+0000","last_change":"2024-04-23T01:38:48.884633+0000","last_active":"2024-04-23T01:57:43.569618+0000","last_peered":"2024-04-23T01:57:43.569618+0000","last_clean":"2024-04-23T01:57:43.569618+0000","last_became_active":"2024-04-23T01:38:48.879351+0000","last_became_peered":"2024-04-23T01:38:48.879351+0000","last_unstale":"2024-04-23T01:57:43.569618+0000","last_undegraded":"2024-04-23T01:57:43.569618+0000","last_fullsized":"2024-04-23T01:57:43.569618+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1885,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.720525+0000","last_change":"2024-04-23T01:38:48.887592+0000","last_active":"2024-04-23T01:57:43.720525+0000","last_peered":"2024-04-23T01:57:43.720525+0000","last_clean":"2024-04-23T01:57:43.720525+0000","last_became_active":"2024-04-23T01:38:48.883647+0000","last_became_peered":"2024-04-23T01:38:48.883647+0000","last_unstale":"2024-04-23T01:57:43.720525+0000","last_undegraded":"2024-04-23T01:57:43.720525+0000","last_fullsized":"2024-04-23T01:57:43.720525+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.502987+0000","last_change":"2024-04-23T01:38:48.858269+0000","last_active":"2024-04-23T01:57:43.502987+0000","last_peered":"2024-04-23T01:57:43.502987+0000","last_clean":"2024-04-23T01:57:43.502987+0000","last_became_active":"2024-04-23T01:38:48.849449+0000","last_became_peered":"2024-04-23T01:38:48.849449+0000","last_unstale":"2024-04-23T01:57:43.502987+0000","last_undegraded":"2024-04-23T01:57:43.502987+0000","last_fullsized":"2024-04-23T01:57:43.502987+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1879,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.495058+0000","last_change":"2024-04-23T01:38:48.872508+0000","last_active":"2024-04-23T01:57:43.495058+0000","last_peered":"2024-04-23T01:57:43.495058+0000","last_clean":"2024-04-23T01:57:43.495058+0000","last_became_active":"2024-04-23T01:38:48.866529+0000","last_became_peered":"2024-04-23T01:38:48.866529+0000","last_unstale":"2024-04-23T01:57:43.495058+0000","last_undegraded":"2024-04-23T01:57:43.495058+0000","last_fullsized":"2024-04-23T01:57:43.495058+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2022,"reported_epoch":716,"state":"active+clean","last_fresh":"2024-04-23T01:57:43.778951+0000","last_change":"2024-04-23T01:38:46.833335+0000","last_active":"2024-04-23T01:57:43.778951+0000","last_peered":"2024-04-23T01:57:43.778951+0000","last_clean":"2024-04-23T01:57:43.778951+0000","last_became_active":"2024-04-23T01:38:46.827916+0000","last_became_peered":"2024-04-23T01:38:46.827916+0000","last_unstale":"2024-04-23T01:57:43.778951+0000","last_undegraded":"2024-04-23T01:57:43.778951+0000","last_fullsized":"2024-04-23T01:57:43.778951+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_clean_scrub_stamp":"2024-04-23T01:38:45.784723+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77968,"kb_used_data":2440,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779632,"statfs":{"total":107374182400,"available":107294343168,"internally_reserved":0,"allocated":2498560,"data_stored":1238414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":69060,"kb_used_data":1852,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104788540,"statfs":{"total":107374182400,"available":107303464960,"internally_reserved":0,"allocated":1896448,"data_stored":651427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":78004,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779596,"statfs":{"total":107374182400,"available":107294306304,"internally_reserved":0,"allocated":2535424,"data_stored":1289415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792652,"statfs":{"total":107374182400,"available":107307675648,"internally_reserved":0,"allocated":1945600,"data_stored":687249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T01:58:17.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T01:58:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.324+0000 7f809759d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.334+0000 7f809759d640 1 Processor -- start 2024-04-23T01:58:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.335+0000 7f809759d640 1 -- start start 2024-04-23T01:58:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.337+0000 7f809759d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80900725f0 0x7f80901328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.337+0000 7f809759d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8090072330 con 0x7f8090132de0 2024-04-23T01:58:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.337+0000 7f809759d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f80900a0ef0 con 0x7f80900725f0 2024-04-23T01:58:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.338+0000 7f8094b38640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8090132de0 0x7f809012f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40248/0 (socket says 172.21.15.37:40248) 2024-04-23T01:58:17.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.338+0000 7f8094b38640 1 -- 172.21.15.37:0/1039243080 learned_addr learned my addr 172.21.15.37:0/1039243080 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.338+0000 7f8095339640 1 --2- 172.21.15.37:0/1039243080 >> v2:172.21.15.37:3300/0 conn(0x7f80900725f0 0x7f80901328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.338+0000 7f8087fff640 1 -- 172.21.15.37:0/1039243080 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097248196 0 0) 0x7f8090072330 con 0x7f8090132de0 2024-04-23T01:58:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.338+0000 7f8087fff640 1 -- 172.21.15.37:0/1039243080 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f807c003580 con 0x7f8090132de0 2024-04-23T01:58:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.338+0000 7f8087fff640 1 -- 172.21.15.37:0/1039243080 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1409856343 0 0) 0x7f807c003580 con 0x7f8090132de0 2024-04-23T01:58:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.338+0000 7f8095339640 1 -- 172.21.15.37:0/1039243080 >> v1:172.21.15.37:6789/0 conn(0x7f8090132de0 legacy=0x7f809012f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.339+0000 7f8095339640 1 -- 172.21.15.37:0/1039243080 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80900a0be0 con 0x7f80900725f0 2024-04-23T01:58:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.339+0000 7f8095339640 1 --2- 172.21.15.37:0/1039243080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900725f0 0x7f80901328a0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d7f34bddeda4fb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.339+0000 7f8087fff640 1 -- 172.21.15.37:0/1039243080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f808c009d90 con 0x7f80900725f0 2024-04-23T01:58:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.340+0000 7f8087fff640 1 -- 172.21.15.37:0/1039243080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f808c00e230 con 0x7f80900725f0 2024-04-23T01:58:17.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.340+0000 7f8087fff640 1 -- 172.21.15.37:0/1039243080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f808c00e4d0 con 0x7f80900725f0 2024-04-23T01:58:17.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.341+0000 7f809759d640 1 -- 172.21.15.37:0/1039243080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900725f0 msgr2=0x7f80901328a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.341+0000 7f809759d640 1 --2- 172.21.15.37:0/1039243080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900725f0 0x7f80901328a0 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.341+0000 7f809759d640 1 -- 172.21.15.37:0/1039243080 shutdown_connections 2024-04-23T01:58:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.341+0000 7f809759d640 1 --2- 172.21.15.37:0/1039243080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80900725f0 0x7f80901328a0 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.341+0000 7f809759d640 1 -- 172.21.15.37:0/1039243080 >> 172.21.15.37:0/1039243080 conn(0x7f80900a1c00 msgr2=0x7f80900a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.341+0000 7f809759d640 1 -- 172.21.15.37:0/1039243080 shutdown_connections 2024-04-23T01:58:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.342+0000 7f809759d640 1 -- 172.21.15.37:0/1039243080 wait complete. 2024-04-23T01:58:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.342+0000 7f809759d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.345+0000 7f809759d640 1 Processor -- start 2024-04-23T01:58:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.345+0000 7f809759d640 1 -- start start 2024-04-23T01:58:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.347+0000 7f809759d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8090132de0 0x7f809006ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.347+0000 7f809759d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f809006fe30 con 0x7f8090132de0 2024-04-23T01:58:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.348+0000 7f8095339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8090132de0 0x7f809006ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.348+0000 7f8095339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8090132de0 0x7f809006ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46312/0 (socket says 172.21.15.37:46312) 2024-04-23T01:58:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.348+0000 7f8095339640 1 -- 172.21.15.37:0/28178076 learned_addr learned my addr 172.21.15.37:0/28178076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.348+0000 7f8095339640 1 -- 172.21.15.37:0/28178076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8090124ff0 con 0x7f8090132de0 2024-04-23T01:58:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.349+0000 7f8095339640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8090132de0 0x7f809006ea70 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.349+0000 7f8085ffb640 1 -- 172.21.15.37:0/28178076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f808c013400 con 0x7f8090132de0 2024-04-23T01:58:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.349+0000 7f8085ffb640 1 -- 172.21.15.37:0/28178076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f808c013560 con 0x7f8090132de0 2024-04-23T01:58:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.349+0000 7f8085ffb640 1 -- 172.21.15.37:0/28178076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f808c013800 con 0x7f8090132de0 2024-04-23T01:58:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.349+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809006fb20 con 0x7f8090132de0 2024-04-23T01:58:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.350+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8090123a40 con 0x7f8090132de0 2024-04-23T01:58:17.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.351+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8090124890 con 0x7f8090132de0 2024-04-23T01:58:17.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.351+0000 7f8085ffb640 1 -- 172.21.15.37:0/28178076 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f808c013960 con 0x7f8090132de0 2024-04-23T01:58:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.352+0000 7f8085ffb640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8074038a00 0x7f807403af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.352+0000 7f8085ffb640 1 -- 172.21.15.37:0/28178076 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f808c018040 con 0x7f8090132de0 2024-04-23T01:58:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.353+0000 7f8094b38640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8074038a00 0x7f807403af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.354+0000 7f8094b38640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8074038a00 0x7f807403af10 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:17.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.362+0000 7f8085ffb640 1 -- 172.21.15.37:0/28178076 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f808c018b20 con 0x7f8090132de0 2024-04-23T01:58:17.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.584+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80900a0580 con 0x7f8090132de0 2024-04-23T01:58:17.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.585+0000 7f8085ffb640 1 -- 172.21.15.37:0/28178076 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v718) ==== 74+0+11127 (crc 0 0 0) 0x7f808c018710 con 0x7f8090132de0 2024-04-23T01:58:17.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:58:17.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":718,"fsid":"e132a9f8-f5c5-4318-805c-a5b188312643","created":"2024-04-23T01:38:37.200203+0000","modified":"2024-04-23T01:58:15.488448+0000","last_up_change":"2024-04-23T01:38:43.779753+0000","last_in_change":"2024-04-23T01:38:39.323031+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":201,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T01:38:45.767564+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T01:38:47.518741+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-04-23T01:44:33.387916+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9aacf45a-9611-4f14-9dea-50f0fc0f3a3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":705,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1949701083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6801","nonce":1949701083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1949701083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6803","nonce":1949701083}]},"public_addr":"172.21.15.37:6802/1949701083","cluster_addr":"172.21.15.37:6801/1949701083","heartbeat_back_addr":"172.21.15.37:6800/1949701083","heartbeat_front_addr":"172.21.15.37:6803/1949701083","state":["exists","up"]},{"osd":1,"uuid":"ed271568-29f8-4d1b-a810-ca3b16b2682d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":705,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6805","nonce":1977556410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1977556410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1977556410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6807","nonce":1977556410}]},"public_addr":"172.21.15.37:6805/1977556410","cluster_addr":"172.21.15.37:6804/1977556410","heartbeat_back_addr":"172.21.15.37:6808/1977556410","heartbeat_front_addr":"172.21.15.37:6807/1977556410","state":["exists","up"]},{"osd":2,"uuid":"d9c96632-2efd-4fc2-8d5a-896bbe7a5204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":705,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6805","nonce":3894758024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":3894758024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6807","nonce":3894758024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":3894758024}]},"public_addr":"172.21.15.191:6805/3894758024","cluster_addr":"172.21.15.191:6804/3894758024","heartbeat_back_addr":"172.21.15.191:6807/3894758024","heartbeat_front_addr":"172.21.15.191:6812/3894758024","state":["exists","up"]},{"osd":3,"uuid":"e191d386-d82b-47ee-b6c7-5154e1d630c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":705,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1018833307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":1018833307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1018833307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6811","nonce":1018833307}]},"public_addr":"172.21.15.191:6808/1018833307","cluster_addr":"172.21.15.191:6809/1018833307","heartbeat_back_addr":"172.21.15.191:6810/1018833307","heartbeat_front_addr":"172.21.15.191:6811/1018833307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":4},{"begin":9,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":181,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":1}]},{"pool":184,"snaps":[{"begin":1,"length":2}]},{"pool":185,"snaps":[{"begin":3,"length":1}]},{"pool":188,"snaps":[{"begin":2,"length":2}]},{"pool":190,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8074038a00 msgr2=0x7f807403af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8074038a00 0x7f807403af10 crc :-1 s=READY pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8090132de0 msgr2=0x7f809006ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8090132de0 0x7f809006ea70 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 shutdown_connections 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f8074038a00 0x7f807403af10 unknown :-1 s=CLOSED pgs=3861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 --2- 172.21.15.37:0/28178076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8090132de0 0x7f809006ea70 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 >> 172.21.15.37:0/28178076 conn(0x7f80900a1c00 msgr2=0x7f80900a2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 shutdown_connections 2024-04-23T01:58:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:17.587+0000 7f809759d640 1 -- 172.21.15.37:0/28178076 wait complete. 2024-04-23T01:58:18.602 INFO:tasks.ceph:Scrubbing osd.0 2024-04-23T01:58:18.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-23T01:58:18.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.722+0000 7f7bff95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:18.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.731+0000 7f7bff95d640 1 Processor -- start 2024-04-23T01:58:18.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.732+0000 7f7bff95d640 1 -- start start 2024-04-23T01:58:18.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.733+0000 7f7bff95d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bf8131290 0x7f7bf81316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:18.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.733+0000 7f7bff95d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf806ff60 con 0x7f7bf8131be0 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.733+0000 7f7bff95d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf806eaf0 con 0x7f7bf8131290 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.733+0000 7f7bfd6f9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7bf8131290 0x7f7bf81316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.733+0000 7f7bfcef8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7bf8131be0 0x7f7bf806d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40260/0 (socket says 172.21.15.37:40260) 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.733+0000 7f7bfcef8640 1 -- 172.21.15.37:0/198885627 learned_addr learned my addr 172.21.15.37:0/198885627 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.734+0000 7f7bfd6f9640 1 -- 172.21.15.37:0/198885627 >> v1:172.21.15.37:6789/0 conn(0x7f7bf8131be0 legacy=0x7f7bf806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.734+0000 7f7bfd6f9640 1 -- 172.21.15.37:0/198885627 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf806fc20 con 0x7f7bf8131290 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.734+0000 7f7bfd6f9640 1 --2- 172.21.15.37:0/198885627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf81316a0 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34717afb3afb48e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.734+0000 7f7beffff640 1 -- 172.21.15.37:0/198885627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7bf0009d90 con 0x7f7bf8131290 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.734+0000 7f7beffff640 1 -- 172.21.15.37:0/198885627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7bf000e230 con 0x7f7bf8131290 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.734+0000 7f7beffff640 1 -- 172.21.15.37:0/198885627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7bf000e4d0 con 0x7f7bf8131290 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 1 -- 172.21.15.37:0/198885627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 msgr2=0x7f7bf81316a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 1 --2- 172.21.15.37:0/198885627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf81316a0 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 1 -- 172.21.15.37:0/198885627 shutdown_connections 2024-04-23T01:58:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 1 --2- 172.21.15.37:0/198885627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf81316a0 unknown :-1 s=CLOSED pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 1 -- 172.21.15.37:0/198885627 >> 172.21.15.37:0/198885627 conn(0x7f7bf80a19a0 msgr2=0x7f7bf80a1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 1 -- 172.21.15.37:0/198885627 shutdown_connections 2024-04-23T01:58:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 1 -- 172.21.15.37:0/198885627 wait complete. 2024-04-23T01:58:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.735+0000 7f7bff95d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.737+0000 7f7bff95d640 1 Processor -- start 2024-04-23T01:58:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.737+0000 7f7bff95d640 1 -- start start 2024-04-23T01:58:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.738+0000 7f7bff95d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf8129a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.738+0000 7f7bff95d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf81348f0 con 0x7f7bf8131290 2024-04-23T01:58:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bfd6f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf8129a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bfd6f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf8129a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46326/0 (socket says 172.21.15.37:46326) 2024-04-23T01:58:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bfd6f9640 1 -- 172.21.15.37:0/958694709 learned_addr learned my addr 172.21.15.37:0/958694709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bfd6f9640 1 -- 172.21.15.37:0/958694709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf8132e70 con 0x7f7bf8131290 2024-04-23T01:58:18.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bfd6f9640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf8129a20 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:18.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7bf0014620 con 0x7f7bf8131290 2024-04-23T01:58:18.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7bf0014780 con 0x7f7bf8131290 2024-04-23T01:58:18.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf8132c00 con 0x7f7bf8131290 2024-04-23T01:58:18.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7bf0014a20 con 0x7f7bf8131290 2024-04-23T01:58:18.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.739+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf8133d70 con 0x7f7bf8131290 2024-04-23T01:58:18.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.740+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7bf0014bd0 con 0x7f7bf8131290 2024-04-23T01:58:18.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.740+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bf809c940 con 0x7f7bf8131290 2024-04-23T01:58:18.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.740+0000 7f7bedffb640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7bdc038980 0x7f7bdc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:18.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.740+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f7bf0019040 con 0x7f7bf8131290 2024-04-23T01:58:18.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.741+0000 7f7bedffb640 1 --2- 172.21.15.37:0/958694709 >> v2:172.21.15.37:6802/1949701083 conn(0x7f7bdc03ea40 0x7f7bdc040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:18.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.741+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 --> v2:172.21.15.37:6802/1949701083 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bdc0415c0 con 0x7f7bdc03ea40 2024-04-23T01:58:18.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.741+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=718) ==== 24+0+0 (crc 0 0 0) 0x7f7bf0049fd0 con 0x7f7bf8131290 2024-04-23T01:58:18.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.741+0000 7f7bfcef8640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7bdc038980 0x7f7bdc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:18.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.741+0000 7f7bfcef8640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7bdc038980 0x7f7bdc03ae90 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:18.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.742+0000 7f7bfdefa640 1 --2- 172.21.15.37:0/958694709 >> v2:172.21.15.37:6802/1949701083 conn(0x7f7bdc03ea40 0x7f7bdc040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:58:18.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.745+0000 7f7bfdefa640 1 --2- 172.21.15.37:0/958694709 >> v2:172.21.15.37:6802/1949701083 conn(0x7f7bdc03ea40 0x7f7bdc040f30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:18.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.747+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== osd.0 v2:172.21.15.37:6802/1949701083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f7bdc0415c0 con 0x7f7bdc03ea40 2024-04-23T01:58:18.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.750+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 --> v2:172.21.15.37:6802/1949701083 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7bf806f7f0 con 0x7f7bdc03ea40 2024-04-23T01:58:18.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bedffb640 1 -- 172.21.15.37:0/958694709 <== osd.0 v2:172.21.15.37:6802/1949701083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f7bf400a820 con 0x7f7bdc03ea40 2024-04-23T01:58:18.754 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-23T01:58:18.754 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-04-23T01:58:18.754 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-23T01:58:18.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 >> v2:172.21.15.37:6802/1949701083 conn(0x7f7bdc03ea40 msgr2=0x7f7bdc040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:18.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 --2- 172.21.15.37:0/958694709 >> v2:172.21.15.37:6802/1949701083 conn(0x7f7bdc03ea40 0x7f7bdc040f30 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7bdc038980 msgr2=0x7f7bdc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7bdc038980 0x7f7bdc03ae90 crc :-1 s=READY pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 msgr2=0x7f7bf8129a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf8129a20 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 shutdown_connections 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 --2- 172.21.15.37:0/958694709 >> v2:172.21.15.37:6802/1949701083 conn(0x7f7bdc03ea40 0x7f7bdc040f30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f7bdc038980 0x7f7bdc03ae90 unknown :-1 s=CLOSED pgs=3862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 --2- 172.21.15.37:0/958694709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf8131290 0x7f7bf8129a20 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 >> 172.21.15.37:0/958694709 conn(0x7f7bf80a19a0 msgr2=0x7f7bf809d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:18.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 shutdown_connections 2024-04-23T01:58:18.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.752+0000 7f7bff95d640 1 -- 172.21.15.37:0/958694709 wait complete. 2024-04-23T01:58:18.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-23T01:58:18.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.875+0000 7f969e35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:18.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.881+0000 7f969e35d640 1 Processor -- start 2024-04-23T01:58:18.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.881+0000 7f969e35d640 1 -- start start 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f969e35d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f969809f960 0x7f969813a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f969e35d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969806f0b0 con 0x7f969809ee40 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f969e35d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9698073c50 con 0x7f969809f960 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f96977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f969809f960 0x7f969813a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f9697fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f969809ee40 0x7f969809f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40272/0 (socket says 172.21.15.37:40272) 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f96977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f969809f960 0x7f969813a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46332/0 (socket says 172.21.15.37:46332) 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f9697fff640 1 -- 172.21.15.37:0/3317873125 learned_addr learned my addr 172.21.15.37:0/3317873125 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.883+0000 7f96977fe640 1 -- 172.21.15.37:0/3317873125 >> v1:172.21.15.37:6789/0 conn(0x7f969809ee40 legacy=0x7f969809f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.884+0000 7f96977fe640 1 -- 172.21.15.37:0/3317873125 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96980a1120 con 0x7f969809f960 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.884+0000 7f9696ffd640 1 -- 172.21.15.37:0/3317873125 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430924351 0 0) 0x7f969806f0b0 con 0x7f969809ee40 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.884+0000 7f96977fe640 1 --2- 172.21.15.37:0/3317873125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809f960 0x7f969813a090 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d05b13ecd5ae5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.884+0000 7f9696ffd640 1 -- 172.21.15.37:0/3317873125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f968c009d90 con 0x7f969809f960 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.884+0000 7f9696ffd640 1 -- 172.21.15.37:0/3317873125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f968c00e230 con 0x7f969809f960 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.884+0000 7f9696ffd640 1 -- 172.21.15.37:0/3317873125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f968c00e4d0 con 0x7f969809f960 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 1 -- 172.21.15.37:0/3317873125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809f960 msgr2=0x7f969813a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 1 --2- 172.21.15.37:0/3317873125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809f960 0x7f969813a090 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 1 -- 172.21.15.37:0/3317873125 shutdown_connections 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 1 --2- 172.21.15.37:0/3317873125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809f960 0x7f969813a090 unknown :-1 s=CLOSED pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 1 -- 172.21.15.37:0/3317873125 >> 172.21.15.37:0/3317873125 conn(0x7f96980a3be0 msgr2=0x7f96980a3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 1 -- 172.21.15.37:0/3317873125 shutdown_connections 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 1 -- 172.21.15.37:0/3317873125 wait complete. 2024-04-23T01:58:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.885+0000 7f969e35d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:18.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.887+0000 7f969e35d640 1 Processor -- start 2024-04-23T01:58:18.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.887+0000 7f969e35d640 1 -- start start 2024-04-23T01:58:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.889+0000 7f969e35d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809ee40 0x7f969811e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.889+0000 7f969e35d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9698120660 con 0x7f969809ee40 2024-04-23T01:58:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.889+0000 7f9697fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809ee40 0x7f969811e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.889+0000 7f9697fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809ee40 0x7f969811e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46340/0 (socket says 172.21.15.37:46340) 2024-04-23T01:58:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.889+0000 7f9697fff640 1 -- 172.21.15.37:0/657577126 learned_addr learned my addr 172.21.15.37:0/657577126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.889+0000 7f9697fff640 1 -- 172.21.15.37:0/657577126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9698122110 con 0x7f969809ee40 2024-04-23T01:58:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.889+0000 7f9697fff640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809ee40 0x7f969811e100 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.890+0000 7f9694ff9640 1 -- 172.21.15.37:0/657577126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9688004b80 con 0x7f969809ee40 2024-04-23T01:58:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.890+0000 7f9694ff9640 1 -- 172.21.15.37:0/657577126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9688004ce0 con 0x7f969809ee40 2024-04-23T01:58:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.890+0000 7f9694ff9640 1 -- 172.21.15.37:0/657577126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9688007120 con 0x7f969809ee40 2024-04-23T01:58:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.890+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969811f290 con 0x7f969809ee40 2024-04-23T01:58:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.890+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9698120de0 con 0x7f969809ee40 2024-04-23T01:58:18.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.891+0000 7f9694ff9640 1 -- 172.21.15.37:0/657577126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9688007320 con 0x7f969809ee40 2024-04-23T01:58:18.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.891+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969811f4e0 con 0x7f969809ee40 2024-04-23T01:58:18.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.891+0000 7f9694ff9640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9684038930 0x7f968403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:18.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.891+0000 7f9694ff9640 1 -- 172.21.15.37:0/657577126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f96880486b0 con 0x7f969809ee40 2024-04-23T01:58:18.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.891+0000 7f96977fe640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9684038930 0x7f968403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:18.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.892+0000 7f96977fe640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9684038930 0x7f968403ae40 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:18.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:18.896+0000 7f9694ff9640 1 -- 172.21.15.37:0/657577126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f968800a9e0 con 0x7f969809ee40 2024-04-23T01:58:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.084+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f96980a0090 con 0x7f9684038930 2024-04-23T01:58:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.085+0000 7f9694ff9640 1 -- 172.21.15.37:0/657577126 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f968c00e3a0 con 0x7f9684038930 2024-04-23T01:58:19.087 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9684038930 msgr2=0x7f968403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9684038930 0x7f968403ae40 crc :-1 s=READY pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809ee40 msgr2=0x7f969811e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809ee40 0x7f969811e100 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 shutdown_connections 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9684038930 0x7f968403ae40 unknown :-1 s=CLOSED pgs=3863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 --2- 172.21.15.37:0/657577126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f969809ee40 0x7f969811e100 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 >> 172.21.15.37:0/657577126 conn(0x7f96980a3be0 msgr2=0x7f96981bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 shutdown_connections 2024-04-23T01:58:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.087+0000 7f969e35d640 1 -- 172.21.15.37:0/657577126 wait complete. 2024-04-23T01:58:19.106 INFO:tasks.ceph:Scrubbing osd.1 2024-04-23T01:58:19.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-23T01:58:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.213+0000 7f963542d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.223+0000 7f963542d640 1 Processor -- start 2024-04-23T01:58:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.223+0000 7f963542d640 1 -- start start 2024-04-23T01:58:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.224+0000 7f963542d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9630135050 0x7f9630135460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.224+0000 7f963542d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96300a0ea0 con 0x7f963009ee40 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.224+0000 7f963542d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f963006f170 con 0x7f9630135050 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.224+0000 7f962effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9630135050 0x7f9630135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.224+0000 7f962effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9630135050 0x7f9630135460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46352/0 (socket says 172.21.15.37:46352) 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.224+0000 7f962effd640 1 -- 172.21.15.37:0/1709059134 learned_addr learned my addr 172.21.15.37:0/1709059134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.224+0000 7f962e7fc640 1 --1- 172.21.15.37:0/1709059134 >> v1:172.21.15.37:6789/0 conn(0x7f963009ee40 0x7f963009f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40286/0 (socket says 172.21.15.37:40286) 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.225+0000 7f962effd640 1 -- 172.21.15.37:0/1709059134 >> v1:172.21.15.37:6789/0 conn(0x7f963009ee40 legacy=0x7f963009f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.225+0000 7f962effd640 1 -- 172.21.15.37:0/1709059134 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9630134c00 con 0x7f9630135050 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.225+0000 7f962dffb640 1 -- 172.21.15.37:0/1709059134 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571482819 0 0) 0x7f96300a0ea0 con 0x7f963009ee40 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.225+0000 7f962effd640 1 --2- 172.21.15.37:0/1709059134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9630135050 0x7f9630135460 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8c22e6ec5f0c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.225+0000 7f962dffb640 1 -- 172.21.15.37:0/1709059134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f962000e040 con 0x7f9630135050 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.225+0000 7f962dffb640 1 -- 172.21.15.37:0/1709059134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f96200091e0 con 0x7f9630135050 2024-04-23T01:58:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.225+0000 7f962dffb640 1 -- 172.21.15.37:0/1709059134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9620007730 con 0x7f9630135050 2024-04-23T01:58:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 1 -- 172.21.15.37:0/1709059134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9630135050 msgr2=0x7f9630135460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 1 --2- 172.21.15.37:0/1709059134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9630135050 0x7f9630135460 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 1 -- 172.21.15.37:0/1709059134 shutdown_connections 2024-04-23T01:58:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 1 --2- 172.21.15.37:0/1709059134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9630135050 0x7f9630135460 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 1 -- 172.21.15.37:0/1709059134 >> 172.21.15.37:0/1709059134 conn(0x7f96300a4eb0 msgr2=0x7f96300a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 1 -- 172.21.15.37:0/1709059134 shutdown_connections 2024-04-23T01:58:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 1 -- 172.21.15.37:0/1709059134 wait complete. 2024-04-23T01:58:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.226+0000 7f963542d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.228+0000 7f963542d640 1 Processor -- start 2024-04-23T01:58:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.228+0000 7f963542d640 1 -- start start 2024-04-23T01:58:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.230+0000 7f963542d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963009ee40 0x7f963011e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.230+0000 7f963542d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96301207b0 con 0x7f963009ee40 2024-04-23T01:58:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.230+0000 7f962effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963009ee40 0x7f963011e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.230+0000 7f962effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963009ee40 0x7f963011e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46368/0 (socket says 172.21.15.37:46368) 2024-04-23T01:58:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.230+0000 7f962effd640 1 -- 172.21.15.37:0/2011060479 learned_addr learned my addr 172.21.15.37:0/2011060479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.231+0000 7f962effd640 1 -- 172.21.15.37:0/2011060479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96301222a0 con 0x7f963009ee40 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.231+0000 7f962effd640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963009ee40 0x7f963011e370 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.231+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f962000e040 con 0x7f963009ee40 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.231+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f96200118d0 con 0x7f963009ee40 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.231+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9630121760 con 0x7f963009ee40 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.231+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9620011b70 con 0x7f963009ee40 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.231+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9630121490 con 0x7f963009ee40 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.232+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96300736e0 con 0x7f963009ee40 2024-04-23T01:58:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.232+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9620011d20 con 0x7f963009ee40 2024-04-23T01:58:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.232+0000 7f96277fe640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9610038980 0x7f961003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.232+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f9620049a50 con 0x7f963009ee40 2024-04-23T01:58:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.232+0000 7f96277fe640 1 --2- 172.21.15.37:0/2011060479 >> v2:172.21.15.37:6805/1977556410 conn(0x7f961003ea40 0x7f9610040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.232+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 --> v2:172.21.15.37:6805/1977556410 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96100415c0 con 0x7f961003ea40 2024-04-23T01:58:19.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.232+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=718) ==== 24+0+0 (crc 0 0 0) 0x7f9620049de0 con 0x7f963009ee40 2024-04-23T01:58:19.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.233+0000 7f962e7fc640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9610038980 0x7f961003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.233+0000 7f962e7fc640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9610038980 0x7f961003ae90 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.233+0000 7f962f7fe640 1 --2- 172.21.15.37:0/2011060479 >> v2:172.21.15.37:6805/1977556410 conn(0x7f961003ea40 0x7f9610040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:58:19.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.237+0000 7f962f7fe640 1 --2- 172.21.15.37:0/2011060479 >> v2:172.21.15.37:6805/1977556410 conn(0x7f961003ea40 0x7f9610040f30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.238+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== osd.1 v2:172.21.15.37:6805/1977556410 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f96100415c0 con 0x7f961003ea40 2024-04-23T01:58:19.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.241+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 --> v2:172.21.15.37:6805/1977556410 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f96301359a0 con 0x7f961003ea40 2024-04-23T01:58:19.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.243+0000 7f96277fe640 1 -- 172.21.15.37:0/2011060479 <== osd.1 v2:172.21.15.37:6805/1977556410 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f9628009830 con 0x7f961003ea40 2024-04-23T01:58:19.245 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-23T01:58:19.245 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-04-23T01:58:19.245 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.243+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 >> v2:172.21.15.37:6805/1977556410 conn(0x7f961003ea40 msgr2=0x7f9610040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.243+0000 7f963542d640 1 --2- 172.21.15.37:0/2011060479 >> v2:172.21.15.37:6805/1977556410 conn(0x7f961003ea40 0x7f9610040f30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.243+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9610038980 msgr2=0x7f961003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.243+0000 7f963542d640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9610038980 0x7f961003ae90 crc :-1 s=READY pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.243+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963009ee40 msgr2=0x7f963011e370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.243+0000 7f963542d640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963009ee40 0x7f963011e370 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.244+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 shutdown_connections 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.244+0000 7f963542d640 1 --2- 172.21.15.37:0/2011060479 >> v2:172.21.15.37:6805/1977556410 conn(0x7f961003ea40 0x7f9610040f30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.244+0000 7f963542d640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9610038980 0x7f961003ae90 unknown :-1 s=CLOSED pgs=3864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.244+0000 7f963542d640 1 --2- 172.21.15.37:0/2011060479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963009ee40 0x7f963011e370 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.244+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 >> 172.21.15.37:0/2011060479 conn(0x7f96300a4eb0 msgr2=0x7f96301bcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.244+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 shutdown_connections 2024-04-23T01:58:19.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.244+0000 7f963542d640 1 -- 172.21.15.37:0/2011060479 wait complete. 2024-04-23T01:58:19.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-23T01:58:19.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.361+0000 7f981a224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.368+0000 7f981a224640 1 Processor -- start 2024-04-23T01:58:19.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.368+0000 7f981a224640 1 -- start start 2024-04-23T01:58:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.369+0000 7f981a224640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f981406ec40 0x7f981413a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.369+0000 7f981a224640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98141321e0 con 0x7f98140a11e0 2024-04-23T01:58:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.369+0000 7f981a224640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f98140a0d90 con 0x7f981406ec40 2024-04-23T01:58:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.369+0000 7f9812ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f981406ec40 0x7f981413a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.369+0000 7f98137fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98140a11e0 0x7f981409fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40302/0 (socket says 172.21.15.37:40302) 2024-04-23T01:58:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.369+0000 7f98137fe640 1 -- 172.21.15.37:0/4072406582 learned_addr learned my addr 172.21.15.37:0/4072406582 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.370+0000 7f9812ffd640 1 -- 172.21.15.37:0/4072406582 >> v1:172.21.15.37:6789/0 conn(0x7f98140a11e0 legacy=0x7f981409fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.370+0000 7f9812ffd640 1 -- 172.21.15.37:0/4072406582 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981406f050 con 0x7f981406ec40 2024-04-23T01:58:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.370+0000 7f98127fc640 1 -- 172.21.15.37:0/4072406582 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1513752026 0 0) 0x7f98141321e0 con 0x7f98140a11e0 2024-04-23T01:58:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.370+0000 7f9812ffd640 1 --2- 172.21.15.37:0/4072406582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981413a140 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07de865d254d63f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.370+0000 7f98127fc640 1 -- 172.21.15.37:0/4072406582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9808009d90 con 0x7f981406ec40 2024-04-23T01:58:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.370+0000 7f98127fc640 1 -- 172.21.15.37:0/4072406582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f980800e230 con 0x7f981406ec40 2024-04-23T01:58:19.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.370+0000 7f98127fc640 1 -- 172.21.15.37:0/4072406582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f980800e4d0 con 0x7f981406ec40 2024-04-23T01:58:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 1 -- 172.21.15.37:0/4072406582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 msgr2=0x7f981413a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 1 --2- 172.21.15.37:0/4072406582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981413a140 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 1 -- 172.21.15.37:0/4072406582 shutdown_connections 2024-04-23T01:58:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 1 --2- 172.21.15.37:0/4072406582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981413a140 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 1 -- 172.21.15.37:0/4072406582 >> 172.21.15.37:0/4072406582 conn(0x7f98140a5050 msgr2=0x7f98140a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 1 -- 172.21.15.37:0/4072406582 shutdown_connections 2024-04-23T01:58:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 1 -- 172.21.15.37:0/4072406582 wait complete. 2024-04-23T01:58:19.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.371+0000 7f981a224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.373+0000 7f981a224640 1 Processor -- start 2024-04-23T01:58:19.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.373+0000 7f981a224640 1 -- start start 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f981a224640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981412e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f981a224640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9814072050 con 0x7f981406ec40 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f98137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981412e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f98137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981412e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46372/0 (socket says 172.21.15.37:46372) 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f98137fe640 1 -- 172.21.15.37:0/2602850576 learned_addr learned my addr 172.21.15.37:0/2602850576 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f98137fe640 1 -- 172.21.15.37:0/2602850576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981412f4b0 con 0x7f981406ec40 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f98137fe640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981412e370 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f97fbfff640 1 -- 172.21.15.37:0/2602850576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9804005a60 con 0x7f981406ec40 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f97fbfff640 1 -- 172.21.15.37:0/2602850576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9804005bc0 con 0x7f981406ec40 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981412f160 con 0x7f981406ec40 2024-04-23T01:58:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f97fbfff640 1 -- 172.21.15.37:0/2602850576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9804005e60 con 0x7f981406ec40 2024-04-23T01:58:19.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.375+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981411da90 con 0x7f981406ec40 2024-04-23T01:58:19.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.376+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98140716c0 con 0x7f981406ec40 2024-04-23T01:58:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.376+0000 7f97fbfff640 1 -- 172.21.15.37:0/2602850576 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f980400c770 con 0x7f981406ec40 2024-04-23T01:58:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.377+0000 7f97fbfff640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9800038980 0x7f980003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.377+0000 7f97fbfff640 1 -- 172.21.15.37:0/2602850576 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f98040483c0 con 0x7f981406ec40 2024-04-23T01:58:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.377+0000 7f9812ffd640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9800038980 0x7f980003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.377+0000 7f9812ffd640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9800038980 0x7f980003ae90 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.382+0000 7f97fbfff640 1 -- 172.21.15.37:0/2602850576 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f980400d330 con 0x7f981406ec40 2024-04-23T01:58:19.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.567+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f981406f360 con 0x7f9800038980 2024-04-23T01:58:19.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.568+0000 7f97fbfff640 1 -- 172.21.15.37:0/2602850576 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f9808009e00 con 0x7f9800038980 2024-04-23T01:58:19.570 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2024-04-23T01:58:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9800038980 msgr2=0x7f980003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9800038980 0x7f980003ae90 crc :-1 s=READY pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 msgr2=0x7f981412e370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981412e370 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 shutdown_connections 2024-04-23T01:58:19.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9800038980 0x7f980003ae90 unknown :-1 s=CLOSED pgs=3865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 --2- 172.21.15.37:0/2602850576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f981406ec40 0x7f981412e370 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 >> 172.21.15.37:0/2602850576 conn(0x7f98140a5050 msgr2=0x7f98140a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 shutdown_connections 2024-04-23T01:58:19.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.570+0000 7f981a224640 1 -- 172.21.15.37:0/2602850576 wait complete. 2024-04-23T01:58:19.589 INFO:tasks.ceph:Scrubbing osd.2 2024-04-23T01:58:19.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-23T01:58:19.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.696+0000 7f811cb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.706+0000 7f811cb9d640 1 Processor -- start 2024-04-23T01:58:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.706+0000 7f811cb9d640 1 -- start start 2024-04-23T01:58:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.707+0000 7f811cb9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8118135cd0 0x7f81181380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.707+0000 7f811cb9d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81180713e0 con 0x7f8118132d80 2024-04-23T01:58:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.707+0000 7f811cb9d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8118073970 con 0x7f8118135cd0 2024-04-23T01:58:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.707+0000 7f8115d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8118135cd0 0x7f81181380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f811659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8118132d80 0x7f8118133190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37862/0 (socket says 172.21.15.37:37862) 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f8115d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8118135cd0 0x7f81181380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51062/0 (socket says 172.21.15.37:51062) 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f811659c640 1 -- 172.21.15.37:0/1256185251 learned_addr learned my addr 172.21.15.37:0/1256185251 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f8115d9b640 1 -- 172.21.15.37:0/1256185251 >> v1:172.21.15.37:6789/0 conn(0x7f8118132d80 legacy=0x7f8118133190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f811559a640 1 -- 172.21.15.37:0/1256185251 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543925113 0 0) 0x7f81180713e0 con 0x7f8118132d80 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f8115d9b640 1 -- 172.21.15.37:0/1256185251 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81181329c0 con 0x7f8118135cd0 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f8115d9b640 1 --2- 172.21.15.37:0/1256185251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118135cd0 0x7f81181380f0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d788ef33609882 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f811559a640 1 -- 172.21.15.37:0/1256185251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8100009d90 con 0x7f8118135cd0 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f811559a640 1 -- 172.21.15.37:0/1256185251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f810000e230 con 0x7f8118135cd0 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.708+0000 7f811559a640 1 -- 172.21.15.37:0/1256185251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f810000e4d0 con 0x7f8118135cd0 2024-04-23T01:58:19.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 1 -- 172.21.15.37:0/1256185251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118135cd0 msgr2=0x7f81181380f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 1 --2- 172.21.15.37:0/1256185251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118135cd0 0x7f81181380f0 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 1 -- 172.21.15.37:0/1256185251 shutdown_connections 2024-04-23T01:58:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 1 --2- 172.21.15.37:0/1256185251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118135cd0 0x7f81181380f0 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 1 -- 172.21.15.37:0/1256185251 >> 172.21.15.37:0/1256185251 conn(0x7f81180a17c0 msgr2=0x7f81180a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 1 -- 172.21.15.37:0/1256185251 shutdown_connections 2024-04-23T01:58:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 1 -- 172.21.15.37:0/1256185251 wait complete. 2024-04-23T01:58:19.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.709+0000 7f811cb9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.711+0000 7f811cb9d640 1 Processor -- start 2024-04-23T01:58:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.711+0000 7f811cb9d640 1 -- start start 2024-04-23T01:58:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f811cb9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118132d80 0x7f811811d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f811cb9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f811811f030 con 0x7f8118132d80 2024-04-23T01:58:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f811659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118132d80 0x7f811811d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f811659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118132d80 0x7f811811d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51072/0 (socket says 172.21.15.37:51072) 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f811659c640 1 -- 172.21.15.37:0/688086300 learned_addr learned my addr 172.21.15.37:0/688086300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f811659c640 1 -- 172.21.15.37:0/688086300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811811d290 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f811659c640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118132d80 0x7f811811d520 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8108004b80 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.713+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8108004ce0 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.714+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811811cef0 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.714+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8108007120 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.714+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811811fea0 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.714+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f81080072d0 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.715+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8118120c80 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.715+0000 7f810effd640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f80f8038980 0x7f80f803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.715+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f81080485f0 con 0x7f8118132d80 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.715+0000 7f810effd640 1 --2- 172.21.15.37:0/688086300 >> v2:172.21.15.191:6805/3894758024 conn(0x7f80f803ea40 0x7f80f8040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.715+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 --> v2:172.21.15.191:6805/3894758024 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80f80415c0 con 0x7f80f803ea40 2024-04-23T01:58:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.715+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=718) ==== 24+0+0 (crc 0 0 0) 0x7f810800f230 con 0x7f8118132d80 2024-04-23T01:58:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.715+0000 7f8115d9b640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f80f8038980 0x7f80f803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.716+0000 7f8115d9b640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f80f8038980 0x7f80f803ae90 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.716+0000 7f8116d9d640 1 --2- 172.21.15.37:0/688086300 >> v2:172.21.15.191:6805/3894758024 conn(0x7f80f803ea40 0x7f80f8040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:58:19.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.721+0000 7f8116d9d640 1 --2- 172.21.15.37:0/688086300 >> v2:172.21.15.191:6805/3894758024 conn(0x7f80f803ea40 0x7f80f8040f30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.722+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== osd.2 v2:172.21.15.191:6805/3894758024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f80f80415c0 con 0x7f80f803ea40 2024-04-23T01:58:19.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.725+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 --> v2:172.21.15.191:6805/3894758024 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8118072220 con 0x7f80f803ea40 2024-04-23T01:58:19.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.727+0000 7f810effd640 1 -- 172.21.15.37:0/688086300 <== osd.2 v2:172.21.15.191:6805/3894758024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f811000a820 con 0x7f80f803ea40 2024-04-23T01:58:19.730 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-23T01:58:19.730 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-04-23T01:58:19.730 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-23T01:58:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 >> v2:172.21.15.191:6805/3894758024 conn(0x7f80f803ea40 msgr2=0x7f80f8040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 --2- 172.21.15.37:0/688086300 >> v2:172.21.15.191:6805/3894758024 conn(0x7f80f803ea40 0x7f80f8040f30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f80f8038980 msgr2=0x7f80f803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f80f8038980 0x7f80f803ae90 crc :-1 s=READY pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118132d80 msgr2=0x7f811811d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118132d80 0x7f811811d520 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 shutdown_connections 2024-04-23T01:58:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 --2- 172.21.15.37:0/688086300 >> v2:172.21.15.191:6805/3894758024 conn(0x7f80f803ea40 0x7f80f8040f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f80f8038980 0x7f80f803ae90 unknown :-1 s=CLOSED pgs=3866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 --2- 172.21.15.37:0/688086300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8118132d80 0x7f811811d520 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 >> 172.21.15.37:0/688086300 conn(0x7f81180a17c0 msgr2=0x7f81181307c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 shutdown_connections 2024-04-23T01:58:19.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.728+0000 7f811cb9d640 1 -- 172.21.15.37:0/688086300 wait complete. 2024-04-23T01:58:19.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-23T01:58:19.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.845+0000 7f9a578ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.851+0000 7f9a578ad640 1 Processor -- start 2024-04-23T01:58:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.852+0000 7f9a578ad640 1 -- start start 2024-04-23T01:58:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.853+0000 7f9a578ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a500a01e0 0x7f9a50137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.853+0000 7f9a578ad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a50070d80 con 0x7f9a5009f6c0 2024-04-23T01:58:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.853+0000 7f9a578ad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9a500717b0 con 0x7f9a500a01e0 2024-04-23T01:58:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.853+0000 7f9a55649640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9a5009f6c0 0x7f9a5009fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37872/0 (socket says 172.21.15.37:37872) 2024-04-23T01:58:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.853+0000 7f9a55649640 1 -- 172.21.15.37:0/2942451946 learned_addr learned my addr 172.21.15.37:0/2942451946 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.853+0000 7f9a54e48640 1 --2- 172.21.15.37:0/2942451946 >> v2:172.21.15.37:3300/0 conn(0x7f9a500a01e0 0x7f9a50137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.854+0000 7f9a54e48640 1 -- 172.21.15.37:0/2942451946 >> v1:172.21.15.37:6789/0 conn(0x7f9a5009f6c0 legacy=0x7f9a5009fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.854+0000 7f9a54e48640 1 -- 172.21.15.37:0/2942451946 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a50072330 con 0x7f9a500a01e0 2024-04-23T01:58:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.854+0000 7f9a54e48640 1 --2- 172.21.15.37:0/2942451946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a500a01e0 0x7f9a50137c40 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e63805593a6cf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.854+0000 7f9a4ffff640 1 -- 172.21.15.37:0/2942451946 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a44009d90 con 0x7f9a500a01e0 2024-04-23T01:58:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.854+0000 7f9a4ffff640 1 -- 172.21.15.37:0/2942451946 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a4400e230 con 0x7f9a500a01e0 2024-04-23T01:58:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.854+0000 7f9a4ffff640 1 -- 172.21.15.37:0/2942451946 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a4400e4d0 con 0x7f9a500a01e0 2024-04-23T01:58:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.855+0000 7f9a578ad640 1 -- 172.21.15.37:0/2942451946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a500a01e0 msgr2=0x7f9a50137c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.855+0000 7f9a578ad640 1 --2- 172.21.15.37:0/2942451946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a500a01e0 0x7f9a50137c40 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.855+0000 7f9a578ad640 1 -- 172.21.15.37:0/2942451946 shutdown_connections 2024-04-23T01:58:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.855+0000 7f9a578ad640 1 --2- 172.21.15.37:0/2942451946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a500a01e0 0x7f9a50137c40 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.855+0000 7f9a578ad640 1 -- 172.21.15.37:0/2942451946 >> 172.21.15.37:0/2942451946 conn(0x7f9a500a1960 msgr2=0x7f9a500a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.855+0000 7f9a578ad640 1 -- 172.21.15.37:0/2942451946 shutdown_connections 2024-04-23T01:58:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.855+0000 7f9a578ad640 1 -- 172.21.15.37:0/2942451946 wait complete. 2024-04-23T01:58:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.856+0000 7f9a578ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.857+0000 7f9a578ad640 1 Processor -- start 2024-04-23T01:58:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.857+0000 7f9a578ad640 1 -- start start 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.859+0000 7f9a578ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a5009f6c0 0x7f9a5011be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.859+0000 7f9a578ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5011f280 con 0x7f9a5009f6c0 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.859+0000 7f9a55649640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a5009f6c0 0x7f9a5011be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.859+0000 7f9a55649640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a5009f6c0 0x7f9a5011be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51096/0 (socket says 172.21.15.37:51096) 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.859+0000 7f9a55649640 1 -- 172.21.15.37:0/1312214209 learned_addr learned my addr 172.21.15.37:0/1312214209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.859+0000 7f9a55649640 1 -- 172.21.15.37:0/1312214209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a50076860 con 0x7f9a5009f6c0 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.859+0000 7f9a55649640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a5009f6c0 0x7f9a5011be00 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.860+0000 7f9a4dffb640 1 -- 172.21.15.37:0/1312214209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a48005a60 con 0x7f9a5009f6c0 2024-04-23T01:58:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.860+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5011ef90 con 0x7f9a5009f6c0 2024-04-23T01:58:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.860+0000 7f9a4dffb640 1 -- 172.21.15.37:0/1312214209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9a48005bc0 con 0x7f9a5009f6c0 2024-04-23T01:58:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.860+0000 7f9a4dffb640 1 -- 172.21.15.37:0/1312214209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9a48005e60 con 0x7f9a5009f6c0 2024-04-23T01:58:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.860+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a501302f0 con 0x7f9a5009f6c0 2024-04-23T01:58:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.861+0000 7f9a4dffb640 1 -- 172.21.15.37:0/1312214209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f9a4800c780 con 0x7f9a5009f6c0 2024-04-23T01:58:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.861+0000 7f9a4dffb640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9a3c038980 0x7f9a3c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.861+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a500692b0 con 0x7f9a5009f6c0 2024-04-23T01:58:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.861+0000 7f9a4dffb640 1 -- 172.21.15.37:0/1312214209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f9a48048340 con 0x7f9a5009f6c0 2024-04-23T01:58:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.861+0000 7f9a54e48640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9a3c038980 0x7f9a3c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:19.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.862+0000 7f9a54e48640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9a3c038980 0x7f9a3c03ae90 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:19.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:19.866+0000 7f9a4dffb640 1 -- 172.21.15.37:0/1312214209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f9a480070b0 con 0x7f9a5009f6c0 2024-04-23T01:58:20.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.063+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9a50076860 con 0x7f9a3c038980 2024-04-23T01:58:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.064+0000 7f9a4dffb640 1 -- 172.21.15.37:0/1312214209 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f9a50076860 con 0x7f9a3c038980 2024-04-23T01:58:20.066 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9a3c038980 msgr2=0x7f9a3c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9a3c038980 0x7f9a3c03ae90 crc :-1 s=READY pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a5009f6c0 msgr2=0x7f9a5011be00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a5009f6c0 0x7f9a5011be00 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 shutdown_connections 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f9a3c038980 0x7f9a3c03ae90 unknown :-1 s=CLOSED pgs=3867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 --2- 172.21.15.37:0/1312214209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a5009f6c0 0x7f9a5011be00 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 >> 172.21.15.37:0/1312214209 conn(0x7f9a500a1960 msgr2=0x7f9a501bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 shutdown_connections 2024-04-23T01:58:20.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.067+0000 7f9a578ad640 1 -- 172.21.15.37:0/1312214209 wait complete. 2024-04-23T01:58:20.084 INFO:tasks.ceph:Scrubbing osd.3 2024-04-23T01:58:20.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-23T01:58:20.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.192+0000 7f128c31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.204+0000 7f128c31d640 1 Processor -- start 2024-04-23T01:58:20.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.204+0000 7f128c31d640 1 -- start start 2024-04-23T01:58:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.205+0000 7f128c31d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1284135760 0x7f128413a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.205+0000 7f128c31d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128406e820 con 0x7f1284134c40 2024-04-23T01:58:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.205+0000 7f128c31d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f128406d870 con 0x7f1284135760 2024-04-23T01:58:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.205+0000 7f12898b8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1284135760 0x7f128413a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.205+0000 7f128a0b9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1284134c40 0x7f1284135050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37876/0 (socket says 172.21.15.37:37876) 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.205+0000 7f12898b8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1284135760 0x7f128413a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51112/0 (socket says 172.21.15.37:51112) 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.205+0000 7f128a0b9640 1 -- 172.21.15.37:0/1498756441 learned_addr learned my addr 172.21.15.37:0/1498756441 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.206+0000 7f12898b8640 1 -- 172.21.15.37:0/1498756441 >> v1:172.21.15.37:6789/0 conn(0x7f1284134c40 legacy=0x7f1284135050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.206+0000 7f12898b8640 1 -- 172.21.15.37:0/1498756441 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128406f440 con 0x7f1284135760 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.206+0000 7f12898b8640 1 --2- 172.21.15.37:0/1498756441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284135760 0x7f128413a170 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1302e58f7a4f1f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.206+0000 7f12890b7640 1 -- 172.21.15.37:0/1498756441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1274009d90 con 0x7f1284135760 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.206+0000 7f12890b7640 1 -- 172.21.15.37:0/1498756441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f127400e230 con 0x7f1284135760 2024-04-23T01:58:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.206+0000 7f12890b7640 1 -- 172.21.15.37:0/1498756441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f127400e4d0 con 0x7f1284135760 2024-04-23T01:58:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 1 -- 172.21.15.37:0/1498756441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284135760 msgr2=0x7f128413a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 1 --2- 172.21.15.37:0/1498756441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284135760 0x7f128413a170 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 1 -- 172.21.15.37:0/1498756441 shutdown_connections 2024-04-23T01:58:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 1 --2- 172.21.15.37:0/1498756441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284135760 0x7f128413a170 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 1 -- 172.21.15.37:0/1498756441 >> 172.21.15.37:0/1498756441 conn(0x7f12840a5da0 msgr2=0x7f12840a61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 1 -- 172.21.15.37:0/1498756441 shutdown_connections 2024-04-23T01:58:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 1 -- 172.21.15.37:0/1498756441 wait complete. 2024-04-23T01:58:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.208+0000 7f128c31d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.210+0000 7f128c31d640 1 Processor -- start 2024-04-23T01:58:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.210+0000 7f128c31d640 1 -- start start 2024-04-23T01:58:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.212+0000 7f128c31d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284134c40 0x7f12841c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.212+0000 7f128c31d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1284121170 con 0x7f1284134c40 2024-04-23T01:58:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.212+0000 7f128a0b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284134c40 0x7f12841c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.212+0000 7f128a0b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284134c40 0x7f12841c63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51122/0 (socket says 172.21.15.37:51122) 2024-04-23T01:58:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.212+0000 7f128a0b9640 1 -- 172.21.15.37:0/2490235944 learned_addr learned my addr 172.21.15.37:0/2490235944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.213+0000 7f128a0b9640 1 -- 172.21.15.37:0/2490235944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1284074f80 con 0x7f1284134c40 2024-04-23T01:58:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.213+0000 7f128a0b9640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284134c40 0x7f12841c63e0 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.213+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1280005a60 con 0x7f1284134c40 2024-04-23T01:58:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.213+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12841c6080 con 0x7f1284134c40 2024-04-23T01:58:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.213+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1280005bc0 con 0x7f1284134c40 2024-04-23T01:58:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.213+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1280005e60 con 0x7f1284134c40 2024-04-23T01:58:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.213+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128411fd10 con 0x7f1284134c40 2024-04-23T01:58:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.214+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12840a6b20 con 0x7f1284134c40 2024-04-23T01:58:20.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.214+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f128000c780 con 0x7f1284134c40 2024-04-23T01:58:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.214+0000 7f127affd640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1268038930 0x7f126803ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.214+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f1280048310 con 0x7f1284134c40 2024-04-23T01:58:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.215+0000 7f127affd640 1 --2- 172.21.15.37:0/2490235944 >> v2:172.21.15.191:6808/1018833307 conn(0x7f126803ea50 0x7f1268040f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.215+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 --> v2:172.21.15.191:6808/1018833307 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12680415d0 con 0x7f126803ea50 2024-04-23T01:58:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.215+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=718) ==== 24+0+0 (crc 0 0 0) 0x7f128004a880 con 0x7f1284134c40 2024-04-23T01:58:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.215+0000 7f12898b8640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1268038930 0x7f126803ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.215+0000 7f12898b8640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1268038930 0x7f126803ae40 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.218+0000 7f128a8ba640 1 --2- 172.21.15.37:0/2490235944 >> v2:172.21.15.191:6808/1018833307 conn(0x7f126803ea50 0x7f1268040f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-23T01:58:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.233+0000 7f128a8ba640 1 --2- 172.21.15.37:0/2490235944 >> v2:172.21.15.191:6808/1018833307 conn(0x7f126803ea50 0x7f1268040f40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.234+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== osd.3 v2:172.21.15.191:6808/1018833307 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f12680415d0 con 0x7f126803ea50 2024-04-23T01:58:20.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.238+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 --> v2:172.21.15.191:6808/1018833307 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1284074f80 con 0x7f126803ea50 2024-04-23T01:58:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f127affd640 1 -- 172.21.15.37:0/2490235944 <== osd.3 v2:172.21.15.191:6808/1018833307 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f1284074f80 con 0x7f126803ea50 2024-04-23T01:58:20.242 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-23T01:58:20.242 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "" 2024-04-23T01:58:20.242 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-23T01:58:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 >> v2:172.21.15.191:6808/1018833307 conn(0x7f126803ea50 msgr2=0x7f1268040f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 --2- 172.21.15.37:0/2490235944 >> v2:172.21.15.191:6808/1018833307 conn(0x7f126803ea50 0x7f1268040f40 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1268038930 msgr2=0x7f126803ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1268038930 0x7f126803ae40 crc :-1 s=READY pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284134c40 msgr2=0x7f12841c63e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284134c40 0x7f12841c63e0 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 shutdown_connections 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 --2- 172.21.15.37:0/2490235944 >> v2:172.21.15.191:6808/1018833307 conn(0x7f126803ea50 0x7f1268040f40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f1268038930 0x7f126803ae40 unknown :-1 s=CLOSED pgs=3868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 --2- 172.21.15.37:0/2490235944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1284134c40 0x7f12841c63e0 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 >> 172.21.15.37:0/2490235944 conn(0x7f12840a5da0 msgr2=0x7f12841bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 shutdown_connections 2024-04-23T01:58:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.240+0000 7f128c31d640 1 -- 172.21.15.37:0/2490235944 wait complete. 2024-04-23T01:58:20.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-23T01:58:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.358+0000 7fc725314640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:20.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.365+0000 7fc725314640 1 Processor -- start 2024-04-23T01:58:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.365+0000 7fc725314640 1 -- start start 2024-04-23T01:58:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.366+0000 7fc725314640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc72006ec40 0x7fc72013a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.366+0000 7fc725314640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7201321e0 con 0x7fc7200a11e0 2024-04-23T01:58:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.366+0000 7fc725314640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fc7200a0d90 con 0x7fc72006ec40 2024-04-23T01:58:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.366+0000 7fc71effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7200a11e0 0x7fc72009fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37878/0 (socket says 172.21.15.37:37878) 2024-04-23T01:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.366+0000 7fc7167fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc72006ec40 0x7fc72013a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.366+0000 7fc71effd640 1 -- 172.21.15.37:0/3872218838 learned_addr learned my addr 172.21.15.37:0/3872218838 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:20.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.367+0000 7fc7167fc640 1 -- 172.21.15.37:0/3872218838 >> v1:172.21.15.37:6789/0 conn(0x7fc7200a11e0 legacy=0x7fc72009fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.367+0000 7fc7167fc640 1 -- 172.21.15.37:0/3872218838 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72006f050 con 0x7fc72006ec40 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.367+0000 7fc7167fc640 1 --2- 172.21.15.37:0/3872218838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc72013a140 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a02a0303ce703b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.367+0000 7fc71e7fc640 1 -- 172.21.15.37:0/3872218838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc708009d90 con 0x7fc72006ec40 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.367+0000 7fc71e7fc640 1 -- 172.21.15.37:0/3872218838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc70800e230 con 0x7fc72006ec40 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.367+0000 7fc71e7fc640 1 -- 172.21.15.37:0/3872218838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc70800e4d0 con 0x7fc72006ec40 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 1 -- 172.21.15.37:0/3872218838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 msgr2=0x7fc72013a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 1 --2- 172.21.15.37:0/3872218838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc72013a140 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 1 -- 172.21.15.37:0/3872218838 shutdown_connections 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 1 --2- 172.21.15.37:0/3872218838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc72013a140 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 1 -- 172.21.15.37:0/3872218838 >> 172.21.15.37:0/3872218838 conn(0x7fc7200a5050 msgr2=0x7fc7200a5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 1 -- 172.21.15.37:0/3872218838 shutdown_connections 2024-04-23T01:58:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 1 -- 172.21.15.37:0/3872218838 wait complete. 2024-04-23T01:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.368+0000 7fc725314640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.370+0000 7fc725314640 1 Processor -- start 2024-04-23T01:58:20.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.370+0000 7fc725314640 1 -- start start 2024-04-23T01:58:20.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.371+0000 7fc725314640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc7201c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.371+0000 7fc725314640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc7200700a0 con 0x7fc72006ec40 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc71effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc7201c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc71effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc7201c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51138/0 (socket says 172.21.15.37:51138) 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc71effd640 1 -- 172.21.15.37:0/4262994417 learned_addr learned my addr 172.21.15.37:0/4262994417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc71effd640 1 -- 172.21.15.37:0/4262994417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc720072170 con 0x7fc72006ec40 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc71effd640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc7201c98a0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc717fff640 1 -- 172.21.15.37:0/4262994417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc710005a60 con 0x7fc72006ec40 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc717fff640 1 -- 172.21.15.37:0/4262994417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc710005bc0 con 0x7fc72006ec40 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc720072490 con 0x7fc72006ec40 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.372+0000 7fc717fff640 1 -- 172.21.15.37:0/4262994417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc710005e60 con 0x7fc72006ec40 2024-04-23T01:58:20.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.373+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72006fd00 con 0x7fc72006ec40 2024-04-23T01:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.373+0000 7fc717fff640 1 -- 172.21.15.37:0/4262994417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc7100070b0 con 0x7fc72006ec40 2024-04-23T01:58:20.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.373+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc72006f330 con 0x7fc72006ec40 2024-04-23T01:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.373+0000 7fc717fff640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc7000389d0 0x7fc70003aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.374+0000 7fc717fff640 1 -- 172.21.15.37:0/4262994417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7fc710048420 con 0x7fc72006ec40 2024-04-23T01:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.374+0000 7fc7167fc640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc7000389d0 0x7fc70003aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.374+0000 7fc7167fc640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc7000389d0 0x7fc70003aee0 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.379+0000 7fc717fff640 1 -- 172.21.15.37:0/4262994417 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc71000d7f0 con 0x7fc72006ec40 2024-04-23T01:58:20.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.567+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc72006fef0 con 0x7fc7000389d0 2024-04-23T01:58:20.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.568+0000 7fc717fff640 1 -- 172.21.15.37:0/4262994417 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fc72006fef0 con 0x7fc7000389d0 2024-04-23T01:58:20.570 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2024-04-23T01:58:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.569+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc7000389d0 msgr2=0x7fc70003aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.569+0000 7fc725314640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc7000389d0 0x7fc70003aee0 crc :-1 s=READY pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.569+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 msgr2=0x7fc7201c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.569+0000 7fc725314640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc7201c98a0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.570+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 shutdown_connections 2024-04-23T01:58:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.570+0000 7fc725314640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7fc7000389d0 0x7fc70003aee0 unknown :-1 s=CLOSED pgs=3869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.570+0000 7fc725314640 1 --2- 172.21.15.37:0/4262994417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72006ec40 0x7fc7201c98a0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.570+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 >> 172.21.15.37:0/4262994417 conn(0x7fc7200a5050 msgr2=0x7fc7200a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:20.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.570+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 shutdown_connections 2024-04-23T01:58:20.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.570+0000 7fc725314640 1 -- 172.21.15.37:0/4262994417 wait complete. 2024-04-23T01:58:20.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T01:58:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.693+0000 7f0d9fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.698+0000 7f0d9fd9d640 1 Processor -- start 2024-04-23T01:58:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.698+0000 7f0d9fd9d640 1 -- start start 2024-04-23T01:58:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.699+0000 7f0d9fd9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d980a01e0 0x7f0d98137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.699+0000 7f0d9fd9d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d98070d80 con 0x7f0d9809f6c0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.699+0000 7f0d9fd9d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0d980717b0 con 0x7f0d980a01e0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9db39640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0d9809f6c0 0x7f0d9809fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37892/0 (socket says 172.21.15.37:37892) 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9db39640 1 -- 172.21.15.37:0/2352550515 learned_addr learned my addr 172.21.15.37:0/2352550515 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9d338640 1 --2- 172.21.15.37:0/2352550515 >> v2:172.21.15.37:3300/0 conn(0x7f0d980a01e0 0x7f0d98137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9cb37640 1 -- 172.21.15.37:0/2352550515 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779824371 0 0) 0x7f0d98070d80 con 0x7f0d9809f6c0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9cb37640 1 -- 172.21.15.37:0/2352550515 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d84003580 con 0x7f0d9809f6c0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9d338640 1 -- 172.21.15.37:0/2352550515 >> v1:172.21.15.37:6789/0 conn(0x7f0d9809f6c0 legacy=0x7f0d9809fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9d338640 1 -- 172.21.15.37:0/2352550515 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d98072330 con 0x7f0d980a01e0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9d338640 1 --2- 172.21.15.37:0/2352550515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d980a01e0 0x7f0d98137c40 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e773c1c2a3a04945 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9cb37640 1 -- 172.21.15.37:0/2352550515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0d88009d90 con 0x7f0d980a01e0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9cb37640 1 -- 172.21.15.37:0/2352550515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0d8800e230 con 0x7f0d980a01e0 2024-04-23T01:58:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.700+0000 7f0d9cb37640 1 -- 172.21.15.37:0/2352550515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0d8800e4d0 con 0x7f0d980a01e0 2024-04-23T01:58:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2352550515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d980a01e0 msgr2=0x7f0d98137c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 1 --2- 172.21.15.37:0/2352550515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d980a01e0 0x7f0d98137c40 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2352550515 shutdown_connections 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 1 --2- 172.21.15.37:0/2352550515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d980a01e0 0x7f0d98137c40 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2352550515 >> 172.21.15.37:0/2352550515 conn(0x7f0d980a1960 msgr2=0x7f0d980a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2352550515 shutdown_connections 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2352550515 wait complete. 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.701+0000 7f0d9fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.703+0000 7f0d9fd9d640 1 Processor -- start 2024-04-23T01:58:20.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.703+0000 7f0d9fd9d640 1 -- start start 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9fd9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d9809f6c0 0x7f0d981c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9fd9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d981c3cd0 con 0x7f0d9809f6c0 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9db39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d9809f6c0 0x7f0d981c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9db39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d9809f6c0 0x7f0d981c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51152/0 (socket says 172.21.15.37:51152) 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9db39640 1 -- 172.21.15.37:0/2771079936 learned_addr learned my addr 172.21.15.37:0/2771079936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9db39640 1 -- 172.21.15.37:0/2771079936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9811e5e0 con 0x7f0d9809f6c0 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9db39640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d9809f6c0 0x7f0d981c4280 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d8e7fc640 1 -- 172.21.15.37:0/2771079936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0d940070b0 con 0x7f0d9809f6c0 2024-04-23T01:58:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d8e7fc640 1 -- 172.21.15.37:0/2771079936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0d94007210 con 0x7f0d9809f6c0 2024-04-23T01:58:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d981c3f70 con 0x7f0d9809f6c0 2024-04-23T01:58:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d8e7fc640 1 -- 172.21.15.37:0/2771079936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0d940074b0 con 0x7f0d9809f6c0 2024-04-23T01:58:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.705+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9811e9e0 con 0x7f0d9809f6c0 2024-04-23T01:58:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.706+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9811e7e0 con 0x7f0d9809f6c0 2024-04-23T01:58:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.706+0000 7f0d8e7fc640 1 -- 172.21.15.37:0/2771079936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0d94007660 con 0x7f0d9809f6c0 2024-04-23T01:58:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.707+0000 7f0d8e7fc640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0d7c038980 0x7f0d7c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.707+0000 7f0d8e7fc640 1 -- 172.21.15.37:0/2771079936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7f0d94048e80 con 0x7f0d9809f6c0 2024-04-23T01:58:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.707+0000 7f0d9d338640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0d7c038980 0x7f0d7c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.707+0000 7f0d9d338640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0d7c038980 0x7f0d7c03ae90 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.712+0000 7f0d8e7fc640 1 -- 172.21.15.37:0/2771079936 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f0d940090b0 con 0x7f0d9809f6c0 2024-04-23T01:58:20.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.894+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d9809bca0 con 0x7f0d7c038980 2024-04-23T01:58:20.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.897+0000 7f0d8e7fc640 1 -- 172.21.15.37:0/2771079936 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+108925 (crc 0 0 0) 0x7f0d88009ce0 con 0x7f0d7c038980 2024-04-23T01:58:20.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:58:20.901 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-23T01:58:20.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0d7c038980 msgr2=0x7f0d7c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0d7c038980 0x7f0d7c03ae90 crc :-1 s=READY pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d9809f6c0 msgr2=0x7f0d981c4280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d9809f6c0 0x7f0d981c4280 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 shutdown_connections 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7f0d7c038980 0x7f0d7c03ae90 unknown :-1 s=CLOSED pgs=3870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 --2- 172.21.15.37:0/2771079936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d9809f6c0 0x7f0d981c4280 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.899+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 >> 172.21.15.37:0/2771079936 conn(0x7f0d980a1960 msgr2=0x7f0d981b8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.900+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 shutdown_connections 2024-04-23T01:58:20.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:20.900+0000 7f0d9fd9d640 1 -- 172.21.15.37:0/2771079936 wait complete. 2024-04-23T01:58:20.916 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":1299,"stamp":"2024-04-23T01:58:20.038098+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":289476,"kb_used_data":8164,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419140924,"statfs":{"total":429496729600,"available":429200306176,"internally_reserved":0,"allocated":8359936,"data_stored":3306153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002348"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.572568+0000","last_change":"2024-04-23T01:44:35.541884+0000","last_active":"2024-04-23T01:58:15.572568+0000","last_peered":"2024-04-23T01:58:15.572568+0000","last_clean":"2024-04-23T01:58:15.572568+0000","last_became_active":"2024-04-23T01:44:35.536828+0000","last_became_peered":"2024-04-23T01:44:35.536828+0000","last_unstale":"2024-04-23T01:58:15.572568+0000","last_undegraded":"2024-04-23T01:58:15.572568+0000","last_fullsized":"2024-04-23T01:58:15.572568+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.626328+0000","last_change":"2024-04-23T01:44:35.597862+0000","last_active":"2024-04-23T01:58:15.626328+0000","last_peered":"2024-04-23T01:58:15.626328+0000","last_clean":"2024-04-23T01:58:15.626328+0000","last_became_active":"2024-04-23T01:44:35.592920+0000","last_became_peered":"2024-04-23T01:44:35.592920+0000","last_unstale":"2024-04-23T01:58:15.626328+0000","last_undegraded":"2024-04-23T01:58:15.626328+0000","last_fullsized":"2024-04-23T01:58:15.626328+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1307,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.324223+0000","last_change":"2024-04-23T01:44:35.607049+0000","last_active":"2024-04-23T01:58:17.324223+0000","last_peered":"2024-04-23T01:58:17.324223+0000","last_clean":"2024-04-23T01:58:17.324223+0000","last_became_active":"2024-04-23T01:44:35.598001+0000","last_became_peered":"2024-04-23T01:44:35.598001+0000","last_unstale":"2024-04-23T01:58:17.324223+0000","last_undegraded":"2024-04-23T01:58:17.324223+0000","last_fullsized":"2024-04-23T01:58:17.324223+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1307,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.269773+0000","last_change":"2024-04-23T01:44:35.621029+0000","last_active":"2024-04-23T01:58:17.269773+0000","last_peered":"2024-04-23T01:58:17.269773+0000","last_clean":"2024-04-23T01:58:17.269773+0000","last_became_active":"2024-04-23T01:44:35.610632+0000","last_became_peered":"2024-04-23T01:44:35.610632+0000","last_unstale":"2024-04-23T01:58:17.269773+0000","last_undegraded":"2024-04-23T01:58:17.269773+0000","last_fullsized":"2024-04-23T01:58:17.269773+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.646836+0000","last_change":"2024-04-23T01:44:35.502927+0000","last_active":"2024-04-23T01:58:15.646836+0000","last_peered":"2024-04-23T01:58:15.646836+0000","last_clean":"2024-04-23T01:58:15.646836+0000","last_became_active":"2024-04-23T01:44:35.490300+0000","last_became_peered":"2024-04-23T01:44:35.490300+0000","last_unstale":"2024-04-23T01:58:15.646836+0000","last_undegraded":"2024-04-23T01:58:15.646836+0000","last_fullsized":"2024-04-23T01:58:15.646836+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.617384+0000","last_change":"2024-04-23T01:44:35.577689+0000","last_active":"2024-04-23T01:58:15.617384+0000","last_peered":"2024-04-23T01:58:15.617384+0000","last_clean":"2024-04-23T01:58:15.617384+0000","last_became_active":"2024-04-23T01:44:35.572629+0000","last_became_peered":"2024-04-23T01:44:35.572629+0000","last_unstale":"2024-04-23T01:58:15.617384+0000","last_undegraded":"2024-04-23T01:58:15.617384+0000","last_fullsized":"2024-04-23T01:58:15.617384+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.118000+0000","last_change":"2024-04-23T01:44:35.531053+0000","last_active":"2024-04-23T01:58:17.118000+0000","last_peered":"2024-04-23T01:58:17.118000+0000","last_clean":"2024-04-23T01:58:17.118000+0000","last_became_active":"2024-04-23T01:44:35.525053+0000","last_became_peered":"2024-04-23T01:44:35.525053+0000","last_unstale":"2024-04-23T01:58:17.118000+0000","last_undegraded":"2024-04-23T01:58:17.118000+0000","last_fullsized":"2024-04-23T01:58:17.118000+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.594862+0000","last_change":"2024-04-23T01:44:35.475519+0000","last_active":"2024-04-23T01:58:15.594862+0000","last_peered":"2024-04-23T01:58:15.594862+0000","last_clean":"2024-04-23T01:58:15.594862+0000","last_became_active":"2024-04-23T01:44:35.468130+0000","last_became_peered":"2024-04-23T01:44:35.468130+0000","last_unstale":"2024-04-23T01:58:15.594862+0000","last_undegraded":"2024-04-23T01:58:15.594862+0000","last_fullsized":"2024-04-23T01:58:15.594862+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1307,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.330192+0000","last_change":"2024-04-23T01:44:35.624145+0000","last_active":"2024-04-23T01:58:17.330192+0000","last_peered":"2024-04-23T01:58:17.330192+0000","last_clean":"2024-04-23T01:58:17.330192+0000","last_became_active":"2024-04-23T01:44:35.615580+0000","last_became_peered":"2024-04-23T01:44:35.615580+0000","last_unstale":"2024-04-23T01:58:17.330192+0000","last_undegraded":"2024-04-23T01:58:17.330192+0000","last_fullsized":"2024-04-23T01:58:17.330192+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1291,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.229373+0000","last_change":"2024-04-23T01:44:35.603892+0000","last_active":"2024-04-23T01:58:17.229373+0000","last_peered":"2024-04-23T01:58:17.229373+0000","last_clean":"2024-04-23T01:58:17.229373+0000","last_became_active":"2024-04-23T01:44:35.595827+0000","last_became_peered":"2024-04-23T01:44:35.595827+0000","last_unstale":"2024-04-23T01:58:17.229373+0000","last_undegraded":"2024-04-23T01:58:17.229373+0000","last_fullsized":"2024-04-23T01:58:17.229373+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1291,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.180109+0000","last_change":"2024-04-23T01:44:35.498234+0000","last_active":"2024-04-23T01:58:17.180109+0000","last_peered":"2024-04-23T01:58:17.180109+0000","last_clean":"2024-04-23T01:58:17.180109+0000","last_became_active":"2024-04-23T01:44:35.493377+0000","last_became_peered":"2024-04-23T01:44:35.493377+0000","last_unstale":"2024-04-23T01:58:17.180109+0000","last_undegraded":"2024-04-23T01:58:17.180109+0000","last_fullsized":"2024-04-23T01:58:17.180109+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.643880+0000","last_change":"2024-04-23T01:44:35.487445+0000","last_active":"2024-04-23T01:58:15.643880+0000","last_peered":"2024-04-23T01:58:15.643880+0000","last_clean":"2024-04-23T01:58:15.643880+0000","last_became_active":"2024-04-23T01:44:35.481772+0000","last_became_peered":"2024-04-23T01:44:35.481772+0000","last_unstale":"2024-04-23T01:58:15.643880+0000","last_undegraded":"2024-04-23T01:58:15.643880+0000","last_fullsized":"2024-04-23T01:58:15.643880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1307,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.333433+0000","last_change":"2024-04-23T01:44:35.583076+0000","last_active":"2024-04-23T01:58:17.333433+0000","last_peered":"2024-04-23T01:58:17.333433+0000","last_clean":"2024-04-23T01:58:17.333433+0000","last_became_active":"2024-04-23T01:44:35.572973+0000","last_became_peered":"2024-04-23T01:44:35.572973+0000","last_unstale":"2024-04-23T01:58:17.333433+0000","last_undegraded":"2024-04-23T01:58:17.333433+0000","last_fullsized":"2024-04-23T01:58:17.333433+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1307,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.313406+0000","last_change":"2024-04-23T01:44:35.561524+0000","last_active":"2024-04-23T01:58:17.313406+0000","last_peered":"2024-04-23T01:58:17.313406+0000","last_clean":"2024-04-23T01:58:17.313406+0000","last_became_active":"2024-04-23T01:44:35.552435+0000","last_became_peered":"2024-04-23T01:44:35.552435+0000","last_unstale":"2024-04-23T01:58:17.313406+0000","last_undegraded":"2024-04-23T01:58:17.313406+0000","last_fullsized":"2024-04-23T01:58:17.313406+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.586130+0000","last_change":"2024-04-23T01:44:35.533102+0000","last_active":"2024-04-23T01:58:15.586130+0000","last_peered":"2024-04-23T01:58:15.586130+0000","last_clean":"2024-04-23T01:58:15.586130+0000","last_became_active":"2024-04-23T01:44:35.525485+0000","last_became_peered":"2024-04-23T01:44:35.525485+0000","last_unstale":"2024-04-23T01:58:15.586130+0000","last_undegraded":"2024-04-23T01:58:15.586130+0000","last_fullsized":"2024-04-23T01:58:15.586130+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.095532+0000","last_change":"2024-04-23T01:44:35.557707+0000","last_active":"2024-04-23T01:58:17.095532+0000","last_peered":"2024-04-23T01:58:17.095532+0000","last_clean":"2024-04-23T01:58:17.095532+0000","last_became_active":"2024-04-23T01:44:35.553565+0000","last_became_peered":"2024-04-23T01:44:35.553565+0000","last_unstale":"2024-04-23T01:58:17.095532+0000","last_undegraded":"2024-04-23T01:58:17.095532+0000","last_fullsized":"2024-04-23T01:58:17.095532+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.551001+0000","last_change":"2024-04-23T01:44:35.514978+0000","last_active":"2024-04-23T01:58:15.551001+0000","last_peered":"2024-04-23T01:58:15.551001+0000","last_clean":"2024-04-23T01:58:15.551001+0000","last_became_active":"2024-04-23T01:44:35.510739+0000","last_became_peered":"2024-04-23T01:44:35.510739+0000","last_unstale":"2024-04-23T01:58:15.551001+0000","last_undegraded":"2024-04-23T01:58:15.551001+0000","last_fullsized":"2024-04-23T01:58:15.551001+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1307,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.307133+0000","last_change":"2024-04-23T01:44:35.661139+0000","last_active":"2024-04-23T01:58:17.307133+0000","last_peered":"2024-04-23T01:58:17.307133+0000","last_clean":"2024-04-23T01:58:17.307133+0000","last_became_active":"2024-04-23T01:44:35.655691+0000","last_became_peered":"2024-04-23T01:44:35.655691+0000","last_unstale":"2024-04-23T01:58:17.307133+0000","last_undegraded":"2024-04-23T01:58:17.307133+0000","last_fullsized":"2024-04-23T01:58:17.307133+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1307,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.345983+0000","last_change":"2024-04-23T01:44:35.495357+0000","last_active":"2024-04-23T01:58:17.345983+0000","last_peered":"2024-04-23T01:58:17.345983+0000","last_clean":"2024-04-23T01:58:17.345983+0000","last_became_active":"2024-04-23T01:44:35.488384+0000","last_became_peered":"2024-04-23T01:44:35.488384+0000","last_unstale":"2024-04-23T01:58:17.345983+0000","last_undegraded":"2024-04-23T01:58:17.345983+0000","last_fullsized":"2024-04-23T01:58:17.345983+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.605597+0000","last_change":"2024-04-23T01:44:35.619539+0000","last_active":"2024-04-23T01:58:15.605597+0000","last_peered":"2024-04-23T01:58:15.605597+0000","last_clean":"2024-04-23T01:58:15.605597+0000","last_became_active":"2024-04-23T01:44:35.613157+0000","last_became_peered":"2024-04-23T01:44:35.613157+0000","last_unstale":"2024-04-23T01:58:15.605597+0000","last_undegraded":"2024-04-23T01:58:15.605597+0000","last_fullsized":"2024-04-23T01:58:15.605597+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.579098+0000","last_change":"2024-04-23T01:44:35.564324+0000","last_active":"2024-04-23T01:58:15.579098+0000","last_peered":"2024-04-23T01:58:15.579098+0000","last_clean":"2024-04-23T01:58:15.579098+0000","last_became_active":"2024-04-23T01:44:35.555769+0000","last_became_peered":"2024-04-23T01:44:35.555769+0000","last_unstale":"2024-04-23T01:58:15.579098+0000","last_undegraded":"2024-04-23T01:58:15.579098+0000","last_fullsized":"2024-04-23T01:58:15.579098+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.649754+0000","last_change":"2024-04-23T01:44:35.530323+0000","last_active":"2024-04-23T01:58:15.649754+0000","last_peered":"2024-04-23T01:58:15.649754+0000","last_clean":"2024-04-23T01:58:15.649754+0000","last_became_active":"2024-04-23T01:44:35.520575+0000","last_became_peered":"2024-04-23T01:44:35.520575+0000","last_unstale":"2024-04-23T01:58:15.649754+0000","last_undegraded":"2024-04-23T01:58:15.649754+0000","last_fullsized":"2024-04-23T01:58:15.649754+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1291,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.166515+0000","last_change":"2024-04-23T01:44:35.633303+0000","last_active":"2024-04-23T01:58:17.166515+0000","last_peered":"2024-04-23T01:58:17.166515+0000","last_clean":"2024-04-23T01:58:17.166515+0000","last_became_active":"2024-04-23T01:44:35.625265+0000","last_became_peered":"2024-04-23T01:44:35.625265+0000","last_unstale":"2024-04-23T01:58:17.166515+0000","last_undegraded":"2024-04-23T01:58:17.166515+0000","last_fullsized":"2024-04-23T01:58:17.166515+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1291,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.111403+0000","last_change":"2024-04-23T01:44:35.630312+0000","last_active":"2024-04-23T01:58:17.111403+0000","last_peered":"2024-04-23T01:58:17.111403+0000","last_clean":"2024-04-23T01:58:17.111403+0000","last_became_active":"2024-04-23T01:44:35.617649+0000","last_became_peered":"2024-04-23T01:44:35.617649+0000","last_unstale":"2024-04-23T01:58:17.111403+0000","last_undegraded":"2024-04-23T01:58:17.111403+0000","last_fullsized":"2024-04-23T01:58:17.111403+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1291,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.212072+0000","last_change":"2024-04-23T01:44:35.620547+0000","last_active":"2024-04-23T01:58:17.212072+0000","last_peered":"2024-04-23T01:58:17.212072+0000","last_clean":"2024-04-23T01:58:17.212072+0000","last_became_active":"2024-04-23T01:44:35.610600+0000","last_became_peered":"2024-04-23T01:44:35.610600+0000","last_unstale":"2024-04-23T01:58:17.212072+0000","last_undegraded":"2024-04-23T01:58:17.212072+0000","last_fullsized":"2024-04-23T01:58:17.212072+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.591292+0000","last_change":"2024-04-23T01:44:35.506423+0000","last_active":"2024-04-23T01:58:15.591292+0000","last_peered":"2024-04-23T01:58:15.591292+0000","last_clean":"2024-04-23T01:58:15.591292+0000","last_became_active":"2024-04-23T01:44:35.498971+0000","last_became_peered":"2024-04-23T01:44:35.498971+0000","last_unstale":"2024-04-23T01:58:15.591292+0000","last_undegraded":"2024-04-23T01:58:15.591292+0000","last_fullsized":"2024-04-23T01:58:15.591292+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1291,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.228071+0000","last_change":"2024-04-23T01:44:35.666017+0000","last_active":"2024-04-23T01:58:17.228071+0000","last_peered":"2024-04-23T01:58:17.228071+0000","last_clean":"2024-04-23T01:58:17.228071+0000","last_became_active":"2024-04-23T01:44:35.661648+0000","last_became_peered":"2024-04-23T01:44:35.661648+0000","last_unstale":"2024-04-23T01:58:17.228071+0000","last_undegraded":"2024-04-23T01:58:17.228071+0000","last_fullsized":"2024-04-23T01:58:17.228071+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.642783+0000","last_change":"2024-04-23T01:44:35.551930+0000","last_active":"2024-04-23T01:58:15.642783+0000","last_peered":"2024-04-23T01:58:15.642783+0000","last_clean":"2024-04-23T01:58:15.642783+0000","last_became_active":"2024-04-23T01:44:35.546395+0000","last_became_peered":"2024-04-23T01:44:35.546395+0000","last_unstale":"2024-04-23T01:58:15.642783+0000","last_undegraded":"2024-04-23T01:58:15.642783+0000","last_fullsized":"2024-04-23T01:58:15.642783+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.641071+0000","last_change":"2024-04-23T01:44:35.567435+0000","last_active":"2024-04-23T01:58:15.641071+0000","last_peered":"2024-04-23T01:58:15.641071+0000","last_clean":"2024-04-23T01:58:15.641071+0000","last_became_active":"2024-04-23T01:44:35.560107+0000","last_became_peered":"2024-04-23T01:44:35.560107+0000","last_unstale":"2024-04-23T01:58:15.641071+0000","last_undegraded":"2024-04-23T01:58:15.641071+0000","last_fullsized":"2024-04-23T01:58:15.641071+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1297,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.588820+0000","last_change":"2024-04-23T01:44:35.590627+0000","last_active":"2024-04-23T01:58:15.588820+0000","last_peered":"2024-04-23T01:58:15.588820+0000","last_clean":"2024-04-23T01:58:15.588820+0000","last_became_active":"2024-04-23T01:44:35.585680+0000","last_became_peered":"2024-04-23T01:44:35.585680+0000","last_unstale":"2024-04-23T01:58:15.588820+0000","last_undegraded":"2024-04-23T01:58:15.588820+0000","last_fullsized":"2024-04-23T01:58:15.588820+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1310,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.595930+0000","last_change":"2024-04-23T01:44:35.631346+0000","last_active":"2024-04-23T01:58:15.595930+0000","last_peered":"2024-04-23T01:58:15.595930+0000","last_clean":"2024-04-23T01:58:15.595930+0000","last_became_active":"2024-04-23T01:44:35.625747+0000","last_became_peered":"2024-04-23T01:44:35.625747+0000","last_unstale":"2024-04-23T01:58:15.595930+0000","last_undegraded":"2024-04-23T01:58:15.595930+0000","last_fullsized":"2024-04-23T01:58:15.595930+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1291,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.193859+0000","last_change":"2024-04-23T01:44:35.567181+0000","last_active":"2024-04-23T01:58:17.193859+0000","last_peered":"2024-04-23T01:58:17.193859+0000","last_clean":"2024-04-23T01:58:17.193859+0000","last_became_active":"2024-04-23T01:44:35.558674+0000","last_became_peered":"2024-04-23T01:44:35.558674+0000","last_unstale":"2024-04-23T01:58:17.193859+0000","last_undegraded":"2024-04-23T01:58:17.193859+0000","last_fullsized":"2024-04-23T01:58:17.193859+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:44:34.322144+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1883,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.651264+0000","last_change":"2024-04-23T01:38:48.861947+0000","last_active":"2024-04-23T01:58:15.651264+0000","last_peered":"2024-04-23T01:58:15.651264+0000","last_clean":"2024-04-23T01:58:15.651264+0000","last_became_active":"2024-04-23T01:38:48.855491+0000","last_became_peered":"2024-04-23T01:38:48.855491+0000","last_unstale":"2024-04-23T01:58:15.651264+0000","last_undegraded":"2024-04-23T01:58:15.651264+0000","last_fullsized":"2024-04-23T01:58:15.651264+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1895,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.508418+0000","last_change":"2024-04-23T01:38:48.864893+0000","last_active":"2024-04-23T01:58:17.508418+0000","last_peered":"2024-04-23T01:58:17.508418+0000","last_clean":"2024-04-23T01:58:17.508418+0000","last_became_active":"2024-04-23T01:38:48.859341+0000","last_became_peered":"2024-04-23T01:38:48.859341+0000","last_unstale":"2024-04-23T01:58:17.508418+0000","last_undegraded":"2024-04-23T01:58:17.508418+0000","last_fullsized":"2024-04-23T01:58:17.508418+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1895,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.319875+0000","last_change":"2024-04-23T01:38:48.878113+0000","last_active":"2024-04-23T01:58:17.319875+0000","last_peered":"2024-04-23T01:58:17.319875+0000","last_clean":"2024-04-23T01:58:17.319875+0000","last_became_active":"2024-04-23T01:38:48.868717+0000","last_became_peered":"2024-04-23T01:38:48.868717+0000","last_unstale":"2024-04-23T01:58:17.319875+0000","last_undegraded":"2024-04-23T01:58:17.319875+0000","last_fullsized":"2024-04-23T01:58:17.319875+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1895,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.455474+0000","last_change":"2024-04-23T01:38:48.865866+0000","last_active":"2024-04-23T01:58:17.455474+0000","last_peered":"2024-04-23T01:58:17.455474+0000","last_clean":"2024-04-23T01:58:17.455474+0000","last_became_active":"2024-04-23T01:38:48.860354+0000","last_became_peered":"2024-04-23T01:38:48.860354+0000","last_unstale":"2024-04-23T01:58:17.455474+0000","last_undegraded":"2024-04-23T01:58:17.455474+0000","last_fullsized":"2024-04-23T01:58:17.455474+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1883,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.713027+0000","last_change":"2024-04-23T01:38:48.884633+0000","last_active":"2024-04-23T01:58:15.713027+0000","last_peered":"2024-04-23T01:58:15.713027+0000","last_clean":"2024-04-23T01:58:15.713027+0000","last_became_active":"2024-04-23T01:38:48.879351+0000","last_became_peered":"2024-04-23T01:38:48.879351+0000","last_unstale":"2024-04-23T01:58:15.713027+0000","last_undegraded":"2024-04-23T01:58:15.713027+0000","last_fullsized":"2024-04-23T01:58:15.713027+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1891,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.164595+0000","last_change":"2024-04-23T01:38:48.887592+0000","last_active":"2024-04-23T01:58:17.164595+0000","last_peered":"2024-04-23T01:58:17.164595+0000","last_clean":"2024-04-23T01:58:17.164595+0000","last_became_active":"2024-04-23T01:38:48.883647+0000","last_became_peered":"2024-04-23T01:38:48.883647+0000","last_unstale":"2024-04-23T01:58:17.164595+0000","last_undegraded":"2024-04-23T01:58:17.164595+0000","last_fullsized":"2024-04-23T01:58:17.164595+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1883,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.571040+0000","last_change":"2024-04-23T01:38:48.858269+0000","last_active":"2024-04-23T01:58:15.571040+0000","last_peered":"2024-04-23T01:58:15.571040+0000","last_clean":"2024-04-23T01:58:15.571040+0000","last_became_active":"2024-04-23T01:38:48.849449+0000","last_became_peered":"2024-04-23T01:38:48.849449+0000","last_unstale":"2024-04-23T01:58:15.571040+0000","last_undegraded":"2024-04-23T01:58:15.571040+0000","last_fullsized":"2024-04-23T01:58:15.571040+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1883,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:15.592591+0000","last_change":"2024-04-23T01:38:48.872508+0000","last_active":"2024-04-23T01:58:15.592591+0000","last_peered":"2024-04-23T01:58:15.592591+0000","last_clean":"2024-04-23T01:58:15.592591+0000","last_became_active":"2024-04-23T01:38:48.866529+0000","last_became_peered":"2024-04-23T01:38:48.866529+0000","last_unstale":"2024-04-23T01:58:15.592591+0000","last_undegraded":"2024-04-23T01:58:15.592591+0000","last_fullsized":"2024-04-23T01:58:15.592591+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:47.794323+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2028,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:17.294363+0000","last_change":"2024-04-23T01:38:46.833335+0000","last_active":"2024-04-23T01:58:17.294363+0000","last_peered":"2024-04-23T01:58:17.294363+0000","last_clean":"2024-04-23T01:58:17.294363+0000","last_became_active":"2024-04-23T01:38:46.827916+0000","last_became_peered":"2024-04-23T01:38:46.827916+0000","last_unstale":"2024-04-23T01:58:17.294363+0000","last_undegraded":"2024-04-23T01:58:17.294363+0000","last_fullsized":"2024-04-23T01:58:17.294363+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:38:45.784723+0000","last_clean_scrub_stamp":"2024-04-23T01:38:45.784723+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77872,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779728,"statfs":{"total":107374182400,"available":107294441472,"internally_reserved":0,"allocated":2400256,"data_stored":1128016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":68952,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104788648,"statfs":{"total":107374182400,"available":107303575552,"internally_reserved":0,"allocated":1785856,"data_stored":529153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77848,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779752,"statfs":{"total":107374182400,"available":107294466048,"internally_reserved":0,"allocated":2375680,"data_stored":1119637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64804,"kb_used_data":1756,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792796,"statfs":{"total":107374182400,"available":107307823104,"internally_reserved":0,"allocated":1798144,"data_stored":529347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T01:58:20.922 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.923 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.924 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.925 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-04-23T01:44:34.322144+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=44, tm_sec=34, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.926 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.927 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.927 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.927 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.927 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.927 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T01:38:47.794323+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=47, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.927 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T01:38:45.784723+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=38, tm_sec=45, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=1, tm_min=58, tm_sec=17, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T01:58:20.927 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T01:58:40.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T01:58:41.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.048+0000 7ff822f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:41.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.054+0000 7ff822f9d640 1 Processor -- start 2024-04-23T01:58:41.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.054+0000 7ff822f9d640 1 -- start start 2024-04-23T01:58:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.055+0000 7ff822f9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff81c09f6c0 0x7ff81c09fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.055+0000 7ff822f9d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81c070d80 con 0x7ff81c0a0010 2024-04-23T01:58:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.055+0000 7ff822f9d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff81c0717b0 con 0x7ff81c09f6c0 2024-04-23T01:58:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.055+0000 7ff820d39640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff81c09f6c0 0x7ff81c09fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:41.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.055+0000 7ff820d39640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff81c09f6c0 0x7ff81c09fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51172/0 (socket says 172.21.15.37:51172) 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.055+0000 7ff81bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff81c0a0010 0x7ff81c1329f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55182/0 (socket says 172.21.15.37:55182) 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.055+0000 7ff820d39640 1 -- 172.21.15.37:0/648603424 learned_addr learned my addr 172.21.15.37:0/648603424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.056+0000 7ff820d39640 1 -- 172.21.15.37:0/648603424 >> v1:172.21.15.37:6789/0 conn(0x7ff81c0a0010 legacy=0x7ff81c1329f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.056+0000 7ff820d39640 1 -- 172.21.15.37:0/648603424 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c072330 con 0x7ff81c09f6c0 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.056+0000 7ff820d39640 1 --2- 172.21.15.37:0/648603424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c09fad0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5132c608744b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.056+0000 7ff81b7fe640 1 -- 172.21.15.37:0/648603424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff81400e040 con 0x7ff81c09f6c0 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.056+0000 7ff81b7fe640 1 -- 172.21.15.37:0/648603424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff8140091e0 con 0x7ff81c09f6c0 2024-04-23T01:58:41.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.056+0000 7ff81b7fe640 1 -- 172.21.15.37:0/648603424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff814007730 con 0x7ff81c09f6c0 2024-04-23T01:58:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 1 -- 172.21.15.37:0/648603424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 msgr2=0x7ff81c09fad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 1 --2- 172.21.15.37:0/648603424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c09fad0 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 1 -- 172.21.15.37:0/648603424 shutdown_connections 2024-04-23T01:58:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 1 --2- 172.21.15.37:0/648603424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c09fad0 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 1 -- 172.21.15.37:0/648603424 >> 172.21.15.37:0/648603424 conn(0x7ff81c0a1960 msgr2=0x7ff81c0a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 1 -- 172.21.15.37:0/648603424 shutdown_connections 2024-04-23T01:58:41.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 1 -- 172.21.15.37:0/648603424 wait complete. 2024-04-23T01:58:41.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.057+0000 7ff822f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:41.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.059+0000 7ff822f9d640 1 Processor -- start 2024-04-23T01:58:41.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.059+0000 7ff822f9d640 1 -- start start 2024-04-23T01:58:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.061+0000 7ff822f9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c11c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.061+0000 7ff822f9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c11e880 con 0x7ff81c09f6c0 2024-04-23T01:58:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.061+0000 7ff820d39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c11c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.061+0000 7ff820d39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c11c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51184/0 (socket says 172.21.15.37:51184) 2024-04-23T01:58:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.061+0000 7ff820d39640 1 -- 172.21.15.37:0/741853721 learned_addr learned my addr 172.21.15.37:0/741853721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.062+0000 7ff820d39640 1 -- 172.21.15.37:0/741853721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c1300b0 con 0x7ff81c09f6c0 2024-04-23T01:58:41.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.062+0000 7ff820d39640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c11c080 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.062+0000 7ff8197fa640 1 -- 172.21.15.37:0/741853721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff81400e040 con 0x7ff81c09f6c0 2024-04-23T01:58:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.062+0000 7ff8197fa640 1 -- 172.21.15.37:0/741853721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff8140094d0 con 0x7ff81c09f6c0 2024-04-23T01:58:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.062+0000 7ff8197fa640 1 -- 172.21.15.37:0/741853721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff814010960 con 0x7ff81c09f6c0 2024-04-23T01:58:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.062+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c1200e0 con 0x7ff81c09f6c0 2024-04-23T01:58:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.062+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c11ecd0 con 0x7ff81c09f6c0 2024-04-23T01:58:41.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.063+0000 7ff8197fa640 1 -- 172.21.15.37:0/741853721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff814010b10 con 0x7ff81c09f6c0 2024-04-23T01:58:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.063+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c0692b0 con 0x7ff81c09f6c0 2024-04-23T01:58:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.063+0000 7ff8197fa640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7fc038980 0x7ff7fc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.063+0000 7ff8197fa640 1 -- 172.21.15.37:0/741853721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7ff814049d40 con 0x7ff81c09f6c0 2024-04-23T01:58:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.064+0000 7ff81bfff640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7fc038980 0x7ff7fc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:41.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.064+0000 7ff81bfff640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7fc038980 0x7ff7fc03ae90 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:41.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.069+0000 7ff8197fa640 1 -- 172.21.15.37:0/741853721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ff814011290 con 0x7ff81c09f6c0 2024-04-23T01:58:41.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.255+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 --> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff81c1338a0 con 0x7ff7fc038980 2024-04-23T01:58:41.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.258+0000 7ff8197fa640 1 -- 172.21.15.37:0/741853721 <== mgr.4101 v2:172.21.15.191:6800/790915015 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+108915 (crc 0 0 0) 0x7ff81c1338a0 con 0x7ff7fc038980 2024-04-23T01:58:41.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-23T01:58:41.262 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7fc038980 msgr2=0x7ff7fc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7fc038980 0x7ff7fc03ae90 crc :-1 s=READY pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 msgr2=0x7ff81c11c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c11c080 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 shutdown_connections 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7ff7fc038980 0x7ff7fc03ae90 unknown :-1 s=CLOSED pgs=3871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 --2- 172.21.15.37:0/741853721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c09f6c0 0x7ff81c11c080 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 >> 172.21.15.37:0/741853721 conn(0x7ff81c0a1960 msgr2=0x7ff81c1bab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 shutdown_connections 2024-04-23T01:58:41.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.261+0000 7ff822f9d640 1 -- 172.21.15.37:0/741853721 wait complete. 2024-04-23T01:58:41.275 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":1309,"stamp":"2024-04-23T01:58:40.043160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":289476,"kb_used_data":8164,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419140924,"statfs":{"total":429496729600,"available":429200306176,"internally_reserved":0,"allocated":8359936,"data_stored":3306153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002869"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.622356+0000","last_change":"2024-04-23T01:58:20.649909+0000","last_active":"2024-04-23T01:58:20.622356+0000","last_peered":"2024-04-23T01:58:20.622356+0000","last_clean":"2024-04-23T01:58:20.622356+0000","last_became_active":"2024-04-23T01:44:35.536828+0000","last_became_peered":"2024-04-23T01:44:35.536828+0000","last_unstale":"2024-04-23T01:58:20.622356+0000","last_undegraded":"2024-04-23T01:58:20.622356+0000","last_fullsized":"2024-04-23T01:58:20.622356+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.649734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.649734+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.621068+0000","last_change":"2024-04-23T01:58:20.646224+0000","last_active":"2024-04-23T01:58:20.621068+0000","last_peered":"2024-04-23T01:58:20.621068+0000","last_clean":"2024-04-23T01:58:20.621068+0000","last_became_active":"2024-04-23T01:44:35.592920+0000","last_became_peered":"2024-04-23T01:44:35.592920+0000","last_unstale":"2024-04-23T01:58:20.621068+0000","last_undegraded":"2024-04-23T01:58:20.621068+0000","last_fullsized":"2024-04-23T01:58:20.621068+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.646058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.646058+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.590491+0000","last_change":"2024-04-23T01:58:19.616247+0000","last_active":"2024-04-23T01:58:19.590491+0000","last_peered":"2024-04-23T01:58:19.590491+0000","last_clean":"2024-04-23T01:58:19.590491+0000","last_became_active":"2024-04-23T01:44:35.598001+0000","last_became_peered":"2024-04-23T01:44:35.598001+0000","last_unstale":"2024-04-23T01:58:19.590491+0000","last_undegraded":"2024-04-23T01:58:19.590491+0000","last_fullsized":"2024-04-23T01:58:19.590491+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.616086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.616086+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.587573+0000","last_change":"2024-04-23T01:58:19.614927+0000","last_active":"2024-04-23T01:58:19.587573+0000","last_peered":"2024-04-23T01:58:19.587573+0000","last_clean":"2024-04-23T01:58:19.587573+0000","last_became_active":"2024-04-23T01:44:35.610632+0000","last_became_peered":"2024-04-23T01:44:35.610632+0000","last_unstale":"2024-04-23T01:58:19.587573+0000","last_undegraded":"2024-04-23T01:58:19.587573+0000","last_fullsized":"2024-04-23T01:58:19.587573+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.614763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.614763+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.617143+0000","last_change":"2024-04-23T01:58:20.655758+0000","last_active":"2024-04-23T01:58:20.617143+0000","last_peered":"2024-04-23T01:58:20.617143+0000","last_clean":"2024-04-23T01:58:20.617143+0000","last_became_active":"2024-04-23T01:44:35.490300+0000","last_became_peered":"2024-04-23T01:44:35.490300+0000","last_unstale":"2024-04-23T01:58:20.617143+0000","last_undegraded":"2024-04-23T01:58:20.617143+0000","last_fullsized":"2024-04-23T01:58:20.617143+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.655603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.655603+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.614448+0000","last_change":"2024-04-23T01:58:20.643820+0000","last_active":"2024-04-23T01:58:20.614448+0000","last_peered":"2024-04-23T01:58:20.614448+0000","last_clean":"2024-04-23T01:58:20.614448+0000","last_became_active":"2024-04-23T01:44:35.572629+0000","last_became_peered":"2024-04-23T01:44:35.572629+0000","last_unstale":"2024-04-23T01:58:20.614448+0000","last_undegraded":"2024-04-23T01:58:20.614448+0000","last_fullsized":"2024-04-23T01:58:20.614448+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.643668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.643668+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1311,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.069108+0000","last_change":"2024-04-23T01:58:20.078769+0000","last_active":"2024-04-23T01:58:20.069108+0000","last_peered":"2024-04-23T01:58:20.069108+0000","last_clean":"2024-04-23T01:58:20.069108+0000","last_became_active":"2024-04-23T01:44:35.525053+0000","last_became_peered":"2024-04-23T01:44:35.525053+0000","last_unstale":"2024-04-23T01:58:20.069108+0000","last_undegraded":"2024-04-23T01:58:20.069108+0000","last_fullsized":"2024-04-23T01:58:20.069108+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.078583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.078583+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.611539+0000","last_change":"2024-04-23T01:58:20.654431+0000","last_active":"2024-04-23T01:58:20.611539+0000","last_peered":"2024-04-23T01:58:20.611539+0000","last_clean":"2024-04-23T01:58:20.611539+0000","last_became_active":"2024-04-23T01:44:35.468130+0000","last_became_peered":"2024-04-23T01:44:35.468130+0000","last_unstale":"2024-04-23T01:58:20.611539+0000","last_undegraded":"2024-04-23T01:58:20.611539+0000","last_fullsized":"2024-04-23T01:58:20.611539+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.654264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.654264+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.583081+0000","last_change":"2024-04-23T01:58:19.613327+0000","last_active":"2024-04-23T01:58:19.583081+0000","last_peered":"2024-04-23T01:58:19.583081+0000","last_clean":"2024-04-23T01:58:19.583081+0000","last_became_active":"2024-04-23T01:44:35.615580+0000","last_became_peered":"2024-04-23T01:44:35.615580+0000","last_unstale":"2024-04-23T01:58:19.583081+0000","last_undegraded":"2024-04-23T01:58:19.583081+0000","last_fullsized":"2024-04-23T01:58:19.583081+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.613157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.613157+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1293,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.105173+0000","last_change":"2024-04-23T01:58:19.120122+0000","last_active":"2024-04-23T01:58:19.105173+0000","last_peered":"2024-04-23T01:58:19.105173+0000","last_clean":"2024-04-23T01:58:19.105173+0000","last_became_active":"2024-04-23T01:44:35.595827+0000","last_became_peered":"2024-04-23T01:44:35.595827+0000","last_unstale":"2024-04-23T01:58:19.105173+0000","last_undegraded":"2024-04-23T01:58:19.105173+0000","last_fullsized":"2024-04-23T01:58:19.105173+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.119942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.119942+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1293,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.102716+0000","last_change":"2024-04-23T01:58:19.116816+0000","last_active":"2024-04-23T01:58:19.102716+0000","last_peered":"2024-04-23T01:58:19.102716+0000","last_clean":"2024-04-23T01:58:19.102716+0000","last_became_active":"2024-04-23T01:44:35.493377+0000","last_became_peered":"2024-04-23T01:44:35.493377+0000","last_unstale":"2024-04-23T01:58:19.102716+0000","last_undegraded":"2024-04-23T01:58:19.102716+0000","last_fullsized":"2024-04-23T01:58:19.102716+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.116646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.116646+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.607255+0000","last_change":"2024-04-23T01:58:20.641174+0000","last_active":"2024-04-23T01:58:20.607255+0000","last_peered":"2024-04-23T01:58:20.607255+0000","last_clean":"2024-04-23T01:58:20.607255+0000","last_became_active":"2024-04-23T01:44:35.481772+0000","last_became_peered":"2024-04-23T01:44:35.481772+0000","last_unstale":"2024-04-23T01:58:20.607255+0000","last_undegraded":"2024-04-23T01:58:20.607255+0000","last_fullsized":"2024-04-23T01:58:20.607255+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.640998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.640998+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.582200+0000","last_change":"2024-04-23T01:58:19.602753+0000","last_active":"2024-04-23T01:58:19.582200+0000","last_peered":"2024-04-23T01:58:19.582200+0000","last_clean":"2024-04-23T01:58:19.582200+0000","last_became_active":"2024-04-23T01:44:35.572973+0000","last_became_peered":"2024-04-23T01:44:35.572973+0000","last_unstale":"2024-04-23T01:58:19.582200+0000","last_undegraded":"2024-04-23T01:58:19.582200+0000","last_fullsized":"2024-04-23T01:58:19.582200+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.602588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.602588+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.577798+0000","last_change":"2024-04-23T01:58:19.609003+0000","last_active":"2024-04-23T01:58:19.577798+0000","last_peered":"2024-04-23T01:58:19.577798+0000","last_clean":"2024-04-23T01:58:19.577798+0000","last_became_active":"2024-04-23T01:44:35.552435+0000","last_became_peered":"2024-04-23T01:44:35.552435+0000","last_unstale":"2024-04-23T01:58:19.577798+0000","last_undegraded":"2024-04-23T01:58:19.577798+0000","last_fullsized":"2024-04-23T01:58:19.577798+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.608838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.608838+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.601873+0000","last_change":"2024-04-23T01:58:20.636729+0000","last_active":"2024-04-23T01:58:20.601873+0000","last_peered":"2024-04-23T01:58:20.601873+0000","last_clean":"2024-04-23T01:58:20.601873+0000","last_became_active":"2024-04-23T01:44:35.525485+0000","last_became_peered":"2024-04-23T01:44:35.525485+0000","last_unstale":"2024-04-23T01:58:20.601873+0000","last_undegraded":"2024-04-23T01:58:20.601873+0000","last_fullsized":"2024-04-23T01:58:20.601873+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.636559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.636559+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1311,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.067877+0000","last_change":"2024-04-23T01:58:20.077513+0000","last_active":"2024-04-23T01:58:20.067877+0000","last_peered":"2024-04-23T01:58:20.067877+0000","last_clean":"2024-04-23T01:58:20.067877+0000","last_became_active":"2024-04-23T01:44:35.553565+0000","last_became_peered":"2024-04-23T01:44:35.553565+0000","last_unstale":"2024-04-23T01:58:20.067877+0000","last_undegraded":"2024-04-23T01:58:20.067877+0000","last_fullsized":"2024-04-23T01:58:20.067877+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.077305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.077305+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.598420+0000","last_change":"2024-04-23T01:58:20.652894+0000","last_active":"2024-04-23T01:58:20.598420+0000","last_peered":"2024-04-23T01:58:20.598420+0000","last_clean":"2024-04-23T01:58:20.598420+0000","last_became_active":"2024-04-23T01:44:35.510739+0000","last_became_peered":"2024-04-23T01:44:35.510739+0000","last_unstale":"2024-04-23T01:58:20.598420+0000","last_undegraded":"2024-04-23T01:58:20.598420+0000","last_fullsized":"2024-04-23T01:58:20.598420+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.652736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.652736+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.576093+0000","last_change":"2024-04-23T01:58:19.606018+0000","last_active":"2024-04-23T01:58:19.576093+0000","last_peered":"2024-04-23T01:58:19.576093+0000","last_clean":"2024-04-23T01:58:19.576093+0000","last_became_active":"2024-04-23T01:44:35.655691+0000","last_became_peered":"2024-04-23T01:44:35.655691+0000","last_unstale":"2024-04-23T01:58:19.576093+0000","last_undegraded":"2024-04-23T01:58:19.576093+0000","last_fullsized":"2024-04-23T01:58:19.576093+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.605828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.605828+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1309,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.574120+0000","last_change":"2024-04-23T01:58:19.607147+0000","last_active":"2024-04-23T01:58:19.574120+0000","last_peered":"2024-04-23T01:58:19.574120+0000","last_clean":"2024-04-23T01:58:19.574120+0000","last_became_active":"2024-04-23T01:44:35.488384+0000","last_became_peered":"2024-04-23T01:44:35.488384+0000","last_unstale":"2024-04-23T01:58:19.574120+0000","last_undegraded":"2024-04-23T01:58:19.574120+0000","last_fullsized":"2024-04-23T01:58:19.574120+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.606973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.606973+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.594643+0000","last_change":"2024-04-23T01:58:20.651438+0000","last_active":"2024-04-23T01:58:20.594643+0000","last_peered":"2024-04-23T01:58:20.594643+0000","last_clean":"2024-04-23T01:58:20.594643+0000","last_became_active":"2024-04-23T01:44:35.613157+0000","last_became_peered":"2024-04-23T01:44:35.613157+0000","last_unstale":"2024-04-23T01:58:20.594643+0000","last_undegraded":"2024-04-23T01:58:20.594643+0000","last_fullsized":"2024-04-23T01:58:20.594643+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.651275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.651275+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.591735+0000","last_change":"2024-04-23T01:58:20.647092+0000","last_active":"2024-04-23T01:58:20.591735+0000","last_peered":"2024-04-23T01:58:20.591735+0000","last_clean":"2024-04-23T01:58:20.591735+0000","last_became_active":"2024-04-23T01:44:35.555769+0000","last_became_peered":"2024-04-23T01:44:35.555769+0000","last_unstale":"2024-04-23T01:58:20.591735+0000","last_undegraded":"2024-04-23T01:58:20.591735+0000","last_fullsized":"2024-04-23T01:58:20.591735+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.646942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.646942+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.590624+0000","last_change":"2024-04-23T01:58:20.649019+0000","last_active":"2024-04-23T01:58:20.590624+0000","last_peered":"2024-04-23T01:58:20.590624+0000","last_clean":"2024-04-23T01:58:20.590624+0000","last_became_active":"2024-04-23T01:44:35.520575+0000","last_became_peered":"2024-04-23T01:44:35.520575+0000","last_unstale":"2024-04-23T01:58:20.590624+0000","last_undegraded":"2024-04-23T01:58:20.590624+0000","last_fullsized":"2024-04-23T01:58:20.590624+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.648838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.648838+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1293,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.098458+0000","last_change":"2024-04-23T01:58:19.118629+0000","last_active":"2024-04-23T01:58:19.098458+0000","last_peered":"2024-04-23T01:58:19.098458+0000","last_clean":"2024-04-23T01:58:19.098458+0000","last_became_active":"2024-04-23T01:44:35.625265+0000","last_became_peered":"2024-04-23T01:44:35.625265+0000","last_unstale":"2024-04-23T01:58:19.098458+0000","last_undegraded":"2024-04-23T01:58:19.098458+0000","last_fullsized":"2024-04-23T01:58:19.098458+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.118451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.118451+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1293,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.093853+0000","last_change":"2024-04-23T01:58:19.114184+0000","last_active":"2024-04-23T01:58:19.093853+0000","last_peered":"2024-04-23T01:58:19.093853+0000","last_clean":"2024-04-23T01:58:19.093853+0000","last_became_active":"2024-04-23T01:44:35.617649+0000","last_became_peered":"2024-04-23T01:44:35.617649+0000","last_unstale":"2024-04-23T01:58:19.093853+0000","last_undegraded":"2024-04-23T01:58:19.093853+0000","last_fullsized":"2024-04-23T01:58:19.093853+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.113975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.113975+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1293,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.092266+0000","last_change":"2024-04-23T01:58:19.115820+0000","last_active":"2024-04-23T01:58:19.092266+0000","last_peered":"2024-04-23T01:58:19.092266+0000","last_clean":"2024-04-23T01:58:19.092266+0000","last_became_active":"2024-04-23T01:44:35.610600+0000","last_became_peered":"2024-04-23T01:44:35.610600+0000","last_unstale":"2024-04-23T01:58:19.092266+0000","last_undegraded":"2024-04-23T01:58:19.092266+0000","last_fullsized":"2024-04-23T01:58:19.092266+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.115647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.115647+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.587972+0000","last_change":"2024-04-23T01:58:20.642316+0000","last_active":"2024-04-23T01:58:20.587972+0000","last_peered":"2024-04-23T01:58:20.587972+0000","last_clean":"2024-04-23T01:58:20.587972+0000","last_became_active":"2024-04-23T01:44:35.498971+0000","last_became_peered":"2024-04-23T01:44:35.498971+0000","last_unstale":"2024-04-23T01:58:20.587972+0000","last_undegraded":"2024-04-23T01:58:20.587972+0000","last_fullsized":"2024-04-23T01:58:20.587972+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.642133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.642133+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1293,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.089983+0000","last_change":"2024-04-23T01:58:19.112065+0000","last_active":"2024-04-23T01:58:19.089983+0000","last_peered":"2024-04-23T01:58:19.089983+0000","last_clean":"2024-04-23T01:58:19.089983+0000","last_became_active":"2024-04-23T01:44:35.661648+0000","last_became_peered":"2024-04-23T01:44:35.661648+0000","last_unstale":"2024-04-23T01:58:19.089983+0000","last_undegraded":"2024-04-23T01:58:19.089983+0000","last_fullsized":"2024-04-23T01:58:19.089983+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.111877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.111877+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.583658+0000","last_change":"2024-04-23T01:58:20.639326+0000","last_active":"2024-04-23T01:58:20.583658+0000","last_peered":"2024-04-23T01:58:20.583658+0000","last_clean":"2024-04-23T01:58:20.583658+0000","last_became_active":"2024-04-23T01:44:35.546395+0000","last_became_peered":"2024-04-23T01:44:35.546395+0000","last_unstale":"2024-04-23T01:58:20.583658+0000","last_undegraded":"2024-04-23T01:58:20.583658+0000","last_fullsized":"2024-04-23T01:58:20.583658+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.639142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.639142+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.578453+0000","last_change":"2024-04-23T01:58:20.630291+0000","last_active":"2024-04-23T01:58:20.578453+0000","last_peered":"2024-04-23T01:58:20.578453+0000","last_clean":"2024-04-23T01:58:20.578453+0000","last_became_active":"2024-04-23T01:44:35.560107+0000","last_became_peered":"2024-04-23T01:44:35.560107+0000","last_unstale":"2024-04-23T01:58:20.578453+0000","last_undegraded":"2024-04-23T01:58:20.578453+0000","last_fullsized":"2024-04-23T01:58:20.578453+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.630105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.630105+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1299,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.576866+0000","last_change":"2024-04-23T01:58:20.625895+0000","last_active":"2024-04-23T01:58:20.576866+0000","last_peered":"2024-04-23T01:58:20.576866+0000","last_clean":"2024-04-23T01:58:20.576866+0000","last_became_active":"2024-04-23T01:44:35.585680+0000","last_became_peered":"2024-04-23T01:44:35.585680+0000","last_unstale":"2024-04-23T01:58:20.576866+0000","last_undegraded":"2024-04-23T01:58:20.576866+0000","last_fullsized":"2024-04-23T01:58:20.576866+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.625726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.625726+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1312,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.575511+0000","last_change":"2024-04-23T01:58:20.633435+0000","last_active":"2024-04-23T01:58:20.575511+0000","last_peered":"2024-04-23T01:58:20.575511+0000","last_clean":"2024-04-23T01:58:20.575511+0000","last_became_active":"2024-04-23T01:44:35.625747+0000","last_became_peered":"2024-04-23T01:44:35.625747+0000","last_unstale":"2024-04-23T01:58:20.575511+0000","last_undegraded":"2024-04-23T01:58:20.575511+0000","last_fullsized":"2024-04-23T01:58:20.575511+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-04-23T01:58:20.633184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.633184+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1293,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.088577+0000","last_change":"2024-04-23T01:58:19.106735+0000","last_active":"2024-04-23T01:58:19.088577+0000","last_peered":"2024-04-23T01:58:19.088577+0000","last_clean":"2024-04-23T01:58:19.088577+0000","last_became_active":"2024-04-23T01:44:35.558674+0000","last_became_peered":"2024-04-23T01:44:35.558674+0000","last_unstale":"2024-04-23T01:58:19.088577+0000","last_undegraded":"2024-04-23T01:58:19.088577+0000","last_fullsized":"2024-04-23T01:58:19.088577+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.106565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.106565+0000","last_clean_scrub_stamp":"2024-04-23T01:44:34.322144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1885,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.573701+0000","last_change":"2024-04-23T01:58:20.634481+0000","last_active":"2024-04-23T01:58:20.573701+0000","last_peered":"2024-04-23T01:58:20.573701+0000","last_clean":"2024-04-23T01:58:20.573701+0000","last_became_active":"2024-04-23T01:38:48.855491+0000","last_became_peered":"2024-04-23T01:38:48.855491+0000","last_unstale":"2024-04-23T01:58:20.573701+0000","last_undegraded":"2024-04-23T01:58:20.573701+0000","last_fullsized":"2024-04-23T01:58:20.573701+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.634319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.634319+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1897,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.574114+0000","last_change":"2024-04-23T01:58:19.599757+0000","last_active":"2024-04-23T01:58:19.574114+0000","last_peered":"2024-04-23T01:58:19.574114+0000","last_clean":"2024-04-23T01:58:19.574114+0000","last_became_active":"2024-04-23T01:38:48.859341+0000","last_became_peered":"2024-04-23T01:38:48.859341+0000","last_unstale":"2024-04-23T01:58:19.574114+0000","last_undegraded":"2024-04-23T01:58:19.574114+0000","last_fullsized":"2024-04-23T01:58:19.574114+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.599458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.599458+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1897,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.572785+0000","last_change":"2024-04-23T01:58:19.601791+0000","last_active":"2024-04-23T01:58:19.572785+0000","last_peered":"2024-04-23T01:58:19.572785+0000","last_clean":"2024-04-23T01:58:19.572785+0000","last_became_active":"2024-04-23T01:38:48.868717+0000","last_became_peered":"2024-04-23T01:38:48.868717+0000","last_unstale":"2024-04-23T01:58:19.572785+0000","last_undegraded":"2024-04-23T01:58:19.572785+0000","last_fullsized":"2024-04-23T01:58:19.572785+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.601616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.601616+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1897,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.572587+0000","last_change":"2024-04-23T01:58:19.598533+0000","last_active":"2024-04-23T01:58:19.572587+0000","last_peered":"2024-04-23T01:58:19.572587+0000","last_clean":"2024-04-23T01:58:19.572587+0000","last_became_active":"2024-04-23T01:38:48.860354+0000","last_became_peered":"2024-04-23T01:38:48.860354+0000","last_unstale":"2024-04-23T01:58:19.572587+0000","last_undegraded":"2024-04-23T01:58:19.572587+0000","last_fullsized":"2024-04-23T01:58:19.572587+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:19.598214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.598214+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1885,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.573325+0000","last_change":"2024-04-23T01:58:20.612951+0000","last_active":"2024-04-23T01:58:20.573325+0000","last_peered":"2024-04-23T01:58:20.573325+0000","last_clean":"2024-04-23T01:58:20.573325+0000","last_became_active":"2024-04-23T01:38:48.879351+0000","last_became_peered":"2024-04-23T01:38:48.879351+0000","last_unstale":"2024-04-23T01:58:20.573325+0000","last_undegraded":"2024-04-23T01:58:20.573325+0000","last_fullsized":"2024-04-23T01:58:20.573325+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.612771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.612771+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1893,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.069481+0000","last_change":"2024-04-23T01:58:20.080918+0000","last_active":"2024-04-23T01:58:20.069481+0000","last_peered":"2024-04-23T01:58:20.069481+0000","last_clean":"2024-04-23T01:58:20.069481+0000","last_became_active":"2024-04-23T01:38:48.883647+0000","last_became_peered":"2024-04-23T01:38:48.883647+0000","last_unstale":"2024-04-23T01:58:20.069481+0000","last_undegraded":"2024-04-23T01:58:20.069481+0000","last_fullsized":"2024-04-23T01:58:20.069481+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.080735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.080735+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1885,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.572099+0000","last_change":"2024-04-23T01:58:20.638536+0000","last_active":"2024-04-23T01:58:20.572099+0000","last_peered":"2024-04-23T01:58:20.572099+0000","last_clean":"2024-04-23T01:58:20.572099+0000","last_became_active":"2024-04-23T01:38:48.849449+0000","last_became_peered":"2024-04-23T01:38:48.849449+0000","last_unstale":"2024-04-23T01:58:20.572099+0000","last_undegraded":"2024-04-23T01:58:20.572099+0000","last_fullsized":"2024-04-23T01:58:20.572099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.638361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.638361+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1885,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:20.573318+0000","last_change":"2024-04-23T01:58:20.616452+0000","last_active":"2024-04-23T01:58:20.573318+0000","last_peered":"2024-04-23T01:58:20.573318+0000","last_clean":"2024-04-23T01:58:20.573318+0000","last_became_active":"2024-04-23T01:38:48.866529+0000","last_became_peered":"2024-04-23T01:38:48.866529+0000","last_unstale":"2024-04-23T01:58:20.573318+0000","last_undegraded":"2024-04-23T01:58:20.573318+0000","last_fullsized":"2024-04-23T01:58:20.573318+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T01:58:20.616252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:20.616252+0000","last_clean_scrub_stamp":"2024-04-23T01:38:47.794323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":2030,"reported_epoch":718,"state":"active+clean","last_fresh":"2024-04-23T01:58:19.571369+0000","last_change":"2024-04-23T01:58:19.612501+0000","last_active":"2024-04-23T01:58:19.571369+0000","last_peered":"2024-04-23T01:58:19.571369+0000","last_clean":"2024-04-23T01:58:19.571369+0000","last_became_active":"2024-04-23T01:38:46.827916+0000","last_became_peered":"2024-04-23T01:38:46.827916+0000","last_unstale":"2024-04-23T01:58:19.571369+0000","last_undegraded":"2024-04-23T01:58:19.571369+0000","last_fullsized":"2024-04-23T01:58:19.571369+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'97","last_scrub_stamp":"2024-04-23T01:58:19.612279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T01:58:19.612279+0000","last_clean_scrub_stamp":"2024-04-23T01:38:45.784723+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":9,"seq":38654706857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77872,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779728,"statfs":{"total":107374182400,"available":107294441472,"internally_reserved":0,"allocated":2400256,"data_stored":1128016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":9,"seq":38654706857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":68952,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104788648,"statfs":{"total":107374182400,"available":107303575552,"internally_reserved":0,"allocated":1785856,"data_stored":529153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":77848,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104779752,"statfs":{"total":107374182400,"available":107294466048,"internally_reserved":0,"allocated":2375680,"data_stored":1119637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":64804,"kb_used_data":1756,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104792796,"statfs":{"total":107374182400,"available":107307823104,"internally_reserved":0,"allocated":1798144,"data_stored":529347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T01:58:41.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-23T01:58:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.380+0000 7efec979d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:41.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.388+0000 7efec979d640 1 Processor -- start 2024-04-23T01:58:41.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.388+0000 7efec979d640 1 -- start start 2024-04-23T01:58:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec979d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efec4137f00 0x7efec413a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec979d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec40a1150 con 0x7efec4134e20 2024-04-23T01:58:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec979d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efec40a0b90 con 0x7efec4137f00 2024-04-23T01:58:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efec4134e20 0x7efec4135230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55196/0 (socket says 172.21.15.37:55196) 2024-04-23T01:58:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec2ffd640 1 -- 172.21.15.37:0/216428574 learned_addr learned my addr 172.21.15.37:0/216428574 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-04-23T01:58:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec27fc640 1 --2- 172.21.15.37:0/216428574 >> v2:172.21.15.37:3300/0 conn(0x7efec4137f00 0x7efec413a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec27fc640 1 -- 172.21.15.37:0/216428574 >> v1:172.21.15.37:6789/0 conn(0x7efec4134e20 legacy=0x7efec4135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec1ffb640 1 -- 172.21.15.37:0/216428574 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280065605 0 0) 0x7efec40a1150 con 0x7efec4134e20 2024-04-23T01:58:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.390+0000 7efec27fc640 1 -- 172.21.15.37:0/216428574 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec409f140 con 0x7efec4137f00 2024-04-23T01:58:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec27fc640 1 --2- 172.21.15.37:0/216428574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4137f00 0x7efec413a320 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ff46c809047ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec1ffb640 1 -- 172.21.15.37:0/216428574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efeac009d90 con 0x7efec4137f00 2024-04-23T01:58:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec1ffb640 1 -- 172.21.15.37:0/216428574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efeac00e230 con 0x7efec4137f00 2024-04-23T01:58:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec1ffb640 1 -- 172.21.15.37:0/216428574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efeac00e4d0 con 0x7efec4137f00 2024-04-23T01:58:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec979d640 1 -- 172.21.15.37:0/216428574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4137f00 msgr2=0x7efec413a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec979d640 1 --2- 172.21.15.37:0/216428574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4137f00 0x7efec413a320 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec979d640 1 -- 172.21.15.37:0/216428574 shutdown_connections 2024-04-23T01:58:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec979d640 1 --2- 172.21.15.37:0/216428574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4137f00 0x7efec413a320 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec979d640 1 -- 172.21.15.37:0/216428574 >> 172.21.15.37:0/216428574 conn(0x7efec40a1750 msgr2=0x7efec40a1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec979d640 1 -- 172.21.15.37:0/216428574 shutdown_connections 2024-04-23T01:58:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.391+0000 7efec979d640 1 -- 172.21.15.37:0/216428574 wait complete. 2024-04-23T01:58:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.392+0000 7efec979d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-23T01:58:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.394+0000 7efec979d640 1 Processor -- start 2024-04-23T01:58:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.394+0000 7efec979d640 1 -- start start 2024-04-23T01:58:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.395+0000 7efec979d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4134e20 0x7efec41c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:41.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.395+0000 7efec979d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efec41c9540 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.395+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4134e20 0x7efec41c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.395+0000 7efec2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4134e20 0x7efec41c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51208/0 (socket says 172.21.15.37:51208) 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.395+0000 7efec2ffd640 1 -- 172.21.15.37:0/3412423869 learned_addr learned my addr 172.21.15.37:0/3412423869 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.396+0000 7efec2ffd640 1 -- 172.21.15.37:0/3412423869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec4134bf0 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.396+0000 7efec2ffd640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4134e20 0x7efec41c9a70 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.396+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efebc004b80 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.396+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec4121430 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.396+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efebc004ce0 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.396+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efebc007120 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.396+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec4073320 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.397+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec4063880 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.397+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7efebc007320 con 0x7efec4134e20 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.397+0000 7efebb7fe640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efea4038930 0x7efea403ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T01:58:41.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.397+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(718..718 src has 609..718) ==== 3403+0+0 (crc 0 0 0) 0x7efebc0486b0 con 0x7efec4134e20 2024-04-23T01:58:41.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.398+0000 7efec27fc640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efea4038930 0x7efea403ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T01:58:41.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.398+0000 7efec27fc640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efea4038930 0x7efea403ae40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T01:58:41.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.403+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7efebc00a9e0 con 0x7efec4134e20 2024-04-23T01:58:41.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.594+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7efec4067b40 con 0x7efec4134e20 2024-04-23T01:58:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.600+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7efebc00a5d0 con 0x7efec4134e20 2024-04-23T01:58:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.600+0000 7efebb7fe640 1 -- 172.21.15.37:0/3412423869 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7efebc00a9e0 con 0x7efec4134e20 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efea4038930 msgr2=0x7efea403ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efea4038930 0x7efea403ae40 crc :-1 s=READY pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4134e20 msgr2=0x7efec41c9a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4134e20 0x7efec41c9a70 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 shutdown_connections 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.191:6800/790915015,v1:172.21.15.191:6801/790915015] conn(0x7efea4038930 0x7efea403ae40 unknown :-1 s=CLOSED pgs=3872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 --2- 172.21.15.37:0/3412423869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efec4134e20 0x7efec41c9a70 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 >> 172.21.15.37:0/3412423869 conn(0x7efec40a1750 msgr2=0x7efec41329f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T01:58:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 shutdown_connections 2024-04-23T01:58:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-23T01:58:41.602+0000 7efec979d640 1 -- 172.21.15.37:0/3412423869 wait complete. 2024-04-23T01:58:41.617 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-23T01:58:41.617 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-23T01:58:41.617 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-23T01:58:41.618 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T01:58:41.701 INFO:tasks.ceph.osd.0:Stopped 2024-04-23T01:58:41.701 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-23T01:58:41.701 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T01:58:41.776 INFO:tasks.ceph.osd.1:Stopped 2024-04-23T01:58:41.776 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-23T01:58:41.776 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T01:58:41.850 INFO:tasks.ceph.osd.2:Stopped 2024-04-23T01:58:41.850 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T01:58:41.850 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T01:58:41.935 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T01:58:41.935 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-23T01:58:41.936 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-23T01:58:41.936 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T01:58:41.962 INFO:tasks.ceph.mgr.x:Stopped 2024-04-23T01:58:41.962 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-23T01:58:41.963 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-23T01:58:41.963 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T01:58:41.977 INFO:tasks.ceph.mon.a:Stopped 2024-04-23T01:58:41.977 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-23T01:58:41.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-23T01:58:42.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-23T01:58:42.048 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-23T01:58:42.217 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2024-04-23T01:58:42.218 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-23T01:58:42.299 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-23T01:58:42.299 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-23T01:58:42.381 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi191.front.sepia.ceph.com 2024-04-23T01:58:42.381 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-23T01:58:42.446 INFO:tasks.ceph:Archiving mon data... 2024-04-23T01:58:42.447 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/data/mon.a.tgz 2024-04-23T01:58:42.447 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-04-23T01:58:42.462 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.yQebayE1ZT 2024-04-23T01:58:42.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yQebayE1ZT 2024-04-23T01:58:42.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.yQebayE1ZT 2024-04-23T01:58:42.674 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.yQebayE1ZT is 299KB 2024-04-23T01:58:42.743 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.yQebayE1ZT 2024-04-23T01:58:42.758 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-23T01:58:42.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T01:58:42.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T01:58:42.877 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T01:58:42.892 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T01:58:42.892 INFO:tasks.ceph:Archiving crash dumps... 2024-04-23T01:58:42.893 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/remote/smithi037/crash 2024-04-23T01:58:42.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T01:58:42.940 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/remote/smithi191/crash 2024-04-23T01:58:42.941 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T01:58:42.988 INFO:tasks.ceph:Compressing logs... 2024-04-23T01:58:42.988 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T01:58:42.991 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T01:58:43.057 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28203.log 2024-04-23T01:58:43.057 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-23T01:58:43.057 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.28203.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28203.log.gz 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28123.log 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28083.log 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.28123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28163.log 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28123.log.gz 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.28083.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.28083.log.gz 2024-04-23T01:58:43.058 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.28163.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.28163.log.gz 2024-04-23T01:58:43.091 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96398.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96503.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97085.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29342.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96398.log.gz 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97085.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96503.log.gz 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94580.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97085.log.gz 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93900.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94580.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29342.log.gz 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96825.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31619.log 2024-04-23T01:58:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30811.log 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31619.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.94580.log.gz 87.9% 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96825.log.gz 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94642.log 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97036.log 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30811.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.93900.log.gz 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95004.log 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96888.log 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97036.log.gz 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.94642.log.gz 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28207.log 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97642.log 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.31619.log.gz 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96888.log.gz 2024-04-23T01:58:43.093 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95004.log.gz 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29915.log 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97642.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.28207.log.gz 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29915.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97642.log.gz 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96591.log 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29915.log.gz 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29617.log/var/log/ceph/ceph.log: 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96972.log 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29617.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96591.log.gz 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94932.log 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29617.log.gz 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29916.log 2024-04-23T01:58:43.094 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96972.log: /var/log/ceph/ceph-client.admin.94932.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96972.log.gz 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29916.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.94932.log.gz 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94742.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29916.log.gz 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96682.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94372.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94742.log: /var/log/ceph/ceph-client.admin.96682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96547.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96682.log.gz 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29392.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94742.log.gz 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30064.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: 86.6%/var/log/ceph/ceph-client.admin.29392.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25887.log 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96547.log.gz 2024-04-23T01:58:43.095 INFO:teuthology.orchestra.run.smithi037.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94372.log.gz 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29392.log.gz 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28442.log 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30064.log.gz 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93691.log 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.25887.log: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.25887.log.gz 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94931.log 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28442.log: /var/log/ceph/ceph-client.admin.93691.log: gzip 84.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.28442.log.gz --verbose 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.94746.log 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31715.log 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94641.log 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.93691.log.gz 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94828.log 2024-04-23T01:58:43.096 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94931.log.gz 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95412.log 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.94746.log.gz 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94641.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31715.log.gz 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28471.log 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.94641.log.gz 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96846.log 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94828.log.gz 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94968.log 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28471.log.gz 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28286.log 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96846.log: /var/log/ceph/ceph-client.admin.94968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97726.log 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96846.log.gz 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.28286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94599.log 2024-04-23T01:58:43.097 INFO:teuthology.orchestra.run.smithi037.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.28286.log.gz 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94968.log.gz 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94037.log 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97432.log 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94599.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.97726.log.gz 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr: 67.7% -- replaced with /var/log/ceph/ceph-client.admin.94599.log.gz 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94896.log 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94037.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.30811.log.gz 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97432.log: gzip 92.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.95412.log.gz --verbose 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.96310.log 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97432.log.gz 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94640.log 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94896.log: /var/log/ceph/ceph-client.admin.96310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96419.log 2024-04-23T01:58:43.098 INFO:teuthology.orchestra.run.smithi037.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.94896.log.gz 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94827.log 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96310.log.gz 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96419.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96419.log.gz 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94827.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94640.log.gz 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29518.log 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96081.log 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29518.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94827.log.gz 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30341.log 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29518.log.gz 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97348.log 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96804.log 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30341.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.94037.log.gz 2024-04-23T01:58:43.099 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96081.log.gz 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96335.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97348.log.gz 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96804.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96804.log.gz 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.96335.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.93509.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95136.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96335.log.gz 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96546.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96377.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96440.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95136.log.gz 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95057.log 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96546.log.gz 2024-04-23T01:58:43.100 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29785.log 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96377.log.gz 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96440.log: /var/log/ceph/ceph-client.admin.95057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29936.log 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96637.log 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.93509.log.gz 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96440.log.gz 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.95057.log.gz 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29936.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29785.log.gz 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29620.log 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29936.log.gz 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.96637.log: /var/log/ceph/ceph-client.admin.95702.log 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.29620.log: /var/log/ceph/ceph-client.admin.29787.log 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96637.log.gz 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95702.log: gzip 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29620.log.gz 2024-04-23T01:58:43.101 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29618.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97264.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29787.log.gz 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29618.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97264.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29618.log.gz 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96706.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97264.log.gz 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.30341.log.gz 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95365.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94745.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95365.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31585.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96706.log.gz 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97390.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97684.log 2024-04-23T01:58:43.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97390.log: 88.4% 92.3% -- replaced with /var/log/ceph/ceph-client.admin.95702.log.gz 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94745.log.gz 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97390.log.gz 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94744.log 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31585.log.gz 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29619.log 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97684.log.gz 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93986.log 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:gzip/var/log/ceph/ceph-client.admin.29619.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31753.log 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93986.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29619.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94744.log.gz 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95914.log 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.31753.log: /var/log/ceph/ceph-client.admin.95153.log 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94692.log 2024-04-23T01:58:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95153.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93986.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95005.log 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94692.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94692.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93399.log 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr: 91.5%/var/log/ceph/ceph-client.admin.95005.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95365.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95914.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.95005.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97516.log 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96754.log 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29476.log 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95153.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97516.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96482.log 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr: 86.5%/var/log/ceph/ceph-client.admin.29476.log: -- replaced with /var/log/ceph/ceph-client.admin.96754.log.gz 2024-04-23T01:58:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96113.log 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29476.log.gz 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96612.log 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96482.log: /var/log/ceph/ceph-client.admin.96113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97768.log 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96612.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96482.log.gz 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96612.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97808.log 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97768.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.97768.log.gz 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96993.log 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97808.log.gz 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96778.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29434.log 2024-04-23T01:58:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94693.log 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96993.log: /var/log/ceph/ceph-client.admin.29434.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96993.log.gz 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29434.log.gz 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96356.log 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94693.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94693.log.gz 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29786.log 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97306.log 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29786.log: /var/log/ceph/ceph-client.admin.96356.log: 86.5% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96356.log.gz 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29786.log.gz 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29788.log 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97306.log: /var/log/ceph/ceph-client.admin.31638.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97306.log.gz 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95006.log 2024-04-23T01:58:43.106 INFO:teuthology.orchestra.run.smithi037.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29788.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29788.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.96113.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94604.log 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94603.log 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97558.log 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.95006.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93471.log 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94604.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97558.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.94603.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97558.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97060.log 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.93399.log.gz 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96728.log 2024-04-23T01:58:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93471.log: /var/log/ceph/ceph-client.admin.97060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96638.log 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96728.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.97060.log.gz 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93471.log.gz 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96951.log 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96728.log.gz 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.96638.log: -- /var/log/ceph/ceph-client.admin.96260.log 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96951.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.96638.log.gz 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97474.log 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96951.log.gz 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93862.log 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96260.log.gz 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94605.log 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.97474.log.gz 2024-04-23T01:58:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30022.log 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94605.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93862.log.gz 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31677.log 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30022.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94605.log.gz 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94969.log 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30022.log.gz 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29286.log 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94969.log: gzip -5 --verbose -- 85.8% -- replaced with /var/log/ceph/ceph-client.admin.94969.log.gz 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.96286.log 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93843.log 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29286.log.gz 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97015.log 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96286.log.gz 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:58:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93881.log 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97015.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93843.log.gz 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96867.log 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.97015.log.gz 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94691.log 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96867.log: /var/log/ceph/ceph-client.admin.93881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95089.log 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94691.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96867.log.gz 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93881.log.gz 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94691.log.gz 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96524.log 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96930.log 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96909.log 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96524.log.gz 2024-04-23T01:58:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31734.log 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.95089.log.gz 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96909.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96930.log.gz 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96909.log.gz 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.97600.log 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94451.log 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97600.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94743.log 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31734.log.gz 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97600.log.gz 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94829.log 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95595.log 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.31677.log.gz/var/log/ceph/ceph-client.admin.94829.log: 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94743.log.gz 2024-04-23T01:58:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96461.log 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94829.log.gz 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.95595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30106.log 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.96461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97222.log 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96461.log.gz 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30106.log: 91.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.95595.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.93919.log 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30106.log.gz 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93728.log 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97222.log.gz 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97109.log 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.93728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94895.log 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.97109.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.97109.log.gz 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93919.log.gz 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.94895.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93728.log.gz 2024-04-23T01:58:43.112 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94895.log.gz 2024-04-23T01:58:43.113 INFO:teuthology.orchestra.run.smithi037.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.94451.log.gz 2024-04-23T01:58:43.269 INFO:teuthology.orchestra.run.smithi191.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-23T01:58:43.471 INFO:teuthology.orchestra.run.smithi037.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31753.log.gz 2024-04-23T01:58:44.579 INFO:teuthology.orchestra.run.smithi037.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-23T01:58:47.694 INFO:teuthology.orchestra.run.smithi191.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-23T01:58:48.212 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-23T01:58:48.282 INFO:teuthology.orchestra.run.smithi191.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-23T01:58:48.284 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-04-23T01:58:48.284 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m5.241s 2024-04-23T01:58:48.284 INFO:teuthology.orchestra.run.smithi191.stderr:user 0m9.676s 2024-04-23T01:58:48.284 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m0.413s 2024-04-23T01:58:48.351 INFO:teuthology.orchestra.run.smithi037.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-23T01:58:48.354 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-23T01:58:48.354 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m5.351s 2024-04-23T01:58:48.354 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m12.180s 2024-04-23T01:58:48.354 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.544s 2024-04-23T01:58:48.354 INFO:tasks.ceph:Archiving logs... 2024-04-23T01:58:48.354 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/remote/smithi037/log 2024-04-23T01:58:48.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T01:58:50.485 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/remote/smithi191/log 2024-04-23T01:58:50.486 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T01:58:52.066 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T01:58:52.080 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T01:58:52.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T01:58:52.083 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T01:58:52.168 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T01:58:52.176 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T01:58:52.176 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T01:58:52.179 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T01:58:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-23T01:58:52.195 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-04-23T01:58:52.203 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T01:58:52.203 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-23T01:58:52.203 INFO:teuthology.orchestra.run.smithi037.stdout:^- hv01.front.sepia.ceph.com 2 7 377 123 +920us[ +924us] +/- 586ms 2024-04-23T01:58:52.204 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 -819us[ -813us] +/- 61ms 2024-04-23T01:58:52.204 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 122 +869us[ +873us] +/- 70ms 2024-04-23T01:58:52.204 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:58:52.205 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T01:58:52.205 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-04-23T01:58:52.205 INFO:teuthology.orchestra.run.smithi191.stdout:^- hv01.front.sepia.ceph.com 2 6 377 57 +919us[ +919us] +/- 587ms 2024-04-23T01:58:52.205 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv02.front.sepia.ceph.com 3 6 377 58 -793us[ -786us] +/- 61ms 2024-04-23T01:58:52.205 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +879us[ +879us] +/- 71ms 2024-04-23T01:58:52.205 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T01:58:52.206 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T01:58:52.229 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T01:58:52.229 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T01:58:52.258 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T01:58:52.324 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T01:58:52.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T01:58:52.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:58:52.415 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T01:58:52.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:58:52.442 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T01:58:52.452 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T01:58:52.488 INFO:teuthology.task.internal:Duration was 1700.765150 seconds 2024-04-23T01:58:52.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T01:58:52.552 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T01:58:52.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T01:58:52.555 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T01:58:52.593 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T01:58:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T01:58:52.898 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T01:58:52.899 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-04-23T01:58:52.899 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T01:58:52.962 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-04-23T01:58:52.962 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T01:58:52.987 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T01:58:52.987 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T01:58:53.004 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T01:58:53.053 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T01:58:53.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T01:58:53.074 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T01:58:53.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T01:58:53.196 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T01:58:53.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T01:58:53.223 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T01:58:53.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T01:58:53.257 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T01:58:53.265 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T01:58:53.286 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-04-23T01:58:53.309 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-04-23T01:58:53.348 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T01:58:53.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:58:53.363 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T01:58:53.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T01:58:53.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T01:58:53.415 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T01:58:53.416 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/remote/smithi037 2024-04-23T01:58:53.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T01:58:53.450 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2024-04-23_01:23:55-crimson-rados-ci-yingxin-crimson-fix-tri-mutex-4-distro-default-smithi/7669446/remote/smithi191 2024-04-23T01:58:53.451 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T01:58:53.483 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T01:58:53.483 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T01:58:53.488 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T01:58:53.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T01:58:53.542 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T01:58:53.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T01:58:53.580 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T01:58:53.580 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T01:58:53.583 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T01:58:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 01:58 /home/ubuntu/cephtest 2024-04-23T01:58:53.597 INFO:teuthology.orchestra.run.smithi191.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 01:58 /home/ubuntu/cephtest 2024-04-23T01:58:53.598 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T01:58:53.644 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T01:58:53.732 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 1700.765150308609 flavor: crimson owner: scheduled_yingxin@teuthology success: true 2024-04-23T01:58:53.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T01:58:53.813 INFO:teuthology.run:pass