2024-09-21T21:09:10.349 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T21:09:10.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T21:09:10.446 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329 branch: main description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914329' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 2950 sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 sleep_before_teardown: 0 subset: 0/1 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFqIDO1EE8YOS5rYSCDKE4ioqOr7Oly3SdNMePm11lFfoK8rF9ooyHy3u1qWwi0EtrNFgGgpIU5pkIk0UjJzmQ= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNofoI9RTDpSav0EWdpfIdr6bPevI+pMmicw7CZkjX5gajnIp9bzXaP/9zmd1n7xe3IF7UAtSytmGTc1In+//hk= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_20:56:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T21:09:10.447 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa; will attempt to use it 2024-09-21T21:09:10.852 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa/tasks 2024-09-21T21:09:10.853 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T21:09:10.855 INFO:teuthology.task.internal:Checking packages... 2024-09-21T21:09:10.876 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '62da54b4b83a96ca9976b7e1d0c8272a564a2208' 2024-09-21T21:09:10.876 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T21:09:10.876 INFO:teuthology.packaging:ref: None 2024-09-21T21:09:10.876 INFO:teuthology.packaging:tag: None 2024-09-21T21:09:10.876 INFO:teuthology.packaging:branch: main 2024-09-21T21:09:10.876 INFO:teuthology.packaging:sha1: 62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-21T21:09:10.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=main 2024-09-21T21:09:11.098 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5092.g62da54b4 2024-09-21T21:09:11.099 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T21:09:11.106 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T21:09:11.106 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T21:09:11.115 INFO:teuthology.task.internal:Saving configuration 2024-09-21T21:09:11.127 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T21:09:11.134 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T21:09:11.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 21:04:04.738068', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFqIDO1EE8YOS5rYSCDKE4ioqOr7Oly3SdNMePm11lFfoK8rF9ooyHy3u1qWwi0EtrNFgGgpIU5pkIk0UjJzmQ='} 2024-09-21T21:09:11.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 21:04:04.736620', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNofoI9RTDpSav0EWdpfIdr6bPevI+pMmicw7CZkjX5gajnIp9bzXaP/9zmd1n7xe3IF7UAtSytmGTc1In+//hk='} 2024-09-21T21:09:11.183 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T21:09:11.189 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-21T21:09:11.190 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-21T21:09:11.190 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T21:09:11.254 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffb5da40160>, signals=[15]) 2024-09-21T21:09:11.255 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T21:09:11.260 INFO:teuthology.task.internal:Opening connections... 2024-09-21T21:09:11.261 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-09-21T21:09:11.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:09:11.340 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T21:09:11.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:09:11.419 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T21:09:11.425 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-09-21T21:09:11.443 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-09-21T21:09:11.444 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-09-21T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-09-21T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-09-21T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-09-21T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-09-21T21:09:11.502 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T21:09:11.503 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T21:09:11.504 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-09-21T21:09:11.524 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-21T21:09:11.541 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-21T21:09:11.541 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-21T21:09:11.598 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T21:09:11.599 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T21:09:11.599 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T21:09:11.599 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-21T21:09:11.623 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T21:09:11.639 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T21:09:11.689 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T21:09:11.690 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-09-21T21:09:11.692 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-21T21:09:11.708 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T21:09:11.714 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T21:09:11.714 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-09-21T21:09:11.750 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-21T21:09:11.847 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T21:09:11.902 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T21:09:11.916 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T21:09:11.916 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T21:09:11.916 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T21:09:11.917 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T21:09:11.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:09:11.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:09:11.934 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-21T21:09:11.934 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-21T21:09:11.991 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-503.el9.x86_64 2024-09-21T21:09:11.991 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-503.el9.x86_64 2024-09-21T21:09:11.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-09-21T21:09:11.992 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-503.el9.x86_64 2024-09-21T21:09:11.993 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-503.el9.x86_64 2024-09-21T21:09:11.993 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2024-09-21T21:09:14.264 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T21:09:14.428 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T21:09:16.087 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-21T21:09:19.523 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 20 MB 00:04 2024-09-21T21:09:20.555 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-21T21:09:22.055 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 19 kB 00:00 2024-09-21T21:09:23.509 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-21T21:09:25.332 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-21T21:09:26.866 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-21T21:09:28.320 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-21T21:09:28.831 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-21T21:09:30.705 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T21:09:30.705 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T21:09:30.801 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:09:30.810 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:09:30.810 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-21T21:09:30.810 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2024-09-21T21:09:30.811 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:09:30.812 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 79 M 2024-09-21T21:09:30.812 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 126 M 2024-09-21T21:09:30.812 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:09:31.200 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 375 kB/s | 36 kB 00:00 2024-09-21T21:09:31.458 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-21T21:09:31.859 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 46 MB/s | 35 MB 00:00 2024-09-21T21:09:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 28 MB/s | 29 MB 00:01 2024-09-21T21:09:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:09:32.209 INFO:teuthology.orchestra.run.smithi148.stdout:Total 56 MB/s | 79 MB 00:01 2024-09-21T21:09:32.888 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:09:33.245 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:09:33.245 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:09:34.001 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-21T21:09:34.202 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:09:34.202 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:09:35.974 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T21:09:35.974 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T21:09:36.074 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:09:36.087 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:09:36.087 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-21T21:09:36.087 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:09:36.087 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 79 M 2024-09-21T21:09:36.088 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 126 M 2024-09-21T21:09:36.089 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:09:36.219 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 452 kB/s | 36 kB 00:00 2024-09-21T21:09:36.603 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 34 MB/s | 16 MB 00:00 2024-09-21T21:09:36.655 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:09:37.094 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 33 MB/s | 29 MB 00:00 2024-09-21T21:09:37.336 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:09:37.426 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:09:39.111 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-21T21:09:39.111 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:09:39.111 INFO:teuthology.orchestra.run.smithi005.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-21T21:09:39.820 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:09:40.197 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:09:40.225 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:09:40.225 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:09:40.335 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:09:41.208 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:09:41.208 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:09:43.763 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:09:44.440 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:09:44.528 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:09:45.163 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:09:45.260 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:09:47.280 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:09:47.406 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:09:50.103 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:09:52.521 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:09:52.565 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:09:57.706 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:28.292 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:28.333 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:28.679 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:28.679 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:10:28.679 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:10:28.680 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:10:29.490 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:10:29.817 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:10:29.938 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:10:29.938 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:10:29.938 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T21:10:29.939 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T21:10:29.939 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T21:10:29.939 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-21T21:10:29.939 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T21:10:29.939 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:10:29.996 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:10:29.997 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:10:29.997 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2024-09-21T21:10:30.035 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 82.el9 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8274670 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T21:10:30.036 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:10:30.037 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T21:10:30.038 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T21:10:30.038 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-508.el9.x86_64 2024-09-21T21:10:30.038 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T21:10:30.726 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2024-09-21T21:10:32.055 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T21:10:32.084 INFO:teuthology.orchestra.run.smithi148.stderr:done 2024-09-21T21:10:32.087 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2024-09-21T21:10:32.102 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.WmJUwPfIhQ 2024-09-21T21:10:32.102 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.WmJUwPfIhQ 2024-09-21T21:10:32.168 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.WmJUwPfIhQ 2024-09-21T21:10:32.312 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.WmJUwPfIhQ is 6KB 2024-09-21T21:10:32.361 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.WmJUwPfIhQ 2024-09-21T21:10:32.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T21:10:32.438 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T21:10:32.438 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T21:10:32.438 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T21:10:32.439 INFO:teuthology.orchestra.run.smithi148.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T21:10:32.440 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T21:10:32.612 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2024-09-21T21:10:36.752 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:36.795 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:37.153 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:37.153 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T21:10:37.154 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T21:10:37.154 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T21:10:37.973 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T21:10:37.973 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:10:37.973 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:10:37.973 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T21:10:37.973 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T21:10:37.973 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T21:10:37.974 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T21:10:37.974 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:10:37.974 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:10:38.300 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:10:38.432 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:10:38.433 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:10:38.433 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T21:10:38.433 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T21:10:38.433 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T21:10:38.433 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T21:10:38.433 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T21:10:38.433 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T21:10:38.491 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T21:10:38.492 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T21:10:38.492 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-09-21T21:10:38.528 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-09-21T21:10:38.528 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 82.el9 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8274670 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T21:10:38.529 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:10:38.530 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T21:10:38.531 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T21:10:38.531 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 5.14.0-508.el9.x86_64 2024-09-21T21:10:38.531 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T21:10:39.192 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-09-21T21:10:40.520 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T21:10:40.550 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-09-21T21:10:40.561 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-21T21:10:40.595 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.k2DXUeIlAC 2024-09-21T21:10:40.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.k2DXUeIlAC 2024-09-21T21:10:40.661 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.k2DXUeIlAC 2024-09-21T21:10:40.806 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.k2DXUeIlAC is 6KB 2024-09-21T21:10:40.853 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.k2DXUeIlAC 2024-09-21T21:10:40.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T21:10:40.930 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T21:10:40.930 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T21:10:40.930 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T21:10:40.930 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T21:10:40.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T21:10:41.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-09-21T21:11:02.636 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-21T21:11:02.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T21:11:02.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:11:11.090 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T21:11:11.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-21T21:11:11.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:11:21.071 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-21T21:11:29.519 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-09-21T21:11:30.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T21:11:30.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:11:33.135 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-21T21:11:38.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-21T21:11:38.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:11:45.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T21:11:45.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:12:03.567 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-09-21T21:12:18.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T21:12:18.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:12:18.993 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-21T21:12:19.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T21:12:19.381 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-21T21:12:19.382 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2024-09-21T21:12:19.396 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-508.el9.x86_64 2024-09-21T21:12:19.396 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T21:12:19.396 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T21:12:19.397 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T21:12:20.398 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-21T21:12:20.398 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T21:12:20.476 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2024-09-21T21:12:20.498 DEBUG:teuthology.parallel:result is None 2024-09-21T21:12:38.527 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T21:12:50.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-21T21:12:50.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:12:50.781 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-21T21:12:51.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-21T21:12:51.162 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T21:12:51.162 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-21T21:12:51.180 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-508.el9.x86_64 2024-09-21T21:12:51.180 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T21:12:51.181 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T21:12:51.181 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T21:12:52.181 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T21:12:52.182 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T21:12:52.264 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-09-21T21:12:52.287 DEBUG:teuthology.parallel:result is None 2024-09-21T21:12:52.288 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T21:12:52.300 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T21:12:52.300 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T21:12:52.303 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T21:12:52.322 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T21:12:52.328 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T21:12:52.351 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T21:12:52.352 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T21:12:52.362 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T21:12:52.427 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T21:12:52.433 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T21:12:52.433 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T21:12:52.436 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T21:12:52.467 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:12:52.472 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:12:52.479 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:12:52.484 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T21:12:52.486 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T21:12:52.492 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T21:12:52.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T21:12:52.530 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T21:12:52.557 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T21:12:52.566 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T21:12:52.566 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T21:12:52.599 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T21:12:52.615 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:12:52.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:12:52.748 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:12:52.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:12:52.874 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:12:52.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T21:12:52.941 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:12:52.986 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T21:12:53.031 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:12:53.111 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T21:12:53.155 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:12:53.155 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T21:12:53.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-09-21T21:12:53.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-21T21:12:53.274 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T21:12:53.305 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T21:12:53.715 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T21:12:53.722 INFO:teuthology.task.internal:Starting timer... 2024-09-21T21:12:53.722 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T21:12:53.732 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T21:12:53.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-09-21T21:12:53.798 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-09-21T21:12:53.800 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-21T21:12:53.838 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-21T21:12:53.839 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T21:12:53.840 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-09-21T21:12:53.860 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-09-21T21:12:53.860 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-21T21:12:53.897 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-21T21:12:53.897 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2024-09-21T21:12:53.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T21:12:53.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:12:53.928 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T21:12:53.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:12:53.963 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T21:12:53.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-09-21T21:12:54.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-21T21:12:54.035 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T21:12:54.044 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T21:12:54.056 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T21:12:54.057 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T21:16:56.007 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2024-09-21T21:16:56.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-21T21:16:56.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:16:56.103 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-21T21:16:56.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-21T21:16:56.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T21:16:56.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T21:16:56.267 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-21T21:16:56.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T21:16:56.350 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T21:16:56.361 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T21:16:56.361 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T21:16:56.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T21:16:56.364 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T21:16:56.365 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T21:16:56.394 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T21:16:56.409 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T21:16:56.421 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T21:16:56.434 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-09-21T21:16:56.439 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T21:16:56.445 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-09-21T21:16:56.460 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T21:16:56.462 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-21T21:16:56.473 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-21T21:16:56.475 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T21:16:56.488 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T21:16:56.503 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T21:16:56.533 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-21T21:16:56.536 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T21:16:56.536 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-21T21:16:56.536 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.537 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.537 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.537 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.555 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T21:16:56.558 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T21:16:56.558 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T21:16:56.558 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.559 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.559 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.559 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:16:56.560 INFO:teuthology.run_tasks:Running task install... 2024-09-21T21:16:56.568 DEBUG:teuthology.task.install:project ceph 2024-09-21T21:16:56.568 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}} 2024-09-21T21:16:56.568 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'} 2024-09-21T21:16:56.568 INFO:teuthology.task.install:Using flavor: crimson 2024-09-21T21:16:56.575 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T21:16:56.575 INFO:teuthology.task.install:extra packages: [] 2024-09-21T21:16:56.575 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'tag': None, 'wait_for_package': False} 2024-09-21T21:16:56.576 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-21T21:16:56.577 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'tag': None, 'wait_for_package': False} 2024-09-21T21:16:56.578 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-21T21:16:56.720 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/ 2024-09-21T21:16:56.720 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5092.g62da54b4 2024-09-21T21:16:56.725 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/ 2024-09-21T21:16:56.725 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5092.g62da54b4 2024-09-21T21:16:56.830 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T21:16:56.830 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:16:56.830 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T21:16:56.837 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/62da54b4b83a96ca9976b7e1d0c8272a564a2208/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T21:16:56.838 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:16:56.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T21:16:56.857 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T21:16:56.857 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/62da54b4b83a96ca9976b7e1d0c8272a564a2208/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T21:16:56.864 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T21:16:56.864 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/62da54b4b83a96ca9976b7e1d0c8272a564a2208/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T21:16:56.924 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T21:16:56.931 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T21:16:57.000 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T21:16:57.007 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T21:16:57.064 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-21T21:16:57.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-21T21:16:57.072 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-09-21T21:16:57.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-09-21T21:16:57.299 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-21T21:16:57.318 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-09-21T21:16:57.326 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw 2024-09-21T21:16:57.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw 2024-09-21T21:16:57.885 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 325 kB/s | 88 kB 00:00 2024-09-21T21:16:57.919 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 321 kB/s | 88 kB 00:00 2024-09-21T21:16:58.186 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T21:16:58.211 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T21:16:58.462 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-21T21:16:58.486 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 8.8 kB/s | 2.1 kB 00:00 2024-09-21T21:16:58.920 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.3 MB 00:00 2024-09-21T21:16:59.012 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T21:17:00.822 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-21T21:17:00.880 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-21T21:17:05.156 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T21:17:06.072 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 6.5 MB 00:01 2024-09-21T21:17:06.899 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 92 kB/s | 19 kB 00:00 2024-09-21T21:17:07.582 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 19 kB 00:00 2024-09-21T21:17:08.328 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-21T21:17:08.761 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T21:17:13.767 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T21:17:14.291 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T21:17:16.001 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 10 M 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-21T21:17:16.005 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.8 M 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.1 M 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 20 M 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 25 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 808 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T21:17:16.006 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 558 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.4 M 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 45 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 148 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 159 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 314 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 302 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 99 k 2024-09-21T21:17:16.007 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout:Install 31 Packages 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2024-09-21T21:17:16.008 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:16.009 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 60 M 2024-09-21T21:17:16.009 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:17:16.629 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 10 M 2024-09-21T21:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-09-21T21:17:16.644 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.8 M 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.1 M 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 20 M 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 25 k 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 808 k 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T21:17:16.645 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 558 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.4 M 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 45 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 148 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 159 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 314 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 302 k 2024-09-21T21:17:16.646 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 99 k 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout:Install 31 Packages 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 2 Packages 2024-09-21T21:17:16.647 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:16.648 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 60 M 2024-09-21T21:17:16.648 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:17:16.835 INFO:teuthology.orchestra.run.smithi148.stdout:(1/33): ceph-base-19.3.0-5092.g62da54b4.el9.x86 12 MB/s | 6.1 MB 00:00 2024-09-21T21:17:16.885 INFO:teuthology.orchestra.run.smithi148.stdout:(2/33): ceph-selinux-19.3.0-5092.g62da54b4.el9. 504 kB/s | 25 kB 00:00 2024-09-21T21:17:16.994 INFO:teuthology.orchestra.run.smithi148.stdout:(3/33): libcephfs2-19.3.0-5092.g62da54b4.el9.x8 7.3 MB/s | 808 kB 00:00 2024-09-21T21:17:17.085 INFO:teuthology.orchestra.run.smithi148.stdout:(4/33): libradosstriper1-19.3.0-5092.g62da54b4. 6.0 MB/s | 558 kB 00:00 2024-09-21T21:17:17.286 INFO:teuthology.orchestra.run.smithi148.stdout:(5/33): ceph-radosgw-19.3.0-5092.g62da54b4.el9. 11 MB/s | 10 MB 00:00 2024-09-21T21:17:17.486 INFO:teuthology.orchestra.run.smithi148.stdout:(6/33): ceph-common-19.3.0-5092.g62da54b4.el9.x 17 MB/s | 20 MB 00:01 2024-09-21T21:17:17.511 INFO:teuthology.orchestra.run.smithi148.stdout:(7/33): python3-ceph-argparse-19.3.0-5092.g62da 200 kB/s | 45 kB 00:00 2024-09-21T21:17:17.536 INFO:teuthology.orchestra.run.smithi148.stdout:(8/33): python3-ceph-common-19.3.0-5092.g62da54 2.9 MB/s | 148 kB 00:00 2024-09-21T21:17:17.561 INFO:teuthology.orchestra.run.smithi148.stdout:(9/33): python3-cephfs-19.3.0-5092.g62da54b4.el 3.1 MB/s | 159 kB 00:00 2024-09-21T21:17:17.587 INFO:teuthology.orchestra.run.smithi148.stdout:(10/33): python3-rados-19.3.0-5092.g62da54b4.el 6.1 MB/s | 314 kB 00:00 2024-09-21T21:17:17.662 INFO:teuthology.orchestra.run.smithi148.stdout:(11/33): librgw2-19.3.0-5092.g62da54b4.el9.x86_ 9.3 MB/s | 5.4 MB 00:00 2024-09-21T21:17:17.688 INFO:teuthology.orchestra.run.smithi148.stdout:(12/33): python3-rgw-19.3.0-5092.g62da54b4.el9. 990 kB/s | 99 kB 00:00 2024-09-21T21:17:17.721 INFO:teuthology.orchestra.run.smithi148.stdout:(13/33): python3-rbd-19.3.0-5092.g62da54b4.el9. 1.9 MB/s | 302 kB 00:00 2024-09-21T21:17:17.791 INFO:teuthology.orchestra.run.smithi148.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 838 kB/s | 107 kB 00:00 2024-09-21T21:17:17.832 INFO:teuthology.orchestra.run.smithi148.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-21T21:17:17.857 INFO:teuthology.orchestra.run.smithi148.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-21T21:17:17.885 INFO:teuthology.orchestra.run.smithi148.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 492 kB/s | 45 kB 00:00 2024-09-21T21:17:17.941 INFO:teuthology.orchestra.run.smithi148.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-21T21:17:17.951 INFO:teuthology.orchestra.run.smithi005.stdout:(1/33): ceph-base-19.3.0-5092.g62da54b4.el9.x86 9.5 MB/s | 6.1 MB 00:00 2024-09-21T21:17:17.967 INFO:teuthology.orchestra.run.smithi148.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 505 kB/s | 42 kB 00:00 2024-09-21T21:17:17.992 INFO:teuthology.orchestra.run.smithi148.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-21T21:17:18.042 INFO:teuthology.orchestra.run.smithi148.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-21T21:17:18.067 INFO:teuthology.orchestra.run.smithi148.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 357 kB/s | 36 kB 00:00 2024-09-21T21:17:18.093 INFO:teuthology.orchestra.run.smithi148.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-09-21T21:17:18.093 INFO:teuthology.orchestra.run.smithi005.stdout:(2/33): ceph-radosgw-19.3.0-5092.g62da54b4.el9. 13 MB/s | 10 MB 00:00 2024-09-21T21:17:18.110 INFO:teuthology.orchestra.run.smithi005.stdout:(3/33): ceph-selinux-19.3.0-5092.g62da54b4.el9. 158 kB/s | 25 kB 00:00 2024-09-21T21:17:18.151 INFO:teuthology.orchestra.run.smithi148.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T21:17:18.152 INFO:teuthology.orchestra.run.smithi005.stdout:(4/33): libcephfs2-19.3.0-5092.g62da54b4.el9.x8 14 MB/s | 808 kB 00:00 2024-09-21T21:17:18.177 INFO:teuthology.orchestra.run.smithi148.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T21:17:18.193 INFO:teuthology.orchestra.run.smithi005.stdout:(5/33): libradosstriper1-19.3.0-5092.g62da54b4. 6.5 MB/s | 558 kB 00:00 2024-09-21T21:17:18.202 INFO:teuthology.orchestra.run.smithi148.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 276 kB/s | 26 kB 00:00 2024-09-21T21:17:18.227 INFO:teuthology.orchestra.run.smithi148.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T21:17:18.252 INFO:teuthology.orchestra.run.smithi005.stdout:(6/33): python3-ceph-argparse-19.3.0-5092.g62da 773 kB/s | 45 kB 00:00 2024-09-21T21:17:18.261 INFO:teuthology.orchestra.run.smithi148.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T21:17:18.294 INFO:teuthology.orchestra.run.smithi148.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-21T21:17:18.344 INFO:teuthology.orchestra.run.smithi005.stdout:(7/33): python3-ceph-common-19.3.0-5092.g62da54 1.6 MB/s | 148 kB 00:00 2024-09-21T21:17:18.378 INFO:teuthology.orchestra.run.smithi148.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-21T21:17:18.430 INFO:teuthology.orchestra.run.smithi005.stdout:(8/33): librgw2-19.3.0-5092.g62da54b4.el9.x86_6 19 MB/s | 5.4 MB 00:00 2024-09-21T21:17:18.455 INFO:teuthology.orchestra.run.smithi005.stdout:(9/33): python3-cephfs-19.3.0-5092.g62da54b4.el 1.4 MB/s | 159 kB 00:00 2024-09-21T21:17:18.489 INFO:teuthology.orchestra.run.smithi005.stdout:(10/33): python3-rados-19.3.0-5092.g62da54b4.el 5.2 MB/s | 314 kB 00:00 2024-09-21T21:17:18.495 INFO:teuthology.orchestra.run.smithi148.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T21:17:18.554 INFO:teuthology.orchestra.run.smithi148.stdout:(32/33): librados2-19.3.0-5092.g62da54b4.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-21T21:17:18.654 INFO:teuthology.orchestra.run.smithi148.stdout:(33/33): librbd1-19.3.0-5092.g62da54b4.el9.x86_ 14 MB/s | 3.8 MB 00:00 2024-09-21T21:17:18.659 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:17:18.659 INFO:teuthology.orchestra.run.smithi148.stdout:Total 23 MB/s | 60 MB 00:02 2024-09-21T21:17:18.681 INFO:teuthology.orchestra.run.smithi005.stdout:(11/33): ceph-common-19.3.0-5092.g62da54b4.el9. 14 MB/s | 20 MB 00:01 2024-09-21T21:17:18.706 INFO:teuthology.orchestra.run.smithi005.stdout:(12/33): python3-rgw-19.3.0-5092.g62da54b4.el9. 458 kB/s | 99 kB 00:00 2024-09-21T21:17:18.731 INFO:teuthology.orchestra.run.smithi005.stdout:(13/33): python3-rbd-19.3.0-5092.g62da54b4.el9. 1.1 MB/s | 302 kB 00:00 2024-09-21T21:17:18.776 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:17:18.813 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:17:18.813 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:17:18.873 INFO:teuthology.orchestra.run.smithi005.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 557 kB/s | 107 kB 00:00 2024-09-21T21:17:18.899 INFO:teuthology.orchestra.run.smithi005.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 887 kB/s | 171 kB 00:00 2024-09-21T21:17:18.924 INFO:teuthology.orchestra.run.smithi005.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-21T21:17:18.957 INFO:teuthology.orchestra.run.smithi005.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 710 kB/s | 160 kB 00:00 2024-09-21T21:17:19.008 INFO:teuthology.orchestra.run.smithi005.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 844 kB/s | 42 kB 00:00 2024-09-21T21:17:19.033 INFO:teuthology.orchestra.run.smithi005.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-21T21:17:19.113 INFO:teuthology.orchestra.run.smithi005.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-09-21T21:17:19.184 INFO:teuthology.orchestra.run.smithi005.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 239 kB/s | 36 kB 00:00 2024-09-21T21:17:19.209 INFO:teuthology.orchestra.run.smithi005.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 501 kB/s | 47 kB 00:00 2024-09-21T21:17:19.234 INFO:teuthology.orchestra.run.smithi005.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 976 kB/s | 221 kB 00:00 2024-09-21T21:17:19.293 INFO:teuthology.orchestra.run.smithi005.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T21:17:19.318 INFO:teuthology.orchestra.run.smithi005.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T21:17:19.344 INFO:teuthology.orchestra.run.smithi005.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 280 kB/s | 26 kB 00:00 2024-09-21T21:17:19.369 INFO:teuthology.orchestra.run.smithi005.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T21:17:19.394 INFO:teuthology.orchestra.run.smithi005.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T21:17:19.444 INFO:teuthology.orchestra.run.smithi005.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-21T21:17:19.477 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:17:19.477 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:17:19.520 INFO:teuthology.orchestra.run.smithi005.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T21:17:19.628 INFO:teuthology.orchestra.run.smithi005.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T21:17:19.930 INFO:teuthology.orchestra.run.smithi005.stdout:(32/33): librados2-19.3.0-5092.g62da54b4.el9.x8 7.2 MB/s | 3.5 MB 00:00 2024-09-21T21:17:20.354 INFO:teuthology.orchestra.run.smithi005.stdout:(33/33): librbd1-19.3.0-5092.g62da54b4.el9.x86_ 4.6 MB/s | 3.8 MB 00:00 2024-09-21T21:17:20.360 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:17:20.360 INFO:teuthology.orchestra.run.smithi005.stdout:Total 16 MB/s | 60 MB 00:03 2024-09-21T21:17:20.474 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:17:20.516 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:17:20.517 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:17:20.972 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:17:21.226 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:17:21.227 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:17:21.494 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-21T21:17:21.548 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-21T21:17:21.664 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-21T21:17:21.753 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-21T21:17:21.783 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-21T21:17:21.845 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-21T21:17:21.884 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-21T21:17:21.912 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-21T21:17:21.937 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-21T21:17:21.960 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-21T21:17:21.981 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-21T21:17:22.170 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-21T21:17:22.201 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-21T21:17:22.244 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-21T21:17:22.288 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 11/35 2024-09-21T21:17:22.317 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-21T21:17:22.396 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-21T21:17:22.422 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-21T21:17:22.511 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-21T21:17:22.547 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-21T21:17:22.653 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-21T21:17:22.681 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-21T21:17:22.732 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-21T21:17:22.762 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-21T21:17:22.784 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:17:22.791 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-21T21:17:22.828 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-21T21:17:23.190 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-21T21:17:23.246 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-21T21:17:23.300 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-21T21:17:23.336 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-21T21:17:23.367 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 24/35 2024-09-21T21:17:23.381 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-21T21:17:23.403 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-21T21:17:23.465 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-21T21:17:23.558 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-21T21:17:23.583 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-21T21:17:23.670 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-21T21:17:23.708 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-21T21:17:23.737 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-21T21:17:23.771 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-21T21:17:23.802 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-21T21:17:23.826 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-21T21:17:23.971 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-21T21:17:23.998 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-21T21:17:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-21T21:17:24.060 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-21T21:17:24.077 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-21T21:17:24.104 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-21T21:17:24.148 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 11/35 2024-09-21T21:17:24.160 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 28/35 2024-09-21T21:17:24.177 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-21T21:17:24.192 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 29/35 2024-09-21T21:17:24.268 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-21T21:17:24.290 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-21T21:17:24.363 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 14/35 2024-09-21T21:17:24.406 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-21T21:17:24.516 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-21T21:17:24.548 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-21T21:17:24.594 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-21T21:17:24.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-21T21:17:24.651 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-21T21:17:24.688 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-21T21:17:25.062 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-21T21:17:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-21T21:17:25.239 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 23/35 2024-09-21T21:17:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 24/35 2024-09-21T21:17:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-21T21:17:25.916 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-21T21:17:25.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-21T21:17:26.013 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 27/35 2024-09-21T21:17:26.098 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 28/35 2024-09-21T21:17:26.136 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 29/35 2024-09-21T21:17:26.706 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-21T21:17:26.746 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-21T21:17:27.452 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-21T21:17:27.492 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-21T21:17:27.585 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-21T21:17:27.585 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T21:17:27.585 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T21:17:27.586 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:27.618 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-21T21:17:29.072 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-21T21:17:29.108 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-21T21:17:29.843 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 30/35 2024-09-21T21:17:29.878 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-21T21:17:29.970 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 31/35 2024-09-21T21:17:29.970 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T21:17:29.970 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T21:17:29.970 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:30.004 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-21T21:17:38.213 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-21T21:17:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-21T21:17:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-21T21:17:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-21T21:17:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-21T21:17:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-21T21:17:38.213 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-21T21:17:38.214 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-21T21:17:38.214 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:39.299 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-21T21:17:39.326 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-21T21:17:39.326 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:17:39.326 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T21:17:39.326 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:17:39.326 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:17:39.326 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:39.328 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T21:17:39.427 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T21:17:39.427 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T21:17:40.718 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-09-21T21:17:40.719 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:40.848 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T21:17:40.848 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 1/35 2024-09-21T21:17:40.848 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-21T21:17:40.848 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-21T21:17:40.848 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-21T21:17:40.848 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 5/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 6/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 7/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 8/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 9/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 10/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 11/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 13/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-21T21:17:40.849 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-21T21:17:40.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-21T21:17:40.851 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-21T21:17:40.851 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 34/35 2024-09-21T21:17:41.839 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-21T21:17:41.867 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 33/35 2024-09-21T21:17:41.867 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:17:41.868 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T21:17:41.868 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:17:41.868 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T21:17:41.868 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:41.869 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T21:17:41.893 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T21:17:41.894 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.895 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:41.896 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:17:41.967 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-21T21:17:41.967 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T21:17:42.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-test 2024-09-21T21:17:42.834 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:29 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:17:42.972 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:17:42.973 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:17:42.973 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 81 M 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 175 k 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-21T21:17:42.974 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:42.975 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:17:42.975 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:17:42.975 INFO:teuthology.orchestra.run.smithi148.stdout:Install 9 Packages 2024-09-21T21:17:42.975 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:17:42.975 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 83 M 2024-09-21T21:17:42.976 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 775 M 2024-09-21T21:17:42.976 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:17:43.209 INFO:teuthology.orchestra.run.smithi148.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 587 kB/s | 94 kB 00:00 2024-09-21T21:17:43.343 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 1/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 3/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 4/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 5/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_6 6/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 7/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9. 8/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x8 9/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 10/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 11/35 2024-09-21T21:17:43.344 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 12/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 13/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-21T21:17:43.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 32/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-21T21:17:43.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 34/35 2024-09-21T21:17:43.376 INFO:teuthology.orchestra.run.smithi148.stdout:(2/9): libcephsqlite-19.3.0-5092.g62da54b4.el9. 534 kB/s | 175 kB 00:00 2024-09-21T21:17:43.401 INFO:teuthology.orchestra.run.smithi148.stdout:(3/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 2.6 MB/s | 513 kB 00:00 2024-09-21T21:17:43.468 INFO:teuthology.orchestra.run.smithi148.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T21:17:43.518 INFO:teuthology.orchestra.run.smithi148.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-21T21:17:43.544 INFO:teuthology.orchestra.run.smithi148.stdout:(6/9): libubsan-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 183 kB 00:00 2024-09-21T21:17:43.569 INFO:teuthology.orchestra.run.smithi148.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T21:17:43.611 INFO:teuthology.orchestra.run.smithi148.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2024-09-21T21:17:44.242 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T21:17:44.244 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T21:17:44.244 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T21:17:44.244 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.244 INFO:teuthology.orchestra.run.smithi005.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T21:17:44.244 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T21:17:44.245 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T21:17:44.245 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T21:17:44.245 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.245 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T21:17:44.245 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T21:17:44.246 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T21:17:44.247 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T21:17:44.247 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T21:17:44.247 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:44.247 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:17:44.616 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-test 2024-09-21T21:17:45.219 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:31 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:17:45.356 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:17:45.357 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:17:45.357 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:17:45.357 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 81 M 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 175 k 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:45.358 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:17:45.359 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:17:45.359 INFO:teuthology.orchestra.run.smithi005.stdout:Install 9 Packages 2024-09-21T21:17:45.359 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:17:45.359 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 83 M 2024-09-21T21:17:45.359 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 775 M 2024-09-21T21:17:45.359 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:17:45.826 INFO:teuthology.orchestra.run.smithi005.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 702 kB/s | 94 kB 00:00 2024-09-21T21:17:45.934 INFO:teuthology.orchestra.run.smithi005.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 4.7 MB/s | 513 kB 00:00 2024-09-21T21:17:45.952 INFO:teuthology.orchestra.run.smithi148.stdout:(9/9): ceph-test-19.3.0-5092.g62da54b4.el9.x86_ 28 MB/s | 81 MB 00:02 2024-09-21T21:17:45.956 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:17:45.956 INFO:teuthology.orchestra.run.smithi148.stdout:Total 28 MB/s | 83 MB 00:02 2024-09-21T21:17:45.993 INFO:teuthology.orchestra.run.smithi005.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-21T21:17:46.040 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:17:46.062 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:17:46.063 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:17:46.076 INFO:teuthology.orchestra.run.smithi005.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-21T21:17:46.127 INFO:teuthology.orchestra.run.smithi005.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-21T21:17:46.169 INFO:teuthology.orchestra.run.smithi005.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-21T21:17:46.219 INFO:teuthology.orchestra.run.smithi005.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.4 MB/s | 122 kB 00:00 2024-09-21T21:17:46.327 INFO:teuthology.orchestra.run.smithi005.stdout:(8/9): libcephsqlite-19.3.0-5092.g62da54b4.el9. 275 kB/s | 175 kB 00:00 2024-09-21T21:17:46.665 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:17:46.665 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:17:47.531 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:17:47.615 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-21T21:17:47.672 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-21T21:17:47.731 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-21T21:17:47.772 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-21T21:17:47.807 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-21T21:17:47.840 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-21T21:17:47.910 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-21T21:17:47.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-21T21:17:47.983 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-21T21:17:50.494 INFO:teuthology.orchestra.run.smithi005.stdout:(9/9): ceph-test-19.3.0-5092.g62da54b4.el9.x86_ 17 MB/s | 81 MB 00:04 2024-09-21T21:17:50.498 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:17:50.498 INFO:teuthology.orchestra.run.smithi005.stdout:Total 16 MB/s | 83 MB 00:05 2024-09-21T21:17:50.584 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:17:50.610 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:17:50.610 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:17:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:17:51.238 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:17:52.136 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:17:52.209 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-21T21:17:52.259 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-21T21:17:52.308 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-21T21:17:52.339 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-21T21:17:52.374 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-21T21:17:52.398 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-21T21:17:52.468 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-21T21:17:52.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-21T21:17:52.541 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-21T21:17:58.866 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-21T21:17:58.940 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-21T21:18:03.997 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 8/9 2024-09-21T21:18:04.078 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 1/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-21T21:18:04.780 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-21T21:18:05.220 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-21T21:18:05.221 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:05.221 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:18:05.221 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:05.221 INFO:teuthology.orchestra.run.smithi148.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-21T21:18:05.221 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:05.221 INFO:teuthology.orchestra.run.smithi148.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-21T21:18:05.222 INFO:teuthology.orchestra.run.smithi148.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-21T21:18:05.222 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T21:18:05.222 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T21:18:05.222 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T21:18:05.222 INFO:teuthology.orchestra.run.smithi148.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-21T21:18:05.222 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:05.223 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:18:05.582 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph 2024-09-21T21:18:06.171 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:18:06.307 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.5 k 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 2.2 M 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 1.6 M 2024-09-21T21:18:06.310 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 292 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.1 M 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 70 M 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T21:18:06.311 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T21:18:06.312 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout:Install 37 Packages 2024-09-21T21:18:06.313 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:06.314 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 84 M 2024-09-21T21:18:06.314 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 896 M 2024-09-21T21:18:06.314 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:18:06.969 INFO:teuthology.orchestra.run.smithi148.stdout:(1/37): ceph-19.3.0-5092.g62da54b4.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-09-21T21:18:07.178 INFO:teuthology.orchestra.run.smithi148.stdout:(2/37): ceph-mds-19.3.0-5092.g62da54b4.el9.x86_ 5.5 MB/s | 2.2 MB 00:00 2024-09-21T21:18:07.220 INFO:teuthology.orchestra.run.smithi148.stdout:(3/37): ceph-mgr-19.3.0-5092.g62da54b4.el9.x86_ 3.6 MB/s | 1.6 MB 00:00 2024-09-21T21:18:07.337 INFO:teuthology.orchestra.run.smithi148.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5092.g62da 2.4 MB/s | 292 kB 00:00 2024-09-21T21:18:07.437 INFO:teuthology.orchestra.run.smithi148.stdout:(5/37): ceph-mon-19.3.0-5092.g62da54b4.el9.x86_ 11 MB/s | 5.1 MB 00:00 2024-09-21T21:18:08.204 INFO:teuthology.orchestra.run.smithi148.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 292 kB/s | 253 kB 00:00 2024-09-21T21:18:08.446 INFO:teuthology.orchestra.run.smithi148.stdout:(7/37): python3-cryptography-36.0.1-4.el9.x86_6 1.2 MB/s | 1.2 MB 00:01 2024-09-21T21:18:09.171 INFO:teuthology.orchestra.run.smithi148.stdout:(8/37): ceph-osd-19.3.0-5092.g62da54b4.el9.x86_ 35 MB/s | 70 MB 00:01 2024-09-21T21:18:09.471 INFO:teuthology.orchestra.run.smithi148.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 84 kB/s | 106 kB 00:01 2024-09-21T21:18:09.730 INFO:teuthology.orchestra.run.smithi148.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 106 kB/s | 135 kB 00:01 2024-09-21T21:18:09.855 INFO:teuthology.orchestra.run.smithi148.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-21T21:18:09.880 INFO:teuthology.orchestra.run.smithi148.stdout:(12/37): python3-requests-2.25.1-8.el9.noarch.r 176 kB/s | 125 kB 00:00 2024-09-21T21:18:09.906 INFO:teuthology.orchestra.run.smithi148.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T21:18:09.948 INFO:teuthology.orchestra.run.smithi148.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-21T21:18:09.973 INFO:teuthology.orchestra.run.smithi148.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 379 kB/s | 35 kB 00:00 2024-09-21T21:18:09.998 INFO:teuthology.orchestra.run.smithi148.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T21:18:10.023 INFO:teuthology.orchestra.run.smithi148.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-21T21:18:10.074 INFO:teuthology.orchestra.run.smithi148.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T21:18:10.077 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 9/9 2024-09-21T21:18:10.077 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 1/9 2024-09-21T21:18:10.077 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2/9 2024-09-21T21:18:10.077 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-21T21:18:10.077 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-21T21:18:10.078 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-21T21:18:10.078 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-21T21:18:10.078 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-21T21:18:10.078 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-21T21:18:10.099 INFO:teuthology.orchestra.run.smithi148.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-21T21:18:10.124 INFO:teuthology.orchestra.run.smithi148.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-21T21:18:10.158 INFO:teuthology.orchestra.run.smithi148.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-21T21:18:10.183 INFO:teuthology.orchestra.run.smithi148.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-21T21:18:10.217 INFO:teuthology.orchestra.run.smithi148.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 530 kB/s | 18 kB 00:00 2024-09-21T21:18:10.242 INFO:teuthology.orchestra.run.smithi148.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 930 kB/s | 23 kB 00:00 2024-09-21T21:18:10.275 INFO:teuthology.orchestra.run.smithi148.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 756 kB/s | 19 kB 00:00 2024-09-21T21:18:10.301 INFO:teuthology.orchestra.run.smithi148.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 793 kB/s | 20 kB 00:00 2024-09-21T21:18:10.326 INFO:teuthology.orchestra.run.smithi148.stdout:(27/37): python3-urllib3-1.26.5-6.el9.noarch.rp 252 kB/s | 215 kB 00:00 2024-09-21T21:18:10.351 INFO:teuthology.orchestra.run.smithi148.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-21T21:18:10.393 INFO:teuthology.orchestra.run.smithi148.stdout:(29/37): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T21:18:10.418 INFO:teuthology.orchestra.run.smithi148.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 709 kB/s | 16 kB 00:00 2024-09-21T21:18:10.444 INFO:teuthology.orchestra.run.smithi148.stdout:(31/37): python3-more-itertools-8.12.0-2.el9.no 674 kB/s | 79 kB 00:00 2024-09-21T21:18:10.466 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:10.467 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:18:10.469 INFO:teuthology.orchestra.run.smithi148.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-21T21:18:10.494 INFO:teuthology.orchestra.run.smithi148.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-21T21:18:10.520 INFO:teuthology.orchestra.run.smithi148.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-21T21:18:10.545 INFO:teuthology.orchestra.run.smithi148.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-21T21:18:10.570 INFO:teuthology.orchestra.run.smithi148.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-21T21:18:10.637 INFO:teuthology.orchestra.run.smithi148.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 35 kB/s | 22 kB 00:00 2024-09-21T21:18:10.644 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:10.644 INFO:teuthology.orchestra.run.smithi148.stdout:Total 19 MB/s | 84 MB 00:04 2024-09-21T21:18:10.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph 2024-09-21T21:18:10.797 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:18:10.839 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:18:10.839 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:18:11.370 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:18:11.519 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:18:11.522 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:18:11.522 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:11.522 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:18:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 6.5 k 2024-09-21T21:18:11.522 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:18:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 2.2 M 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 1.6 M 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 292 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 5.1 M 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 70 M 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T21:18:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T21:18:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:18:11.525 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:11.526 INFO:teuthology.orchestra.run.smithi005.stdout:Install 37 Packages 2024-09-21T21:18:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:11.526 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 84 M 2024-09-21T21:18:11.526 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 896 M 2024-09-21T21:18:11.526 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:18:11.629 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:18:11.629 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:18:11.988 INFO:teuthology.orchestra.run.smithi005.stdout:(1/37): ceph-19.3.0-5092.g62da54b4.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-21T21:18:12.213 INFO:teuthology.orchestra.run.smithi005.stdout:(2/37): ceph-mds-19.3.0-5092.g62da54b4.el9.x86_ 6.2 MB/s | 2.2 MB 00:00 2024-09-21T21:18:12.263 INFO:teuthology.orchestra.run.smithi005.stdout:(3/37): ceph-mgr-19.3.0-5092.g62da54b4.el9.x86_ 4.0 MB/s | 1.6 MB 00:00 2024-09-21T21:18:12.347 INFO:teuthology.orchestra.run.smithi005.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5092.g62da 3.4 MB/s | 292 kB 00:00 2024-09-21T21:18:12.489 INFO:teuthology.orchestra.run.smithi005.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-21T21:18:12.584 INFO:teuthology.orchestra.run.smithi005.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-21T21:18:12.648 INFO:teuthology.orchestra.run.smithi005.stdout:(7/37): ceph-mon-19.3.0-5092.g62da54b4.el9.x86_ 7.7 MB/s | 5.1 MB 00:00 2024-09-21T21:18:12.679 INFO:teuthology.orchestra.run.smithi005.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-21T21:18:12.715 INFO:teuthology.orchestra.run.smithi005.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-21T21:18:12.810 INFO:teuthology.orchestra.run.smithi005.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-21T21:18:12.833 INFO:teuthology.orchestra.run.smithi005.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 734 kB/s | 135 kB 00:00 2024-09-21T21:18:12.934 INFO:teuthology.orchestra.run.smithi005.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-21T21:18:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-21T21:18:13.002 INFO:teuthology.orchestra.run.smithi005.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 519 kB/s | 35 kB 00:00 2024-09-21T21:18:13.025 INFO:teuthology.orchestra.run.smithi005.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-21T21:18:13.053 INFO:teuthology.orchestra.run.smithi005.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T21:18:13.076 INFO:teuthology.orchestra.run.smithi005.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-21T21:18:13.112 INFO:teuthology.orchestra.run.smithi005.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 443 kB/s | 22 kB 00:00 2024-09-21T21:18:13.151 INFO:teuthology.orchestra.run.smithi005.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 872 kB/s | 43 kB 00:00 2024-09-21T21:18:13.194 INFO:teuthology.orchestra.run.smithi005.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-21T21:18:13.219 INFO:teuthology.orchestra.run.smithi005.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-09-21T21:18:13.244 INFO:teuthology.orchestra.run.smithi005.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 428 kB/s | 11 kB 00:00 2024-09-21T21:18:13.270 INFO:teuthology.orchestra.run.smithi005.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 708 kB/s | 18 kB 00:00 2024-09-21T21:18:13.295 INFO:teuthology.orchestra.run.smithi005.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-21T21:18:13.320 INFO:teuthology.orchestra.run.smithi005.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-21T21:18:13.321 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:18:13.346 INFO:teuthology.orchestra.run.smithi005.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-21T21:18:13.371 INFO:teuthology.orchestra.run.smithi005.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-21T21:18:13.381 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T21:18:13.396 INFO:teuthology.orchestra.run.smithi005.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 927 kB/s | 46 kB 00:00 2024-09-21T21:18:13.414 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T21:18:13.421 INFO:teuthology.orchestra.run.smithi005.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T21:18:13.442 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T21:18:13.447 INFO:teuthology.orchestra.run.smithi005.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 664 kB/s | 16 kB 00:00 2024-09-21T21:18:13.480 INFO:teuthology.orchestra.run.smithi005.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-21T21:18:13.506 INFO:teuthology.orchestra.run.smithi005.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-21T21:18:13.514 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T21:18:13.531 INFO:teuthology.orchestra.run.smithi005.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-21T21:18:13.549 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T21:18:13.565 INFO:teuthology.orchestra.run.smithi005.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-21T21:18:13.582 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T21:18:13.590 INFO:teuthology.orchestra.run.smithi005.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-21T21:18:13.632 INFO:teuthology.orchestra.run.smithi005.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T21:18:13.674 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T21:18:13.769 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T21:18:13.809 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T21:18:13.845 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T21:18:13.874 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T21:18:13.909 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T21:18:13.942 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T21:18:13.983 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T21:18:14.026 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T21:18:14.060 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T21:18:14.109 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T21:18:14.141 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T21:18:14.214 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T21:18:14.354 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T21:18:14.441 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T21:18:14.494 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T21:18:14.532 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T21:18:14.581 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T21:18:14.636 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T21:18:14.824 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T21:18:14.869 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T21:18:14.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T21:18:15.036 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T21:18:15.087 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T21:18:15.222 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T21:18:15.405 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 32/37 2024-09-21T21:18:15.428 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-21T21:18:15.454 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-21T21:18:15.454 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:15.454 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T21:18:15.454 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:18:15.454 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:18:15.455 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:15.457 INFO:teuthology.orchestra.run.smithi005.stdout:(37/37): ceph-osd-19.3.0-5092.g62da54b4.el9.x86 22 MB/s | 70 MB 00:03 2024-09-21T21:18:15.461 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:15.461 INFO:teuthology.orchestra.run.smithi005.stdout:Total 21 MB/s | 84 MB 00:03 2024-09-21T21:18:15.621 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:18:15.667 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:18:15.667 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:18:16.497 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:18:16.497 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:18:18.202 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:18:18.259 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T21:18:18.293 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T21:18:18.320 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T21:18:18.403 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T21:18:18.453 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T21:18:18.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T21:18:18.583 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T21:18:18.668 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T21:18:18.717 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T21:18:18.752 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T21:18:18.781 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T21:18:18.824 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T21:18:18.866 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T21:18:18.907 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T21:18:18.951 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T21:18:18.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T21:18:19.043 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T21:18:19.090 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T21:18:19.176 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T21:18:19.327 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T21:18:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T21:18:19.469 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T21:18:19.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T21:18:19.566 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T21:18:19.646 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T21:18:19.844 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T21:18:19.894 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T21:18:19.985 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T21:18:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T21:18:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T21:18:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T21:18:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 32/37 2024-09-21T21:18:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-21T21:18:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 33/37 2024-09-21T21:18:20.527 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:20.528 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T21:18:20.528 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:18:20.528 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T21:18:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:26.054 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-21T21:18:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-21T21:18:26.082 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:26.082 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T21:18:26.082 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:18:26.082 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:18:26.082 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:26.638 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-21T21:18:26.661 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-21T21:18:26.662 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:26.662 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T21:18:26.662 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:18:26.662 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:18:26.662 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:26.896 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-21T21:18:26.920 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-21T21:18:26.920 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:26.920 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T21:18:26.920 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:18:26.920 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:18:26.921 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:26.994 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-21T21:18:31.696 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-21T21:18:31.725 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 34/37 2024-09-21T21:18:31.725 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:31.725 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T21:18:31.725 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:18:31.725 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T21:18:31.725 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:32.305 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-21T21:18:32.330 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 35/37 2024-09-21T21:18:32.330 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:32.330 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T21:18:32.330 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:18:32.330 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T21:18:32.330 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:32.580 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-21T21:18:32.605 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 36/37 2024-09-21T21:18:32.606 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:32.606 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T21:18:32.606 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:18:32.606 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T21:18:32.606 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:32.680 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-21T21:18:33.612 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 1/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 3/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 4/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 5/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 6/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T21:18:33.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T21:18:33.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T21:18:33.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T21:18:33.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T21:18:33.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T21:18:33.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T21:18:33.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T21:18:33.616 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T21:18:34.474 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T21:18:34.475 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T21:18:34.476 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T21:18:34.477 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:34.478 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:18:34.750 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-base 2024-09-21T21:18:35.341 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:22 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:18:35.429 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:18:35.472 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:18:35.473 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:18:35.473 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:18:35.541 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install cephadm 2024-09-21T21:18:36.123 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:23 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:18:36.253 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:18:36.253 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:36.253 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 784 k 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 784 k 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 791 k 2024-09-21T21:18:36.254 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:18:36.520 INFO:teuthology.orchestra.run.smithi148.stdout:cephadm-19.3.0-5092.g62da54b4.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-21T21:18:36.520 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:36.521 INFO:teuthology.orchestra.run.smithi148.stdout:Total 2.9 MB/s | 784 kB 00:00 2024-09-21T21:18:36.521 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:18:36.526 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:18:36.526 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:18:36.532 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:18:36.533 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:18:36.608 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:18:37.064 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:37.148 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:37.550 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:37.823 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:37.824 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:37.824 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:18:37.824 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:37.824 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:37.824 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:18:38.026 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T21:18:38.616 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:18:38.750 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:18:38.750 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:38.750 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-21T21:18:38.750 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:38.750 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 158 k 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 158 k 2024-09-21T21:18:38.751 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 644 k 2024-09-21T21:18:38.752 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:18:38.961 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-immutable-object-cache-19.3.0-5092.g62da54 752 kB/s | 158 kB 00:00 2024-09-21T21:18:38.962 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:38.962 INFO:teuthology.orchestra.run.smithi148.stdout:Total 746 kB/s | 158 kB 00:00 2024-09-21T21:18:38.963 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:18:38.972 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:18:38.972 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:18:39.029 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:18:39.029 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:18:39.179 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:18:39.271 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-21T21:18:39.297 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-21T21:18:39.297 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:39.297 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T21:18:39.298 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:39.345 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 37/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 1/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 3/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 4/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 5/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9. 6/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T21:18:39.346 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T21:18:39.347 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T21:18:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T21:18:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T21:18:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T21:18:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T21:18:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T21:18:39.348 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T21:18:39.349 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T21:18:39.350 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T21:18:40.271 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-21T21:18:40.271 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:40.271 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:18:40.271 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:40.271 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:40.271 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:18:40.295 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T21:18:40.296 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T21:18:40.297 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T21:18:40.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T21:18:40.299 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:40.299 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:18:40.508 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr 2024-09-21T21:18:40.561 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-base 2024-09-21T21:18:41.107 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:18:41.183 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:27 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:18:41.201 INFO:teuthology.orchestra.run.smithi148.stdout:Package ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:18:41.243 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:18:41.245 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:18:41.245 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:18:41.276 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-base-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:18:41.313 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T21:18:41.321 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:18:41.322 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:18:41.322 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:18:41.407 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install cephadm 2024-09-21T21:18:41.897 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:18:42.012 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:18:42.029 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:18:42.030 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:42.030 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:18:42.030 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:42.030 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:18:42.030 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 14 M 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 34 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 16 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T21:18:42.031 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T21:18:42.032 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:42.032 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:18:42.032 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:18:42.032 INFO:teuthology.orchestra.run.smithi148.stdout:Install 11 Packages 2024-09-21T21:18:42.032 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:42.032 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 18 M 2024-09-21T21:18:42.032 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 156 M 2024-09-21T21:18:42.033 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:18:42.150 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:18:42.150 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 784 k 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:18:42.151 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:42.152 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 784 k 2024-09-21T21:18:42.152 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 791 k 2024-09-21T21:18:42.152 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:18:42.438 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm-19.3.0-5092.g62da54b4.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-21T21:18:42.439 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:42.439 INFO:teuthology.orchestra.run.smithi005.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-21T21:18:42.439 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:18:42.445 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:18:42.445 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:18:42.451 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:18:42.452 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:18:42.522 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:18:42.682 INFO:teuthology.orchestra.run.smithi148.stdout:(1/11): ceph-prometheus-alerts-19.3.0-5092.g62d 104 kB/s | 16 kB 00:00 2024-09-21T21:18:42.708 INFO:teuthology.orchestra.run.smithi148.stdout:(2/11): ceph-grafana-dashboards-19.3.0-5092.g62 187 kB/s | 34 kB 00:00 2024-09-21T21:18:43.001 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:43.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:43.133 INFO:teuthology.orchestra.run.smithi148.stdout:(3/11): ceph-mgr-dashboard-19.3.0-5092.g62da54b 23 MB/s | 14 MB 00:00 2024-09-21T21:18:43.158 INFO:teuthology.orchestra.run.smithi148.stdout:(4/11): python3-protobuf-3.14.0-13.el9.noarch.r 566 kB/s | 269 kB 00:00 2024-09-21T21:18:43.209 INFO:teuthology.orchestra.run.smithi148.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 390 kB/s | 19 kB 00:00 2024-09-21T21:18:43.234 INFO:teuthology.orchestra.run.smithi148.stdout:(6/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.3 MB/s | 548 kB 00:00 2024-09-21T21:18:43.267 INFO:teuthology.orchestra.run.smithi148.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-21T21:18:43.292 INFO:teuthology.orchestra.run.smithi148.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T21:18:43.326 INFO:teuthology.orchestra.run.smithi148.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-21T21:18:43.368 INFO:teuthology.orchestra.run.smithi148.stdout:(10/11): protobuf-compiler-3.14.0-13.el9.x86_64 1.3 MB/s | 863 kB 00:00 2024-09-21T21:18:43.443 INFO:teuthology.orchestra.run.smithi148.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 8.7 MB/s | 2.0 MB 00:00 2024-09-21T21:18:43.505 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:43.505 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:43.505 INFO:teuthology.orchestra.run.smithi148.stdout:Total 13 MB/s | 18 MB 00:01 2024-09-21T21:18:43.505 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:18:43.506 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:18:43.506 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:18:43.756 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:18:43.756 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:43.756 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:18:43.756 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:43.756 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:43.756 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:18:43.757 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:18:43.757 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:18:43.986 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T21:18:44.314 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:18:44.399 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-21T21:18:44.447 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-21T21:18:44.549 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-21T21:18:44.590 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:18:44.682 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-21T21:18:44.730 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:18:44.730 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:44.730 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-21T21:18:44.730 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:44.731 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:18:44.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 158 k 2024-09-21T21:18:44.731 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:44.731 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:18:44.731 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:44.731 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:18:44.731 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:44.732 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 158 k 2024-09-21T21:18:44.732 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 644 k 2024-09-21T21:18:44.732 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:18:44.733 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-21T21:18:44.818 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-21T21:18:44.885 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-21T21:18:44.922 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-21T21:18:44.938 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-immutable-object-cache-19.3.0-5092.g62da54 765 kB/s | 158 kB 00:00 2024-09-21T21:18:44.941 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:44.942 INFO:teuthology.orchestra.run.smithi005.stdout:Total 759 kB/s | 158 kB 00:00 2024-09-21T21:18:44.942 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:18:44.949 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:18:44.950 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:18:44.954 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 9/11 2024-09-21T21:18:45.010 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:18:45.010 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:18:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:18:45.231 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-21T21:18:45.257 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-21T21:18:45.257 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:18:45.257 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T21:18:45.257 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:46.213 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4. 1/1 2024-09-21T21:18:46.213 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:46.214 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:18:46.214 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:18:46.214 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:46.214 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:18:46.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr 2024-09-21T21:18:47.051 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:18:47.144 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-mgr-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:18:47.189 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:18:47.190 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:18:47.190 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:18:47.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T21:18:47.878 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:18:48.016 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 14 M 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 34 k 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 16 k 2024-09-21T21:18:48.017 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout:Install 11 Packages 2024-09-21T21:18:48.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:48.019 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 18 M 2024-09-21T21:18:48.019 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 156 M 2024-09-21T21:18:48.019 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:18:48.178 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 10/11 2024-09-21T21:18:48.233 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-21T21:18:48.608 INFO:teuthology.orchestra.run.smithi005.stdout:(1/11): ceph-grafana-dashboards-19.3.0-5092.g62 243 kB/s | 34 kB 00:00 2024-09-21T21:18:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:(2/11): ceph-prometheus-alerts-19.3.0-5092.g62d 99 kB/s | 16 kB 00:00 2024-09-21T21:18:48.842 INFO:teuthology.orchestra.run.smithi005.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-21T21:18:48.884 INFO:teuthology.orchestra.run.smithi005.stdout:(4/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-09-21T21:18:48.935 INFO:teuthology.orchestra.run.smithi005.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 455 kB/s | 19 kB 00:00 2024-09-21T21:18:48.968 INFO:teuthology.orchestra.run.smithi005.stdout:(6/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.3 MB/s | 548 kB 00:00 2024-09-21T21:18:49.002 INFO:teuthology.orchestra.run.smithi005.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-21T21:18:49.027 INFO:teuthology.orchestra.run.smithi005.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T21:18:49.194 INFO:teuthology.orchestra.run.smithi005.stdout:(9/11): ceph-mgr-dashboard-19.3.0-5092.g62da54b 20 MB/s | 14 MB 00:00 2024-09-21T21:18:49.219 INFO:teuthology.orchestra.run.smithi005.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 981 kB/s | 188 kB 00:00 2024-09-21T21:18:49.328 INFO:teuthology.orchestra.run.smithi005.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.2 MB/s | 2.0 MB 00:00 2024-09-21T21:18:49.332 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:49.332 INFO:teuthology.orchestra.run.smithi005.stdout:Total 14 MB/s | 18 MB 00:01 2024-09-21T21:18:49.364 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:18:49.385 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:18:49.385 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:18:49.689 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:18:49.690 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 1/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 2/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 3/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-21T21:18:49.889 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T21:18:50.229 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T21:18:50.230 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T21:18:50.230 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T21:18:50.230 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T21:18:50.230 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:50.230 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:18:50.256 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:18:50.352 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-21T21:18:50.382 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-21T21:18:50.479 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T21:18:50.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-21T21:18:50.621 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-21T21:18:50.669 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-21T21:18:50.755 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-21T21:18:50.805 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-21T21:18:50.833 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-21T21:18:50.865 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 9/11 2024-09-21T21:18:51.066 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:18:51.200 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:18:51.201 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T21:18:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:18:51.201 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T21:18:51.201 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:18:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 7.4 M 2024-09-21T21:18:51.201 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:18:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T21:18:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:51.203 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:18:51.203 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T21:18:51.203 INFO:teuthology.orchestra.run.smithi148.stdout:Install 12 Packages 2024-09-21T21:18:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:18:51.203 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 38 M 2024-09-21T21:18:51.203 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 212 M 2024-09-21T21:18:51.204 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:18:51.724 INFO:teuthology.orchestra.run.smithi148.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-21T21:18:51.766 INFO:teuthology.orchestra.run.smithi148.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-21T21:18:51.866 INFO:teuthology.orchestra.run.smithi148.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-09-21T21:18:51.916 INFO:teuthology.orchestra.run.smithi148.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 366 kB/s | 18 kB 00:00 2024-09-21T21:18:51.967 INFO:teuthology.orchestra.run.smithi148.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-21T21:18:52.084 INFO:teuthology.orchestra.run.smithi148.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-50 15 MB/s | 7.4 MB 00:00 2024-09-21T21:18:52.284 INFO:teuthology.orchestra.run.smithi148.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-21T21:18:52.534 INFO:teuthology.orchestra.run.smithi148.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 3.0 MB 00:00 2024-09-21T21:18:52.618 INFO:teuthology.orchestra.run.smithi148.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-21T21:18:52.876 INFO:teuthology.orchestra.run.smithi148.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 5.4 MB/s | 4.9 MB 00:00 2024-09-21T21:18:53.151 INFO:teuthology.orchestra.run.smithi148.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-09-21T21:18:53.710 INFO:teuthology.orchestra.run.smithi148.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-21T21:18:53.711 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:18:53.711 INFO:teuthology.orchestra.run.smithi148.stdout:Total 15 MB/s | 38 MB 00:02 2024-09-21T21:18:54.068 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:18:54.094 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:18:54.094 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:18:54.238 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 10/11 2024-09-21T21:18:54.295 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-21T21:18:54.527 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:18:54.528 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:18:55.293 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:18:55.359 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T21:18:55.400 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:18:55.501 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:18:55.534 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T21:18:55.719 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T21:18:55.758 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T21:18:55.851 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 11/11 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el 1/11 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noa 2/11 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9 3/11 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-21T21:18:56.176 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-21T21:18:56.177 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-21T21:18:56.177 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-21T21:18:56.177 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-21T21:18:56.494 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-21T21:18:56.494 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:56.494 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:56.495 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:18:56.506 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T21:18:56.622 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T21:18:56.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T21:18:57.363 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:18:57.503 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 7.4 M 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T21:18:57.504 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout:Install 12 Packages 2024-09-21T21:18:57.505 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:18:57.506 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 38 M 2024-09-21T21:18:57.506 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 212 M 2024-09-21T21:18:57.506 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:18:57.900 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:18:58.052 INFO:teuthology.orchestra.run.smithi005.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-21T21:18:58.094 INFO:teuthology.orchestra.run.smithi005.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-21T21:18:58.186 INFO:teuthology.orchestra.run.smithi005.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 244 kB/s | 33 kB 00:00 2024-09-21T21:18:58.236 INFO:teuthology.orchestra.run.smithi005.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 366 kB/s | 18 kB 00:00 2024-09-21T21:18:58.320 INFO:teuthology.orchestra.run.smithi005.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 461 kB/s | 38 kB 00:00 2024-09-21T21:18:58.420 INFO:teuthology.orchestra.run.smithi005.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-50 14 MB/s | 7.4 MB 00:00 2024-09-21T21:18:58.620 INFO:teuthology.orchestra.run.smithi005.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-21T21:18:58.863 INFO:teuthology.orchestra.run.smithi005.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 3.0 MB 00:00 2024-09-21T21:18:58.944 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T21:18:58.946 INFO:teuthology.orchestra.run.smithi005.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-21T21:18:58.974 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-21T21:18:59.172 INFO:teuthology.orchestra.run.smithi005.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 5.8 MB/s | 4.9 MB 00:00 2024-09-21T21:18:59.538 INFO:teuthology.orchestra.run.smithi005.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.6 MB/s | 5.1 MB 00:00 2024-09-21T21:19:01.397 INFO:teuthology.orchestra.run.smithi005.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.6 MB/s | 16 MB 00:02 2024-09-21T21:19:01.398 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:01.398 INFO:teuthology.orchestra.run.smithi005.stdout:Total 9.8 MB/s | 38 MB 00:03 2024-09-21T21:19:01.599 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-21T21:19:01.599 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 1/12 2024-09-21T21:19:01.599 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:19:01.599 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:19:01.599 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T21:19:01.599 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T21:19:01.600 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T21:19:01.600 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T21:19:01.600 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T21:19:01.600 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T21:19:01.600 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:19:01.600 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T21:19:01.770 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:01.797 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:01.797 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:02.012 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T21:19:02.012 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T21:19:02.013 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T21:19:02.014 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:02.014 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:02.249 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:02.250 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:02.389 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-rook 2024-09-21T21:19:02.993 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:49 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:03.127 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 49 k 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T21:19:03.130 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:03.131 INFO:teuthology.orchestra.run.smithi148.stdout:Install 13 Packages 2024-09-21T21:19:03.132 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:03.132 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 2.2 M 2024-09-21T21:19:03.132 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 26 M 2024-09-21T21:19:03.132 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:03.176 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:03.250 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T21:19:03.295 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:19:03.391 INFO:teuthology.orchestra.run.smithi148.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 307 kB/s | 26 kB 00:00 2024-09-21T21:19:03.399 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:19:03.416 INFO:teuthology.orchestra.run.smithi148.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 177 kB/s | 19 kB 00:00 2024-09-21T21:19:03.438 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T21:19:03.492 INFO:teuthology.orchestra.run.smithi148.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T21:19:03.517 INFO:teuthology.orchestra.run.smithi148.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-21T21:19:03.542 INFO:teuthology.orchestra.run.smithi148.stdout:(5/13): ceph-mgr-rook-19.3.0-5092.g62da54b4.el9 210 kB/s | 49 kB 00:00 2024-09-21T21:19:03.567 INFO:teuthology.orchestra.run.smithi148.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T21:19:03.593 INFO:teuthology.orchestra.run.smithi148.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-21T21:19:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T21:19:03.635 INFO:teuthology.orchestra.run.smithi148.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-21T21:19:03.652 INFO:teuthology.orchestra.run.smithi148.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-09-21T21:19:03.670 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T21:19:03.677 INFO:teuthology.orchestra.run.smithi148.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T21:19:03.702 INFO:teuthology.orchestra.run.smithi148.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.2 MB/s | 220 kB 00:00 2024-09-21T21:19:03.727 INFO:teuthology.orchestra.run.smithi148.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-21T21:19:03.749 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T21:19:03.769 INFO:teuthology.orchestra.run.smithi148.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-21T21:19:03.772 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:03.772 INFO:teuthology.orchestra.run.smithi148.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-21T21:19:03.835 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:03.851 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:03.851 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:03.939 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:03.940 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:04.433 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T21:19:04.444 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:04.575 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T21:19:04.608 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T21:19:04.662 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T21:19:04.726 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T21:19:04.763 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T21:19:04.805 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T21:19:04.907 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T21:19:05.008 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T21:19:05.056 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T21:19:05.787 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T21:19:05.837 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T21:19:05.870 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T21:19:05.897 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:19:05.919 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T21:19:05.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-21T21:19:06.723 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-21T21:19:06.723 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 1/13 2024-09-21T21:19:06.723 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T21:19:06.724 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T21:19:06.988 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T21:19:07.020 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T21:19:07.069 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:07.070 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:07.343 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T21:19:07.925 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:01:54 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:08.059 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 154 k 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:08.060 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:08.061 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:08.061 INFO:teuthology.orchestra.run.smithi148.stdout:Install 6 Packages 2024-09-21T21:19:08.061 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:08.061 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 7.0 M 2024-09-21T21:19:08.061 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 33 M 2024-09-21T21:19:08.061 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:08.654 INFO:teuthology.orchestra.run.smithi148.stdout:(1/6): ceph-mgr-cephadm-19.3.0-5092.g62da54b4.e 767 kB/s | 154 kB 00:00 2024-09-21T21:19:08.679 INFO:teuthology.orchestra.run.smithi148.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-21T21:19:08.738 INFO:teuthology.orchestra.run.smithi148.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 988 kB/s | 58 kB 00:00 2024-09-21T21:19:08.763 INFO:teuthology.orchestra.run.smithi148.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.9 MB/s | 548 kB 00:00 2024-09-21T21:19:08.788 INFO:teuthology.orchestra.run.smithi148.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-21T21:19:09.531 INFO:teuthology.orchestra.run.smithi148.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.5 MB/s | 6.0 MB 00:01 2024-09-21T21:19:09.533 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:09.534 INFO:teuthology.orchestra.run.smithi148.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-21T21:19:09.607 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:09.619 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:09.619 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:09.686 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 12/12 2024-09-21T21:19:09.686 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da5 1/12 2024-09-21T21:19:09.686 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T21:19:09.686 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T21:19:09.687 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T21:19:09.720 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:09.720 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:10.040 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:10.096 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T21:19:10.096 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:10.096 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:10.096 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:10.096 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T21:19:10.096 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:10.097 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:10.213 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T21:19:10.265 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T21:19:10.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-rook 2024-09-21T21:19:10.790 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T21:19:10.876 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T21:19:10.953 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T21:19:10.977 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-21T21:19:11.088 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:57 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:11.228 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:11.229 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:11.229 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 49 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T21:19:11.230 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout:Install 13 Packages 2024-09-21T21:19:11.231 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:11.232 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.2 M 2024-09-21T21:19:11.232 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 26 M 2024-09-21T21:19:11.232 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:11.638 INFO:teuthology.orchestra.run.smithi005.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 213 kB/s | 19 kB 00:00 2024-09-21T21:19:11.663 INFO:teuthology.orchestra.run.smithi005.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 222 kB/s | 26 kB 00:00 2024-09-21T21:19:11.722 INFO:teuthology.orchestra.run.smithi005.stdout:(3/13): ceph-mgr-rook-19.3.0-5092.g62da54b4.el9 283 kB/s | 49 kB 00:00 2024-09-21T21:19:11.764 INFO:teuthology.orchestra.run.smithi005.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.7 MB/s | 222 kB 00:00 2024-09-21T21:19:11.789 INFO:teuthology.orchestra.run.smithi005.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-21T21:19:11.814 INFO:teuthology.orchestra.run.smithi005.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T21:19:11.865 INFO:teuthology.orchestra.run.smithi005.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 427 kB/s | 32 kB 00:00 2024-09-21T21:19:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-21T21:19:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/6 2024-09-21T21:19:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T21:19:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T21:19:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T21:19:11.881 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T21:19:11.890 INFO:teuthology.orchestra.run.smithi005.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-21T21:19:11.923 INFO:teuthology.orchestra.run.smithi005.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-21T21:19:11.965 INFO:teuthology.orchestra.run.smithi005.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.2 MB/s | 220 kB 00:00 2024-09-21T21:19:11.999 INFO:teuthology.orchestra.run.smithi005.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-09-21T21:19:12.024 INFO:teuthology.orchestra.run.smithi005.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-21T21:19:12.059 INFO:teuthology.orchestra.run.smithi005.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-09-21T21:19:12.061 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:12.061 INFO:teuthology.orchestra.run.smithi005.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-21T21:19:12.128 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:12.144 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:12.145 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T21:19:12.168 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:12.169 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:12.245 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:12.246 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:12.455 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-fuse 2024-09-21T21:19:12.942 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:13.034 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:00 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:13.115 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T21:19:13.166 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 883 k 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:13.167 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:13.168 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:13.168 INFO:teuthology.orchestra.run.smithi148.stdout:Install 2 Packages 2024-09-21T21:19:13.168 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:13.168 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 963 k 2024-09-21T21:19:13.168 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 4.1 M 2024-09-21T21:19:13.168 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:13.178 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T21:19:13.234 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T21:19:13.278 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T21:19:13.328 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T21:19:13.452 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T21:19:13.599 INFO:teuthology.orchestra.run.smithi148.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 521 kB/s | 80 kB 00:00 2024-09-21T21:19:13.670 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T21:19:13.731 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T21:19:14.015 INFO:teuthology.orchestra.run.smithi148.stdout:(2/2): ceph-fuse-19.3.0-5092.g62da54b4.el9.x86_ 1.5 MB/s | 883 kB 00:00 2024-09-21T21:19:14.016 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:14.016 INFO:teuthology.orchestra.run.smithi148.stdout:Total 1.1 MB/s | 963 kB 00:00 2024-09-21T21:19:14.028 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:14.053 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:14.053 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:14.134 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:14.135 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:14.323 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:14.468 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T21:19:14.496 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T21:19:14.548 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-21T21:19:14.552 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T21:19:14.586 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T21:19:14.635 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T21:19:14.672 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-21T21:19:15.283 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-21T21:19:15.283 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/2 2024-09-21T21:19:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 13/13 2024-09-21T21:19:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 1/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T21:19:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T21:19:15.560 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T21:19:15.560 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:15.560 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:15.560 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T21:19:15.560 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:15.561 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T21:19:15.794 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:15.794 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T21:19:15.795 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:15.796 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:15.830 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-volume 2024-09-21T21:19:16.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T21:19:16.433 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:03 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:16.565 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:16.566 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:16.566 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T21:19:16.566 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:16.566 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:16.566 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 285 k 2024-09-21T21:19:16.566 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:16.566 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:16.567 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:16.567 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:19:16.567 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:16.567 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 285 k 2024-09-21T21:19:16.567 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 1.3 M 2024-09-21T21:19:16.567 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:16.699 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:02 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:16.803 INFO:teuthology.orchestra.run.smithi148.stdout:ceph-volume-19.3.0-5092.g62da54b4.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-21T21:19:16.804 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:16.804 INFO:teuthology.orchestra.run.smithi148.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-21T21:19:16.804 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:16.813 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:16.813 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:16.837 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:16.838 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:16.838 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:16.838 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 154 k 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:16.839 INFO:teuthology.orchestra.run.smithi005.stdout:Install 6 Packages 2024-09-21T21:19:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:16.840 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 7.0 M 2024-09-21T21:19:16.840 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 33 M 2024-09-21T21:19:16.840 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:17.058 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:17.138 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:19:17.155 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:19:17.155 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:19:17.156 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T21:19:17.156 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:17.228 INFO:teuthology.orchestra.run.smithi005.stdout:(1/6): ceph-mgr-cephadm-19.3.0-5092.g62da54b4.e 718 kB/s | 154 kB 00:00 2024-09-21T21:19:17.253 INFO:teuthology.orchestra.run.smithi005.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-21T21:19:17.311 INFO:teuthology.orchestra.run.smithi005.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 992 kB/s | 58 kB 00:00 2024-09-21T21:19:17.337 INFO:teuthology.orchestra.run.smithi005.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.9 MB/s | 548 kB 00:00 2024-09-21T21:19:17.362 INFO:teuthology.orchestra.run.smithi005.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.4 MB/s | 74 kB 00:00 2024-09-21T21:19:17.629 INFO:teuthology.orchestra.run.smithi005.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.7 MB/s | 6.0 MB 00:00 2024-09-21T21:19:17.630 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:17.631 INFO:teuthology.orchestra.run.smithi005.stdout:Total 8.9 MB/s | 7.0 MB 00:00 2024-09-21T21:19:17.704 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:17.715 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:17.716 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:17.823 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:18.136 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:18.183 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:19:18.183 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:18.183 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:18.184 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:18.184 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:18.184 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:18.310 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T21:19:18.365 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T21:19:18.502 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados-devel 2024-09-21T21:19:18.919 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T21:19:19.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T21:19:19.087 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T21:19:19.104 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:06 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:19.118 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-21T21:19:19.241 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 125 k 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:19:19.242 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:19.243 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 125 k 2024-09-21T21:19:19.243 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 445 k 2024-09-21T21:19:19.243 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:19.433 INFO:teuthology.orchestra.run.smithi148.stdout:librados-devel-19.3.0-5092.g62da54b4.el9.x86_64 656 kB/s | 125 kB 00:00 2024-09-21T21:19:19.434 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:19.434 INFO:teuthology.orchestra.run.smithi148.stdout:Total 651 kB/s | 125 kB 00:00 2024-09-21T21:19:19.434 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:19.439 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:19.440 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:19.504 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:19.504 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:19.657 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:19.766 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:19.972 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 6/6 2024-09-21T21:19:19.972 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 1/6 2024-09-21T21:19:19.972 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T21:19:19.973 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T21:19:19.973 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T21:19:19.973 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T21:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T21:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T21:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T21:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T21:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T21:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T21:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:20.280 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:20.550 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:20.551 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:20.551 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:20.551 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:20.551 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:20.551 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:20.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-fuse 2024-09-21T21:19:20.781 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs2 2024-09-21T21:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:07 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 883 k 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout:Install 2 Packages 2024-09-21T21:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 963 k 2024-09-21T21:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 4.1 M 2024-09-21T21:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:21.382 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:08 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:21.474 INFO:teuthology.orchestra.run.smithi148.stdout:Package libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:21.520 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:21.521 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:19:21.521 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:21.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install libcephfs-devel 2024-09-21T21:19:21.840 INFO:teuthology.orchestra.run.smithi005.stdout:(1/2): ceph-fuse-19.3.0-5092.g62da54b4.el9.x86_ 3.1 MB/s | 883 kB 00:00 2024-09-21T21:19:22.015 INFO:teuthology.orchestra.run.smithi005.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 175 kB/s | 80 kB 00:00 2024-09-21T21:19:22.015 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:22.016 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.3 MB/s | 963 kB 00:00 2024-09-21T21:19:22.027 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:22.052 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:22.052 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:22.140 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:22.140 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:22.169 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:09 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:22.302 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:22.303 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:22.303 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-21T21:19:22.303 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:22.303 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:22.303 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 32 k 2024-09-21T21:19:22.303 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:22.304 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:22.304 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:22.304 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:19:22.304 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:22.304 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 32 k 2024-09-21T21:19:22.304 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 142 k 2024-09-21T21:19:22.304 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:22.337 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:22.454 INFO:teuthology.orchestra.run.smithi148.stdout:libcephfs-devel-19.3.0-5092.g62da54b4.el9.x86_6 211 kB/s | 32 kB 00:00 2024-09-21T21:19:22.454 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:22.455 INFO:teuthology.orchestra.run.smithi148.stdout:Total 209 kB/s | 32 kB 00:00 2024-09-21T21:19:22.455 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:22.459 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:22.459 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:22.471 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:22.471 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:22.483 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T21:19:22.562 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:22.568 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-21T21:19:22.668 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:23.067 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:23.255 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2/2 2024-09-21T21:19:23.256 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/2 2024-09-21T21:19:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:23.307 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:23.307 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:23.308 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:23.485 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librados2 2024-09-21T21:19:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T21:19:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:23.593 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T21:19:23.593 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:23.594 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:23.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-volume 2024-09-21T21:19:24.067 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:11 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:24.156 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:24.202 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:24.203 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:19:24.203 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:24.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install librbd1 2024-09-21T21:19:24.495 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:10 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:24.634 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:24.635 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:24.635 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-21T21:19:24.635 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:24.635 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:24.635 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.3.0-5092.g62da54b4.el9 ceph-noarch 285 k 2024-09-21T21:19:24.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:24.636 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:24.636 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:24.636 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:19:24.636 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:24.636 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 285 k 2024-09-21T21:19:24.636 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 1.3 M 2024-09-21T21:19:24.637 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:24.862 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:11 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:24.878 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-volume-19.3.0-5092.g62da54b4.el9.noarch.rp 1.1 MB/s | 285 kB 00:00 2024-09-21T21:19:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-21T21:19:24.879 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:24.889 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:24.889 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:24.915 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:24.916 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:24.952 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:24.996 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:24.997 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:19:24.997 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:25.065 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rados 2024-09-21T21:19:25.150 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:25.223 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:19:25.239 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:19:25.239 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:19:25.239 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T21:19:25.239 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:25.653 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:12 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:25.743 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:25.787 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:25.788 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:19:25.788 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:25.857 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rgw 2024-09-21T21:19:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 1/1 2024-09-21T21:19:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:26.242 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.3.0-5092.g62da54b4.el9.noarch 2024-09-21T21:19:26.242 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:26.242 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:26.437 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:13 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:26.526 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:26.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados-devel 2024-09-21T21:19:26.569 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:26.570 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:19:26.570 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:26.640 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-cephfs 2024-09-21T21:19:27.176 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:13 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:27.228 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:14 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:27.315 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 125 k 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:27.316 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:19:27.317 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:27.317 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 125 k 2024-09-21T21:19:27.317 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 445 k 2024-09-21T21:19:27.317 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:27.319 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:27.362 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:27.363 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:19:27.363 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:27.434 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install python3-rbd 2024-09-21T21:19:27.533 INFO:teuthology.orchestra.run.smithi005.stdout:librados-devel-19.3.0-5092.g62da54b4.el9.x86_64 577 kB/s | 125 kB 00:00 2024-09-21T21:19:27.534 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:27.534 INFO:teuthology.orchestra.run.smithi005.stdout:Total 573 kB/s | 125 kB 00:00 2024-09-21T21:19:27.534 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:27.540 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:27.540 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:27.608 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:27.608 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:27.767 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:27.886 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:28.015 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:15 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:28.103 INFO:teuthology.orchestra.run.smithi148.stdout:Package python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:28.146 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:28.147 INFO:teuthology.orchestra.run.smithi148.stdout:Nothing to do. 2024-09-21T21:19:28.147 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:28.223 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-fuse 2024-09-21T21:19:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:28.637 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:28.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:28.638 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:28.638 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:28.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:28.638 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:28.810 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:15 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:28.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs2 2024-09-21T21:19:28.943 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:28.943 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:28.943 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 91 k 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 91 k 2024-09-21T21:19:28.944 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 321 k 2024-09-21T21:19:28.945 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:29.307 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-fuse-19.3.0-5092.g62da54b4.el9.x86_64.rpm 251 kB/s | 91 kB 00:00 2024-09-21T21:19:29.307 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:29.307 INFO:teuthology.orchestra.run.smithi148.stdout:Total 250 kB/s | 91 kB 00:00 2024-09-21T21:19:29.308 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:29.316 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:29.316 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:29.382 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:29.382 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:29.525 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:29.528 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:15 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:29.620 INFO:teuthology.orchestra.run.smithi005.stdout:Package libcephfs2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:29.621 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:29.667 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:29.668 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:19:29.669 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:29.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs-devel 2024-09-21T21:19:29.999 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:30.300 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:30.300 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:30.300 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:30.300 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:30.300 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:30.301 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:30.362 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:16 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:30.502 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:30.502 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-21T21:19:30.502 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:30.502 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 32 k 2024-09-21T21:19:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:30.503 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:30.503 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:30.503 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:19:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:30.503 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 32 k 2024-09-21T21:19:30.503 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 142 k 2024-09-21T21:19:30.503 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:30.598 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-mirror 2024-09-21T21:19:30.729 INFO:teuthology.orchestra.run.smithi005.stdout:libcephfs-devel-19.3.0-5092.g62da54b4.el9.x86_6 141 kB/s | 32 kB 00:00 2024-09-21T21:19:30.729 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:30.729 INFO:teuthology.orchestra.run.smithi005.stdout:Total 140 kB/s | 32 kB 00:00 2024-09-21T21:19:30.730 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:30.733 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:30.733 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:30.746 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:30.746 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:30.969 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:31.213 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:18 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:31.354 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:31.355 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:31.355 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repo Size 2024-09-21T21:19:31.355 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:31.355 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:31.355 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-21T21:19:31.355 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:31.355 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:31.356 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:31.356 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:19:31.356 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:31.356 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:31.356 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 3.5 M 2024-09-21T21:19:31.357 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 30 M 2024-09-21T21:19:31.357 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:31.607 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:31.607 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:31.607 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:31.607 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:31.607 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:31.607 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:31.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados2 2024-09-21T21:19:31.828 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-mirror-19.3.0-5092.g62da54b4.el9.x86_64.rpm 7.5 MB/s | 3.5 MB 00:00 2024-09-21T21:19:31.828 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:31.829 INFO:teuthology.orchestra.run.smithi148.stdout:Total 7.4 MB/s | 3.5 MB 00:00 2024-09-21T21:19:31.829 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:31.841 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:31.841 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:31.924 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:31.924 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:32.423 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:18 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:32.512 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:32.516 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:32.562 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:32.563 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:19:32.564 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:32.570 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:32.597 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:19:32.597 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T21:19:32.597 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:19:32.597 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:19:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:32.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librbd1 2024-09-21T21:19:33.251 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:19 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:33.343 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:33.389 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:33.390 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:19:33.390 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:33.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rados 2024-09-21T21:19:33.850 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:33.850 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:33.850 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:33.850 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:33.850 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:33.851 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:34.074 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:20 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:34.098 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install rbd-nbd 2024-09-21T21:19:34.167 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rados-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:34.213 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:34.214 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:19:34.214 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:34.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rgw 2024-09-21T21:19:34.703 INFO:teuthology.orchestra.run.smithi148.stdout:Last metadata expiration check: 0:02:21 ago on Sat 21 Sep 2024 09:17:13 PM UTC. 2024-09-21T21:19:34.837 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T21:19:34.837 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:34.837 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2024-09-21T21:19:34.837 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 176 k 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout:Install 1 Package 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:34.838 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 176 k 2024-09-21T21:19:34.839 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 685 k 2024-09-21T21:19:34.839 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T21:19:34.907 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:20 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:34.999 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rgw-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:35.022 INFO:teuthology.orchestra.run.smithi148.stdout:rbd-nbd-19.3.0-5092.g62da54b4.el9.x86_64.rpm 961 kB/s | 176 kB 00:00 2024-09-21T21:19:35.023 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:35.023 INFO:teuthology.orchestra.run.smithi148.stdout:Total 954 kB/s | 176 kB 00:00 2024-09-21T21:19:35.024 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T21:19:35.033 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T21:19:35.033 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T21:19:35.046 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:35.047 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:19:35.047 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:35.097 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T21:19:35.097 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T21:19:35.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-cephfs 2024-09-21T21:19:35.260 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T21:19:35.362 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:35.729 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:21 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:35.821 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-cephfs-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:35.822 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:35.867 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:35.868 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:19:35.868 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:35.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rbd 2024-09-21T21:19:36.097 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:36.097 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:36.097 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T21:19:36.097 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:36.098 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:36.098 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T21:19:36.360 DEBUG:teuthology.parallel:result is None 2024-09-21T21:19:36.556 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:22 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:36.649 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rbd-2:19.3.0-5092.g62da54b4.el9.x86_64 is already installed. 2024-09-21T21:19:36.696 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:36.697 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-21T21:19:36.697 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:36.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-fuse 2024-09-21T21:19:37.384 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:23 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:37.522 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 91 k 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:37.523 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:19:37.524 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:37.524 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 91 k 2024-09-21T21:19:37.524 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 321 k 2024-09-21T21:19:37.524 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:37.707 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-fuse-19.3.0-5092.g62da54b4.el9.x86_64.rpm 496 kB/s | 91 kB 00:00 2024-09-21T21:19:37.708 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:37.708 INFO:teuthology.orchestra.run.smithi005.stdout:Total 493 kB/s | 91 kB 00:00 2024-09-21T21:19:37.708 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:37.718 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:37.718 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:37.786 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:37.787 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:37.937 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:38.059 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:38.510 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:38.791 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:38.791 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:38.791 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:39.042 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-mirror 2024-09-21T21:19:39.649 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:25 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:39.788 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:39.789 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-21T21:19:39.789 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:39.789 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 3.5 M 2024-09-21T21:19:39.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:39.790 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:39.790 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:39.790 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:19:39.790 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:39.790 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 3.5 M 2024-09-21T21:19:39.790 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 30 M 2024-09-21T21:19:39.791 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:40.127 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-mirror-19.3.0-5092.g62da54b4.el9.x86_64.rpm 10 MB/s | 3.5 MB 00:00 2024-09-21T21:19:40.128 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:40.129 INFO:teuthology.orchestra.run.smithi005.stdout:Total 10 MB/s | 3.5 MB 00:00 2024-09-21T21:19:40.129 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:40.141 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:40.141 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:40.229 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:40.230 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:40.849 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:40.904 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:40.932 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:40.932 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T21:19:40.932 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T21:19:40.932 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:19:40.932 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T21:19:40.932 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:42.198 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:42.198 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:42.198 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:42.198 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:42.198 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:42.198 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:42.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-nbd 2024-09-21T21:19:43.100 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:02:29 ago on Sat 21 Sep 2024 09:17:14 PM UTC. 2024-09-21T21:19:43.239 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.3.0-5092.g62da54b4.el9 ceph 176 k 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-21T21:19:43.240 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:43.241 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 176 k 2024-09-21T21:19:43.241 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 685 k 2024-09-21T21:19:43.241 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-21T21:19:43.449 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-nbd-19.3.0-5092.g62da54b4.el9.x86_64.rpm 848 kB/s | 176 kB 00:00 2024-09-21T21:19:43.449 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-21T21:19:43.450 INFO:teuthology.orchestra.run.smithi005.stdout:Total 842 kB/s | 176 kB 00:00 2024-09-21T21:19:43.450 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-21T21:19:43.460 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-21T21:19:43.461 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-21T21:19:43.530 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-21T21:19:43.530 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-21T21:19:43.696 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-21T21:19:43.809 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:44.243 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 1/1 2024-09-21T21:19:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:44.507 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-21T21:19:44.507 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.3.0-5092.g62da54b4.el9.x86_64 2024-09-21T21:19:44.508 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:44.508 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-21T21:19:44.805 DEBUG:teuthology.parallel:result is None 2024-09-21T21:19:44.805 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-21T21:19:44.954 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T21:19:44.979 INFO:teuthology.orchestra.run.smithi005.stdout:19.3.0-5092.g62da54b4.el9 2024-09-21T21:19:44.979 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5092.g62da54b4.el9 2024-09-21T21:19:44.980 INFO:teuthology.task.install:The correct ceph version 19.3.0-5092.g62da54b4 is installed. 2024-09-21T21:19:44.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-21T21:19:45.124 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T21:19:45.150 INFO:teuthology.orchestra.run.smithi148.stdout:19.3.0-5092.g62da54b4.el9 2024-09-21T21:19:45.150 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5092.g62da54b4.el9 2024-09-21T21:19:45.150 INFO:teuthology.task.install:The correct ceph version 19.3.0-5092.g62da54b4 is installed. 2024-09-21T21:19:45.152 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T21:19:45.152 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:45.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T21:19:45.182 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:19:45.182 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T21:19:45.220 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T21:19:45.220 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:45.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T21:19:45.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T21:19:45.318 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:19:45.318 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T21:19:45.346 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T21:19:45.414 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T21:19:45.414 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:45.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T21:19:45.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T21:19:45.509 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:19:45.509 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T21:19:45.536 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T21:19:45.602 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T21:19:45.602 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:45.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T21:19:45.629 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T21:19:45.696 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:19:45.697 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T21:19:45.723 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T21:19:45.788 INFO:teuthology.run_tasks:Running task ceph... 2024-09-21T21:19:45.865 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-21T21:19:45.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-09-21T21:19:45.867 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2024-09-21T21:19:45.892 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-21T21:19:45.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T21:19:45.935 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-21T21:19:45.966 INFO:tasks.ceph:Creating extra log directories... 2024-09-21T21:19:45.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T21:19:46.002 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-21T21:19:46.040 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-21T21:19:46.040 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-21T21:19:46.040 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329', 'branch': 'main', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914329', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2950, 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_62da54b4b83a96ca9976b7e1d0c8272a564a2208/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFqIDO1EE8YOS5rYSCDKE4ioqOr7Oly3SdNMePm11lFfoK8rF9ooyHy3u1qWwi0EtrNFgGgpIU5pkIk0UjJzmQ=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNofoI9RTDpSav0EWdpfIdr6bPevI+pMmicw7CZkjX5gajnIp9bzXaP/9zmd1n7xe3IF7UAtSytmGTc1In+//hk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '62da54b4b83a96ca9976b7e1d0c8272a564a2208', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_20:56:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-21T21:19:46.041 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T21:19:46.069 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-21T21:19:46.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T21:19:46.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2024-09-21T21:19:46.151 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:46.152 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T21:19:46.209 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T21:19:46.209 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-09-21T21:19:46.266 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T21:19:46.266 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:46.266 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T21:19:46.266 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:46.266 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:46.266 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-21 21:19:41.194815817 +0000 2024-09-21T21:19:46.266 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-21 21:16:33.568346978 +0000 2024-09-21T21:19:46.267 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-21 21:16:33.569346957 +0000 2024-09-21T21:19:46.267 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-21 21:16:33.568346978 +0000 2024-09-21T21:19:46.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T21:19:46.331 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-21T21:19:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-21T21:19:46.332 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000108333 s, 4.7 MB/s 2024-09-21T21:19:46.333 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T21:19:46.390 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-09-21T21:19:46.447 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T21:19:46.447 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:46.447 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T21:19:46.447 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:46.447 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:46.447 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-21 21:19:41.194815817 +0000 2024-09-21T21:19:46.447 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-21 21:16:33.876340320 +0000 2024-09-21T21:19:46.448 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-21 21:16:33.876340320 +0000 2024-09-21T21:19:46.448 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-21 21:16:33.876340320 +0000 2024-09-21T21:19:46.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T21:19:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-21T21:19:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-21T21:19:46.512 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000103684 s, 4.9 MB/s 2024-09-21T21:19:46.513 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T21:19:46.570 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-09-21T21:19:46.626 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T21:19:46.626 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:46.627 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T21:19:46.627 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:46.627 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:46.627 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-21 21:19:41.195815795 +0000 2024-09-21T21:19:46.627 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-21 21:16:34.194333446 +0000 2024-09-21T21:19:46.627 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-21 21:16:34.194333446 +0000 2024-09-21T21:19:46.627 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-21 21:16:34.194333446 +0000 2024-09-21T21:19:46.627 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T21:19:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-21T21:19:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-21T21:19:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000104057 s, 4.9 MB/s 2024-09-21T21:19:46.693 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T21:19:46.750 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-09-21T21:19:46.806 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T21:19:46.806 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:46.806 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T21:19:46.806 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:46.807 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:46.807 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-21 21:19:41.195815795 +0000 2024-09-21T21:19:46.807 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-21 21:16:34.514326528 +0000 2024-09-21T21:19:46.807 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-21 21:16:34.514326528 +0000 2024-09-21T21:19:46.807 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-21 21:16:34.514326528 +0000 2024-09-21T21:19:46.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T21:19:46.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-21T21:19:46.870 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-21T21:19:46.870 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000100932 s, 5.1 MB/s 2024-09-21T21:19:46.872 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T21:19:46.929 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-21T21:19:46.929 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:19:46.929 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T21:19:46.948 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T21:19:46.948 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-21T21:19:47.007 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T21:19:47.007 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:47.007 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T21:19:47.008 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:47.008 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:47.008 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 21:19:32.858366334 +0000 2024-09-21T21:19:47.008 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 21:16:21.784510645 +0000 2024-09-21T21:19:47.008 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 21:16:21.784510645 +0000 2024-09-21T21:19:47.008 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 21:16:21.784510645 +0000 2024-09-21T21:19:47.008 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T21:19:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T21:19:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T21:19:47.076 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000272743 s, 1.9 MB/s 2024-09-21T21:19:47.077 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T21:19:47.137 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 21:19:32.858366334 +0000 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 21:16:22.138502202 +0000 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 21:16:22.138502202 +0000 2024-09-21T21:19:47.195 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 21:16:22.138502202 +0000 2024-09-21T21:19:47.196 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T21:19:47.261 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T21:19:47.262 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T21:19:47.262 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000192525 s, 2.7 MB/s 2024-09-21T21:19:47.263 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T21:19:47.321 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-21T21:19:47.377 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T21:19:47.377 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:47.377 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T21:19:47.378 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:47.378 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:47.378 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 21:19:32.858366334 +0000 2024-09-21T21:19:47.378 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 21:16:22.464494428 +0000 2024-09-21T21:19:47.378 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 21:16:22.464494428 +0000 2024-09-21T21:19:47.378 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 21:16:22.464494428 +0000 2024-09-21T21:19:47.378 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T21:19:47.443 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T21:19:47.443 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T21:19:47.443 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000222233 s, 2.3 MB/s 2024-09-21T21:19:47.444 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T21:19:47.502 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-21T21:19:47.557 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 21:19:32.859366311 +0000 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 21:16:22.804486319 +0000 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 21:16:22.804486319 +0000 2024-09-21T21:19:47.558 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 21:16:22.804486319 +0000 2024-09-21T21:19:47.558 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T21:19:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T21:19:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T21:19:47.622 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000215965 s, 2.4 MB/s 2024-09-21T21:19:47.623 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T21:19:47.680 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-21T21:19:47.680 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-21T21:19:47.680 INFO:tasks.ceph:Generating config... 2024-09-21T21:19:47.681 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-21T21:19:47.681 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-21T21:19:47.681 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-21T21:19:47.681 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-21T21:19:47.681 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-21T21:19:47.682 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-21T21:19:47.682 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-21T21:19:47.682 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-21T21:19:47.682 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-21T21:19:47.682 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-21T21:19:47.682 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-21T21:19:47.682 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-21T21:19:47.682 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-21T21:19:47.682 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-21T21:19:47.682 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-21T21:19:47.682 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-21T21:19:47.682 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] log to file = False 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-21T21:19:47.683 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-21T21:19:47.684 INFO:tasks.ceph:[osd] osd class default list = * 2024-09-21T21:19:47.684 INFO:tasks.ceph:[osd] osd class load list = * 2024-09-21T21:19:47.684 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-21T21:19:47.684 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-21T21:19:47.684 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-21T21:19:47.684 INFO:tasks.ceph:[client] debug ms = 1 2024-09-21T21:19:47.684 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-21T21:19:47.684 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-21T21:19:47.684 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-21T21:19:47.684 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-21T21:19:47.684 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-21T21:19:47.684 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-21T21:19:47.684 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-21T21:19:47.684 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-21T21:19:47.685 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-21T21:19:47.685 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-21T21:19:47.685 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-21T21:19:47.685 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-21T21:19:47.685 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-21T21:19:47.685 INFO:tasks.ceph:Setting up mon.a... 2024-09-21T21:19:47.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-21T21:19:47.759 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-09-21T21:19:47.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-21T21:19:47.820 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T21:19:47.846 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5')] 2024-09-21T21:19:47.847 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-21T21:19:47.848 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:47.848 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T21:19:47.902 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:19:47.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:19:47.995+0000 7fd5c3e41f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:19:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:19:47.995+0000 7fd5c3e41f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:19:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:19:47.995+0000 7fd5c3e41f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:19:47.997 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:19:47.997 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid ad0a953a-14f9-495f-aee8-909b91df1365 2024-09-21T21:19:47.997 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-09-21T21:19:47.997 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-09-21T21:19:47.998 INFO:teuthology.orchestra.run.smithi005.stdout:fsid ad0a953a-14f9-495f-aee8-909b91df1365 2024-09-21T21:19:47.998 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-09-21T21:19:47.996723+0000 2024-09-21T21:19:47.998 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-21T21:19:47.996723+0000 2024-09-21T21:19:47.998 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 17 (quincy) 2024-09-21T21:19:47.998 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-09-21T21:19:47.998 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-21T21:19:47.998 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-21T21:19:47.999 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-21T21:19:48.014 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ad0a953a-14f9-495f-aee8-909b91df1365... 2024-09-21T21:19:48.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T21:19:48.056 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-21T21:19:48.098 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-21T21:19:48.098 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-21T21:19:48.098 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T21:19:48.098 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-21T21:19:48.098 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.099 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-21T21:19:48.100 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-21T21:19:48.100 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.100 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T21:19:48.100 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-21T21:19:48.100 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.100 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T21:19:48.100 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T21:19:48.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.101 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-21T21:19:48.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-21T21:19:48.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-21T21:19:48.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-21T21:19:48.101 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.102 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T21:19:48.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.103 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-21T21:19:48.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.103 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-21T21:19:48.103 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.103 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-21T21:19:48.103 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-21T21:19:48.104 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-21T21:19:48.104 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = 172.21.15.5 2024-09-21T21:19:48.104 INFO:teuthology.orchestra.run.smithi005.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-21T21:19:48.104 INFO:teuthology.orchestra.run.smithi005.stdout: ms client mode = crc 2024-09-21T21:19:48.104 INFO:teuthology.orchestra.run.smithi005.stdout: ms cluster mode = crc 2024-09-21T21:19:48.104 INFO:teuthology.orchestra.run.smithi005.stdout: ms mon client mode = crc 2024-09-21T21:19:48.104 INFO:teuthology.orchestra.run.smithi005.stdout: ms mon cluster mode = crc 2024-09-21T21:19:48.105 INFO:teuthology.orchestra.run.smithi005.stdout: ms mon service mode = crc 2024-09-21T21:19:48.105 INFO:teuthology.orchestra.run.smithi005.stdout: ms service mode = crc 2024-09-21T21:19:48.105 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = ad0a953a-14f9-495f-aee8-909b91df1365 2024-09-21T21:19:48.105 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.105 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-21T21:19:48.105 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-21T21:19:48.105 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-21T21:19:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-21T21:19:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-21T21:19:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-21T21:19:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-21T21:19:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.107 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: debug monc = 20 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore compression algorithm = snappy 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore compression mode = aggressive 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore rocksdb cf = False 2024-09-21T21:19:48.108 INFO:teuthology.orchestra.run.smithi005.stdout: crimson alien thread cpu cores = 6-7 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: crimson osd obc lru size = 10 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 20 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 20 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 10 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: err to stderr = True 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: log flush on exit = True 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: log to file = False 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: log to stderr = True 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-21T21:19:48.109 INFO:teuthology.orchestra.run.smithi005.stdout: osd blocked scrub grace period = 3600 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: osd class default list = * 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: osd class load list = * 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: osd shutdown pgref assert = True 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:19:48.110 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:19:48.111 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-21T21:19:48.112 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-21T21:19:48.113 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.113 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-21T21:19:48.113 INFO:teuthology.orchestra.run.smithi005.stdout: mon min osdmap epochs = 50 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune interval = 2 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune min = 15 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: mon osdmap full prune txsize = 2 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: paxos service trim min = 10 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default crimson = True 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T21:19:48.114 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout: crimson seastar cpu cores = 0-2 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout: crimson seastar cpu cores = 3-5 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout: crimson seastar cpu cores = 0-2 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-09-21T21:19:48.115 INFO:teuthology.orchestra.run.smithi005.stdout: crimson seastar cpu cores = 3-5 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2024-09-21T21:19:48.117 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2024-09-21T21:19:48.118 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.119 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = 172.21.15.5 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: ms client mode = crc 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: ms cluster mode = crc 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: ms mon client mode = crc 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: ms mon cluster mode = crc 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: ms mon service mode = crc 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: ms service mode = crc 2024-09-21T21:19:48.120 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = ad0a953a-14f9-495f-aee8-909b91df1365 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2024-09-21T21:19:48.121 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.122 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: debug monc = 20 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression algorithm = snappy 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore compression mode = aggressive 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore rocksdb cf = False 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: crimson alien thread cpu cores = 6-7 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: crimson osd obc lru size = 10 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 20 2024-09-21T21:19:48.123 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 20 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 10 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: err to stderr = True 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: log flush on exit = True 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: log to file = False 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: log to stderr = True 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: osd blocked scrub grace period = 3600 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: osd class default list = * 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: osd class load list = * 2024-09-21T21:19:48.124 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: osd shutdown pgref assert = True 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2024-09-21T21:19:48.125 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2024-09-21T21:19:48.126 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon min osdmap epochs = 50 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon osdmap full prune interval = 2 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon osdmap full prune min = 15 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: mon osdmap full prune txsize = 2 2024-09-21T21:19:48.127 INFO:teuthology.orchestra.run.smithi148.stdout: paxos service trim min = 10 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on pool no app = False 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default crimson = True 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout: crimson seastar cpu cores = 0-2 2024-09-21T21:19:48.128 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2024-09-21T21:19:48.129 INFO:teuthology.orchestra.run.smithi148.stdout: crimson seastar cpu cores = 3-5 2024-09-21T21:19:48.129 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2024-09-21T21:19:48.129 INFO:teuthology.orchestra.run.smithi148.stdout: crimson seastar cpu cores = 0-2 2024-09-21T21:19:48.129 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2024-09-21T21:19:48.129 INFO:teuthology.orchestra.run.smithi148.stdout: crimson seastar cpu cores = 3-5 2024-09-21T21:19:48.129 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-21T21:19:48.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-21T21:19:48.224 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-21T21:19:48.225 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:48.225 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-21T21:19:48.241 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:48.242 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-21T21:19:48.296 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-09-21T21:19:48.296 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:48.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T21:19:48.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T21:19:48.371 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:19:48.371 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:19:48.427 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T21:19:48.427 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:19:48.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-21T21:19:48.427 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-21T21:19:48.466 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:19:48.467 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:19:48.523 INFO:tasks.ceph:Setting up mon nodes... 2024-09-21T21:19:48.524 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-21T21:19:48.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T21:19:48.673 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-21T21:19:48.676 INFO:tasks.ceph:Setting up mds nodes... 2024-09-21T21:19:48.676 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-21T21:19:48.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T21:19:48.728 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-21T21:19:48.742 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T21:19:48.795 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-21T21:19:48.809 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-21T21:19:48.809 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-21T21:19:48.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-21T21:19:48.834 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-21T21:19:48.835 INFO:tasks.ceph:role: osd.0 2024-09-21T21:19:48.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-21T21:19:48.835 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T21:19:48.900 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:19:48.900 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:19:48.900 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:19:48.900 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:19:48.900 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:19:48.901 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:19:48.901 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:19:48.901 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:19:48.901 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:19:48.901 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:19:48.932 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-21T21:19:48.934 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-21T21:19:48.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-21T21:19:49.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-21T21:19:49.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-21T21:19:49.144 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-21T21:19:49.144 INFO:tasks.ceph:role: osd.1 2024-09-21T21:19:49.144 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-21T21:19:49.144 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:19:49.210 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:19:49.242 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-21T21:19:49.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-21T21:19:49.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-21T21:19:49.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-21T21:19:49.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:19:49.687 INFO:teuthology.orchestra.run.smithi005.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:19:49.688 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:49,688 seastar - Reactor backend: linux-aio 2024-09-21T21:19:49.700 INFO:teuthology.orchestra.run.smithi005.stderr:==27751==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:19:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:49,831 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-21T21:19:49.831 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:49,831 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-21T21:19:49.832 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG 2024-09-21 21:19:49,832 [shard 0:main] seastar - reactor::drain 2024-09-21T21:19:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:19:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:Suppressions used: 2024-09-21T21:19:50.381 INFO:teuthology.orchestra.run.smithi005.stderr: count bytes template 2024-09-21T21:19:50.381 INFO:teuthology.orchestra.run.smithi005.stderr: 1 8 MallocExtension::Register 2024-09-21T21:19:50.381 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:19:50.381 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:19:50.439 INFO:teuthology.orchestra.run.smithi005.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:19:50.443 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:50,443 seastar - Reactor backend: linux-aio 2024-09-21T21:19:50.453 INFO:teuthology.orchestra.run.smithi005.stderr:==27749==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:19:55.189 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:19:55.189 INFO:teuthology.orchestra.run.smithi005.stderr:Suppressions used: 2024-09-21T21:19:55.189 INFO:teuthology.orchestra.run.smithi005.stderr: count bytes template 2024-09-21T21:19:55.189 INFO:teuthology.orchestra.run.smithi005.stderr: 1 8 MallocExtension::Register 2024-09-21T21:19:55.189 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:19:55.189 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:19:55.212 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T21:19:55.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:19:55.531 INFO:teuthology.orchestra.run.smithi005.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:19:55.532 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:55,532 seastar - Reactor backend: linux-aio 2024-09-21T21:19:55.538 INFO:teuthology.orchestra.run.smithi005.stderr:==27937==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:19:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x4b7e0 0x5fc061d 0x5fc09aa 0x601bbd4 0x5f9bdb6 0x5f9c2ea 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3961ae8 0x39632c2 0x3803c18 0x2958f 0x2963f 0x35eb9a4 2024-09-21T21:19:55.645 INFO:teuthology.orchestra.run.smithi005.stderr:kernel callstack: 2024-09-21T21:19:55.668 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:55,668 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-21T21:19:55.668 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:55,668 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-21T21:19:55.669 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG 2024-09-21 21:19:55,669 [shard 0:main] seastar - reactor::drain 2024-09-21T21:19:56.195 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:19:56.195 INFO:teuthology.orchestra.run.smithi005.stderr:Suppressions used: 2024-09-21T21:19:56.195 INFO:teuthology.orchestra.run.smithi005.stderr: count bytes template 2024-09-21T21:19:56.196 INFO:teuthology.orchestra.run.smithi005.stderr: 1 8 MallocExtension::Register 2024-09-21T21:19:56.196 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:19:56.196 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:19:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:19:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:INFO 2024-09-21 21:19:56,256 seastar - Reactor backend: linux-aio 2024-09-21T21:19:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:==27935==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:19:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0xdd323 0x4ab1c 0x3816dcd 0x46228da 0x5fbf0a1 0x5fbf2d2 0x5f9c36b 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3804428 0x2958f 0x2963f 0x35eb9a4 2024-09-21T21:19:56.331 INFO:teuthology.orchestra.run.smithi005.stderr:kernel callstack: 2024-09-21T21:20:01.503 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:20:01.504 INFO:teuthology.orchestra.run.smithi005.stderr:Suppressions used: 2024-09-21T21:20:01.504 INFO:teuthology.orchestra.run.smithi005.stderr: count bytes template 2024-09-21T21:20:01.504 INFO:teuthology.orchestra.run.smithi005.stderr: 1 8 MallocExtension::Register 2024-09-21T21:20:01.505 INFO:teuthology.orchestra.run.smithi005.stderr:----------------------------------------------------- 2024-09-21T21:20:01.505 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:20:01.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T21:20:01.552 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-21T21:20:01.583 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-21T21:20:01.584 INFO:tasks.ceph:role: osd.2 2024-09-21T21:20:01.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T21:20:01.584 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-21T21:20:01.662 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:20:01.662 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:20:01.662 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:20:01.662 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:20:01.662 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:20:01.663 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:20:01.663 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:20:01.663 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:20:01.663 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:20:01.663 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:20:02.172 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-21T21:20:02.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-21T21:20:02.175 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-21T21:20:02.324 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-21T21:20:02.356 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-21T21:20:02.422 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-21T21:20:02.422 INFO:tasks.ceph:role: osd.3 2024-09-21T21:20:02.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T21:20:02.422 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-21T21:20:02.495 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-21T21:20:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-21T21:20:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-21T21:20:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-21T21:20:02.495 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-21T21:20:02.495 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2024-09-21T21:20:02.495 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-21T21:20:02.496 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-21T21:20:02.496 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-21T21:20:02.496 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-21T21:20:02.937 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2024-09-21T21:20:02.939 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2024-09-21T21:20:02.939 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-21T21:20:03.028 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-21T21:20:03.057 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:20:03.348 INFO:teuthology.orchestra.run.smithi148.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:20:03.349 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:03,348 seastar - Reactor backend: linux-aio 2024-09-21T21:20:03.365 INFO:teuthology.orchestra.run.smithi148.stderr:==28111==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:20:03.486 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:03,486 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-21T21:20:03.487 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:03,486 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-21T21:20:03.487 INFO:teuthology.orchestra.run.smithi148.stderr:DEBUG 2024-09-21 21:20:03,487 [shard 0:main] seastar - reactor::drain 2024-09-21T21:20:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:Suppressions used: 2024-09-21T21:20:04.009 INFO:teuthology.orchestra.run.smithi148.stderr: count bytes template 2024-09-21T21:20:04.009 INFO:teuthology.orchestra.run.smithi148.stderr: 1 8 MallocExtension::Register 2024-09-21T21:20:04.009 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:04.009 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T21:20:04.066 INFO:teuthology.orchestra.run.smithi148.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:20:04.070 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:04,070 seastar - Reactor backend: linux-aio 2024-09-21T21:20:04.080 INFO:teuthology.orchestra.run.smithi148.stderr:==28109==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:20:04.145 INFO:teuthology.orchestra.run.smithi148.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbc8b6ef 0xbb64079 0xbb655e4 0xbb657fa 0xbb65950 0xbb65e19 0x3e6ef 0x5fbf084 0x5fbf2d2 0x5f9c36b 0x5de40ab 0x5dfc2ed 0x713a942 0x714c115 0x714d5b2 0x714d637 0x714d739 0x714d831 0x714da3e 0x714dc24 0x714df73 0x714e317 0x714e547 0x714e7b1 0x714ea7e 0x714ec9c 0x714ed54 0x714ee1a 0x714eefb 0x5c46eec 0x5c46ff6 0x5c470b2 0x5c4716e 0x5c4722a 0x5c47377 0x5c47502 0x5c478c3 0x5c616c6 0xbb78627 0xbb904a5 0xbc3dd4f 0xbc3f39d 0xb90dc6d 0xb90e4a5 0x3804428 0x2958f 0x2963f 0x35eb9a4 2024-09-21T21:20:04.146 INFO:teuthology.orchestra.run.smithi148.stderr:kernel callstack: 2024-09-21T21:20:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:Suppressions used: 2024-09-21T21:20:08.758 INFO:teuthology.orchestra.run.smithi148.stderr: count bytes template 2024-09-21T21:20:08.758 INFO:teuthology.orchestra.run.smithi148.stderr: 1 8 MallocExtension::Register 2024-09-21T21:20:08.758 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:08.758 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T21:20:08.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T21:20:08.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:20:09.086 INFO:teuthology.orchestra.run.smithi148.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:20:09.086 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:09,086 seastar - Reactor backend: linux-aio 2024-09-21T21:20:09.092 INFO:teuthology.orchestra.run.smithi148.stderr:==28297==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:20:09.212 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:09,212 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-21T21:20:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:09,212 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-21T21:20:09.213 INFO:teuthology.orchestra.run.smithi148.stderr:DEBUG 2024-09-21 21:20:09,213 [shard 0:main] seastar - reactor::drain 2024-09-21T21:20:09.724 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:09.724 INFO:teuthology.orchestra.run.smithi148.stderr:Suppressions used: 2024-09-21T21:20:09.724 INFO:teuthology.orchestra.run.smithi148.stderr: count bytes template 2024-09-21T21:20:09.724 INFO:teuthology.orchestra.run.smithi148.stderr: 1 8 MallocExtension::Register 2024-09-21T21:20:09.724 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:09.724 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T21:20:09.775 INFO:teuthology.orchestra.run.smithi148.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-21T21:20:09.779 INFO:teuthology.orchestra.run.smithi148.stderr:INFO 2024-09-21 21:20:09,779 seastar - Reactor backend: linux-aio 2024-09-21T21:20:09.797 INFO:teuthology.orchestra.run.smithi148.stderr:==28295==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-21T21:20:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:Suppressions used: 2024-09-21T21:20:14.495 INFO:teuthology.orchestra.run.smithi148.stderr: count bytes template 2024-09-21T21:20:14.495 INFO:teuthology.orchestra.run.smithi148.stderr: 1 8 MallocExtension::Register 2024-09-21T21:20:14.495 INFO:teuthology.orchestra.run.smithi148.stderr:----------------------------------------------------- 2024-09-21T21:20:14.495 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T21:20:14.517 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T21:20:14.541 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-21T21:20:14.542 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:20:14.542 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-21T21:20:14.574 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:20:14.574 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-21T21:20:14.644 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:20:14.644 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-21T21:20:14.669 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:20:14.669 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-21T21:20:14.733 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:20:14.733 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-21T21:20:14.798 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:20:14.798 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-21T21:20:14.817 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:20:14.817 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-21T21:20:14.853 INFO:tasks.ceph:Adding keys to all mons... 2024-09-21T21:20:14.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-21T21:20:14.886 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-09-21T21:20:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB2OO9mCZqKJBAA1QyXEFUWXjZOWRP0Uer4DQ== 2024-09-21T21:20:14.886 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-09-21T21:20:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB8OO9m+M5QGRAAtulQcHM2fwh6HFfdTvMJEw== 2024-09-21T21:20:14.886 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-09-21T21:20:14.886 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB0OO9muPcfKBAAvzS/X34IJGVCw3pkNbrjpg== 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCEOO9mjfe5DRAADs3gmmYQujHrBt/EW7RAbQ== 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQCJOO9mUQNqOBAAjXGhze6aZAkyxcBWa35nmg== 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB0OO9m9rloKxAA6NdJhRFPdfoT63eLewvL6w== 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2024-09-21T21:20:14.887 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQB0OO9mwVdoLxAAyuNr4VHo7a6fnjH361d+Gg== 2024-09-21T21:20:14.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T21:20:15.002 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T21:20:15.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-21T21:20:15.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T21:20:15.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-21T21:20:15.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T21:20:15.323 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-21T21:20:15.389 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-21T21:20:15.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-21T21:20:15.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-21T21:20:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.524+0000 7fbc0c4d7c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.525 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.524+0000 7fbc0c4d7c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-21T21:20:15.565 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-21T21:20:15.621 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-21T21:20:15.621 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-21T21:20:15.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-21T21:20:15.663 INFO:tasks.ceph.mon.a:Started 2024-09-21T21:20:15.664 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-21T21:20:15.664 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-21T21:20:15.664 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-21T21:20:15.666 INFO:tasks.ceph.mgr.x:Started 2024-09-21T21:20:15.666 DEBUG:tasks.ceph:set 0 configs 2024-09-21T21:20:15.666 INFO:tasks.ceph:Setting crush tunables to default 2024-09-21T21:20:15.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-09-21T21:20:15.750 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-21T21:20:15.748+0000 7f9f310d9c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.750 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-21T21:20:15.748+0000 7f9f310d9c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.750 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-21T21:20:15.749+0000 7f9f310d9c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.761 INFO:tasks.ceph.mgr.x.smithi148.stderr:2024-09-21T21:20:15.760+0000 7f49653c1000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.772+0000 7f5fa00ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.780+0000 7f5fa00ac640 1 Processor -- start 2024-09-21T21:20:15.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.780+0000 7f5fa00ac640 1 -- start start 2024-09-21T21:20:15.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5fa00ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f9809d9e0 0x7f5f9809ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5fa00ac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f980a1100 con 0x7f5f9809e330 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5fa00ac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5f980a02d0 con 0x7f5f9809d9e0 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5f9de48640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5f9809d9e0 0x7f5f9809ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5f9d647640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5f9809e330 0x7f5f98135d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34790/0 (socket says 172.21.15.5:34790) 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5f9d647640 1 -- 172.21.15.5:0/1630199845 learned_addr learned my addr 172.21.15.5:0/1630199845 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5f9de48640 1 -- 172.21.15.5:0/1630199845 >> v1:172.21.15.5:6789/0 conn(0x7f5f9809e330 legacy=0x7f5f98135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5f9ce46640 1 -- 172.21.15.5:0/1630199845 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417742121 0 0) 0x7f5f980a1100 con 0x7f5f9809e330 2024-09-21T21:20:15.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.782+0000 7f5f9de48640 1 -- 172.21.15.5:0/1630199845 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9809fd90 con 0x7f5f9809d9e0 2024-09-21T21:20:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.783+0000 7f5f9de48640 1 --2- 172.21.15.5:0/1630199845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f9809ddf0 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aaaa5d448306c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5f9ce46640 1 -- 172.21.15.5:0/1630199845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f94009d80 con 0x7f5f9809d9e0 2024-09-21T21:20:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5f9ce46640 1 -- 172.21.15.5:0/1630199845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5f9400e230 con 0x7f5f9809d9e0 2024-09-21T21:20:15.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5f9ce46640 1 -- 172.21.15.5:0/1630199845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f9400e4d0 con 0x7f5f9809d9e0 2024-09-21T21:20:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5fa00ac640 1 -- 172.21.15.5:0/1630199845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 msgr2=0x7f5f9809ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5fa00ac640 1 --2- 172.21.15.5:0/1630199845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f9809ddf0 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5fa00ac640 1 -- 172.21.15.5:0/1630199845 shutdown_connections 2024-09-21T21:20:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5fa00ac640 1 --2- 172.21.15.5:0/1630199845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f9809ddf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:15.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.784+0000 7f5fa00ac640 1 -- 172.21.15.5:0/1630199845 >> 172.21.15.5:0/1630199845 conn(0x7f5f9806ea80 msgr2=0x7f5f9806ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.785+0000 7f5fa00ac640 1 -- 172.21.15.5:0/1630199845 shutdown_connections 2024-09-21T21:20:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.785+0000 7f5fa00ac640 1 -- 172.21.15.5:0/1630199845 wait complete. 2024-09-21T21:20:15.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.785+0000 7f5fa00ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.786+0000 7f5fa00ac640 1 Processor -- start 2024-09-21T21:20:15.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.787+0000 7f5fa00ac640 1 -- start start 2024-09-21T21:20:15.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.788+0000 7f5fa00ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f98121a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:15.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.788+0000 7f5fa00ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98136090 con 0x7f5f9809d9e0 2024-09-21T21:20:15.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.788+0000 7f5f9de48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f98121a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.788+0000 7f5f9de48640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f98121a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52560/0 (socket says 172.21.15.5:52560) 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.788+0000 7f5f9de48640 1 -- 172.21.15.5:0/2407384593 learned_addr learned my addr 172.21.15.5:0/2407384593 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.788+0000 7f5f9de48640 1 -- 172.21.15.5:0/2407384593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f981259e0 con 0x7f5f9809d9e0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5f9de48640 1 --2- 172.21.15.5:0/2407384593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f98121a50 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/2407384593 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f94014620 con 0x7f5f9809d9e0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/2407384593 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5f94014780 con 0x7f5f9809d9e0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f98125660 con 0x7f5f9809d9e0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/2407384593 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f94014a20 con 0x7f5f9809d9e0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f981252c0 con 0x7f5f9809d9e0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/2407384593 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f5f94013400 con 0x7f5f9809d9e0 2024-09-21T21:20:15.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.789+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/2407384593 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7f5f94019040 con 0x7f5f9809d9e0 2024-09-21T21:20:15.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.790+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f980705e0 con 0x7f5f9809d9e0 2024-09-21T21:20:15.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.792+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/2407384593 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f5f94013890 con 0x7f5f9809d9e0 2024-09-21T21:20:15.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.859+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5f9809edc0 con 0x7f5f9809d9e0 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.859+0000 7f5f8e7fc640 1 -- 172.21.15.5:0/2407384593 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7f5f940059f0 con 0x7f5f9809d9e0 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.860+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 msgr2=0x7f5f98121a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.860+0000 7f5fa00ac640 1 --2- 172.21.15.5:0/2407384593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f98121a50 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.860+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 shutdown_connections 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.860+0000 7f5fa00ac640 1 --2- 172.21.15.5:0/2407384593 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f9809d9e0 0x7f5f98121a50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.860+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 >> 172.21.15.5:0/2407384593 conn(0x7f5f9806ea80 msgr2=0x7f5f980a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:15.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.860+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 shutdown_connections 2024-09-21T21:20:15.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.860+0000 7f5fa00ac640 1 -- 172.21.15.5:0/2407384593 wait complete. 2024-09-21T21:20:15.872 INFO:tasks.ceph:check_enable_crimson: True 2024-09-21T21:20:15.873 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-21T21:20:15.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-21T21:20:15.967 INFO:tasks.ceph.mgr.x.smithi148.stderr:2024-09-21T21:20:15.966+0000 7f49653c1000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.967 INFO:tasks.ceph.mgr.x.smithi148.stderr:2024-09-21T21:20:15.966+0000 7f49653c1000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.983 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.976+0000 7fdf73951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.983+0000 7fdf73951640 1 Processor -- start 2024-09-21T21:20:15.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.983+0000 7fdf73951640 1 -- start start 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.984+0000 7fdf73951640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdf6c06f1c0 0x7fdf6c13b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.984+0000 7fdf73951640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf6c09f390 con 0x7fdf6c09fae0 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.984+0000 7fdf73951640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdf6c0a03a0 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.984+0000 7fdf716ed640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdf6c09fae0 0x7fdf6c06eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34792/0 (socket says 172.21.15.5:34792) 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.984+0000 7fdf716ed640 1 -- 172.21.15.5:0/2919232449 learned_addr learned my addr 172.21.15.5:0/2919232449 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf70eec640 1 --2- 172.21.15.5:0/2919232449 >> v2:172.21.15.5:3300/0 conn(0x7fdf6c06f1c0 0x7fdf6c13b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf63fff640 1 -- 172.21.15.5:0/2919232449 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266887208 0 0) 0x7fdf6c09f390 con 0x7fdf6c09fae0 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf63fff640 1 -- 172.21.15.5:0/2919232449 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf58003580 con 0x7fdf6c09fae0 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf70eec640 1 -- 172.21.15.5:0/2919232449 >> v1:172.21.15.5:6789/0 conn(0x7fdf6c09fae0 legacy=0x7fdf6c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf70eec640 1 -- 172.21.15.5:0/2919232449 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6c0a0090 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf70eec640 1 --2- 172.21.15.5:0/2919232449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c13b250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0df077c01500495 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf63fff640 1 -- 172.21.15.5:0/2919232449 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf5c009d90 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf63fff640 1 -- 172.21.15.5:0/2919232449 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf5c00e230 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.985+0000 7fdf63fff640 1 -- 172.21.15.5:0/2919232449 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf5c00e4d0 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 1 -- 172.21.15.5:0/2919232449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 msgr2=0x7fdf6c13b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 1 --2- 172.21.15.5:0/2919232449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c13b250 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 1 -- 172.21.15.5:0/2919232449 shutdown_connections 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 1 --2- 172.21.15.5:0/2919232449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c13b250 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 1 -- 172.21.15.5:0/2919232449 >> 172.21.15.5:0/2919232449 conn(0x7fdf6c0a76f0 msgr2=0x7fdf6c0a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 1 -- 172.21.15.5:0/2919232449 shutdown_connections 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 1 -- 172.21.15.5:0/2919232449 wait complete. 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.986+0000 7fdf73951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:15.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.988+0000 7fdf73951640 1 Processor -- start 2024-09-21T21:20:15.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.988+0000 7fdf73951640 1 -- start start 2024-09-21T21:20:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf73951640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c123940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:15.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf73951640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6c1253c0 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf716ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c123940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf716ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c123940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52578/0 (socket says 172.21.15.5:52578) 2024-09-21T21:20:15.994 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf716ed640 1 -- 172.21.15.5:0/3458235505 learned_addr learned my addr 172.21.15.5:0/3458235505 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf716ed640 1 -- 172.21.15.5:0/3458235505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6c124b80 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf716ed640 1 --2- 172.21.15.5:0/3458235505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c123940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf61ffb640 1 -- 172.21.15.5:0/3458235505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf68005a60 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf61ffb640 1 -- 172.21.15.5:0/3458235505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdf68005bc0 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6c125c70 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.990+0000 7fdf61ffb640 1 -- 172.21.15.5:0/3458235505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdf68005e60 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.991+0000 7fdf61ffb640 1 -- 172.21.15.5:0/3458235505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fdf6800cb80 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.991+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf6c1263f0 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.991+0000 7fdf61ffb640 1 -- 172.21.15.5:0/3458235505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7fdf680073f0 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.995 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.991+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6c127810 con 0x7fdf6c06f1c0 2024-09-21T21:20:15.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:15.994+0000 7fdf61ffb640 1 -- 172.21.15.5:0/3458235505 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7fdf6800e1c0 con 0x7fdf6c06f1c0 2024-09-21T21:20:16.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.070+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7fdf6c06eab0 con 0x7fdf6c06f1c0 2024-09-21T21:20:16.071 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-21T21:20:16.070+0000 7f9f27df4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-21T21:20:16.071 INFO:tasks.ceph.mon.a.smithi005.stderr:Please be aware that this feature is experimental, untested, 2024-09-21T21:20:16.072 INFO:tasks.ceph.mon.a.smithi005.stderr:unsupported, and may result in data corruption, data loss, 2024-09-21T21:20:16.072 INFO:tasks.ceph.mon.a.smithi005.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-21T21:20:16.072 INFO:tasks.ceph.mon.a.smithi005.stderr:feature with important data. 2024-09-21T21:20:16.072 INFO:tasks.ceph.mon.a.smithi005.stderr: 2024-09-21T21:20:16.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.860+0000 7fdf61ffb640 1 -- 172.21.15.5:0/3458235505 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7fdf68007680 con 0x7fdf6c06f1c0 2024-09-21T21:20:16.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.861+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 msgr2=0x7fdf6c123940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:16.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.861+0000 7fdf73951640 1 --2- 172.21.15.5:0/3458235505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c123940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:16.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.861+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 shutdown_connections 2024-09-21T21:20:16.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.861+0000 7fdf73951640 1 --2- 172.21.15.5:0/3458235505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf6c06f1c0 0x7fdf6c123940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:16.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.861+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 >> 172.21.15.5:0/3458235505 conn(0x7fdf6c0a76f0 msgr2=0x7fdf6c1bbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:16.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.861+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 shutdown_connections 2024-09-21T21:20:16.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:16.861+0000 7fdf73951640 1 -- 172.21.15.5:0/3458235505 wait complete. 2024-09-21T21:20:16.875 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-21T21:20:16.875 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:20:16.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-21T21:20:16.903 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:20:16.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-21T21:20:16.970 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:20:16.970 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-21T21:20:16.995 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T21:20:16.995 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-21T21:20:17.059 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 8d775b7f-81e2-4b8c-9603-a1de80d82d23 0 2024-09-21T21:20:17.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.199+0000 7f793ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.205+0000 7f793ab51640 1 Processor -- start 2024-09-21T21:20:17.206 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.205+0000 7f793ab51640 1 -- start start 2024-09-21T21:20:17.207 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.206+0000 7f793ab51640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f793411d9b0 0x7f793411fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.206+0000 7f793ab51640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7934120310 con 0x7f7934114fa0 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.206+0000 7f793ab51640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f79341214d0 con 0x7f793411d9b0 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.206+0000 7f7933fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f793411d9b0 0x7f793411fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.206+0000 7f7933fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f793411d9b0 0x7f793411fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36820/0 (socket says 172.21.15.148:36820) 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.206+0000 7f79388ed640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7934114fa0 0x7f79341153b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.148:34706/0 (socket says 172.21.15.148:34706) 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.206+0000 7f7933fff640 1 -- 172.21.15.148:0/3070793721 learned_addr learned my addr 172.21.15.148:0/3070793721 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.207+0000 7f7933fff640 1 -- 172.21.15.148:0/3070793721 >> v1:172.21.15.5:6789/0 conn(0x7f7934114fa0 legacy=0x7f79341153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.207+0000 7f7933fff640 1 -- 172.21.15.148:0/3070793721 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7934121640 con 0x7f793411d9b0 2024-09-21T21:20:17.208 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.207+0000 7f7933fff640 1 --2- 172.21.15.148:0/3070793721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793411d9b0 0x7f793411fdd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8764c556341e6348 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.207+0000 7f79337fe640 1 -- 172.21.15.148:0/3070793721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7920009e50 con 0x7f793411d9b0 2024-09-21T21:20:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.207+0000 7f79337fe640 1 -- 172.21.15.148:0/3070793721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f792000e230 con 0x7f793411d9b0 2024-09-21T21:20:17.209 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.207+0000 7f79337fe640 1 -- 172.21.15.148:0/3070793721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f792000e4d0 con 0x7f793411d9b0 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 1 -- 172.21.15.148:0/3070793721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793411d9b0 msgr2=0x7f793411fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 1 --2- 172.21.15.148:0/3070793721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793411d9b0 0x7f793411fdd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 1 -- 172.21.15.148:0/3070793721 shutdown_connections 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 1 --2- 172.21.15.148:0/3070793721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f793411d9b0 0x7f793411fdd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 1 -- 172.21.15.148:0/3070793721 >> 172.21.15.148:0/3070793721 conn(0x7f793406fb90 msgr2=0x7f793406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 1 -- 172.21.15.148:0/3070793721 shutdown_connections 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 1 -- 172.21.15.148:0/3070793721 wait complete. 2024-09-21T21:20:17.210 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.208+0000 7f793ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.209+0000 7f793ab51640 1 Processor -- start 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.209+0000 7f793ab51640 1 -- start start 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.209+0000 7f793ab51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934114fa0 0x7f79341a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.209+0000 7f793ab51640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f79341a9e90 con 0x7f7934114fa0 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.209+0000 7f79388ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934114fa0 0x7f79341a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.209+0000 7f79388ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934114fa0 0x7f79341a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36828/0 (socket says 172.21.15.148:36828) 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.209+0000 7f79388ed640 1 -- 172.21.15.148:0/3091258326 learned_addr learned my addr 172.21.15.148:0/3091258326 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f79388ed640 1 -- 172.21.15.148:0/3091258326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79341a9fd0 con 0x7f7934114fa0 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f79388ed640 1 --2- 172.21.15.148:0/3091258326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934114fa0 0x7f79341a98c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f79317fa640 1 -- 172.21.15.148:0/3091258326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f79280059a0 con 0x7f7934114fa0 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f79317fa640 1 -- 172.21.15.148:0/3091258326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7928005b00 con 0x7f7934114fa0 2024-09-21T21:20:17.212 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79341aa280 con 0x7f7934114fa0 2024-09-21T21:20:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f79317fa640 1 -- 172.21.15.148:0/3091258326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7928005da0 con 0x7f7934114fa0 2024-09-21T21:20:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341af1a0 con 0x7f7934114fa0 2024-09-21T21:20:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f79317fa640 1 -- 172.21.15.148:0/3091258326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f7928007440 con 0x7f7934114fa0 2024-09-21T21:20:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.210+0000 7f79317fa640 1 -- 172.21.15.148:0/3091258326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f792800fa30 con 0x7f7934114fa0 2024-09-21T21:20:17.213 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.211+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7934120f60 con 0x7f7934114fa0 2024-09-21T21:20:17.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.214+0000 7f79317fa640 1 -- 172.21.15.148:0/3091258326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f792800fc90 con 0x7f7934114fa0 2024-09-21T21:20:17.285 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.284+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8d775b7f-81e2-4b8c-9603-a1de80d82d23", "id": 0} v 0) -- 0x7f793411d9b0 con 0x7f7934114fa0 2024-09-21T21:20:17.286 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.285+0000 7f79317fa640 1 -- 172.21.15.148:0/3091258326 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d775b7f-81e2-4b8c-9603-a1de80d82d23", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f792800c7f0 con 0x7f7934114fa0 2024-09-21T21:20:17.286 INFO:teuthology.orchestra.run.smithi148.stdout:0 2024-09-21T21:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.286+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934114fa0 msgr2=0x7f79341a98c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.286+0000 7f793ab51640 1 --2- 172.21.15.148:0/3091258326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934114fa0 0x7f79341a98c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.287+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 shutdown_connections 2024-09-21T21:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.287+0000 7f793ab51640 1 --2- 172.21.15.148:0/3091258326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934114fa0 0x7f79341a98c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.287+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 >> 172.21.15.148:0/3091258326 conn(0x7f793406fb90 msgr2=0x7f7934113d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.287+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 shutdown_connections 2024-09-21T21:20:17.288 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.287+0000 7f793ab51640 1 -- 172.21.15.148:0/3091258326 wait complete. 2024-09-21T21:20:17.299 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new bedebb15-7f73-41ce-8112-42af3e421377 1 2024-09-21T21:20:17.406 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.400+0000 7f8f0c87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.406+0000 7f8f0c87f640 1 Processor -- start 2024-09-21T21:20:17.407 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.406+0000 7f8f0c87f640 1 -- start start 2024-09-21T21:20:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0c87f640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f08112ff0 0x7f8f08113400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0c87f640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f08119130 con 0x7f8f08118610 2024-09-21T21:20:17.408 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0c87f640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8f08113bf0 con 0x7f8f08112ff0 2024-09-21T21:20:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f08112ff0 0x7f8f08113400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8f08112ff0 0x7f8f08113400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36836/0 (socket says 172.21.15.148:36836) 2024-09-21T21:20:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0659c640 1 -- 172.21.15.148:0/300012865 learned_addr learned my addr 172.21.15.148:0/300012865 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0659c640 1 -- 172.21.15.148:0/300012865 >> v1:172.21.15.5:6789/0 conn(0x7f8f08118610 legacy=0x7f8f08118a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.407+0000 7f8f0659c640 1 -- 172.21.15.148:0/300012865 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f081192f0 con 0x7f8f08112ff0 2024-09-21T21:20:17.409 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.408+0000 7f8f0659c640 1 --2- 172.21.15.148:0/300012865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f08113400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6851e5a99033d2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.408+0000 7f8f0559a640 1 -- 172.21.15.148:0/300012865 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef8009e50 con 0x7f8f08112ff0 2024-09-21T21:20:17.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.408+0000 7f8f0559a640 1 -- 172.21.15.148:0/300012865 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ef800e230 con 0x7f8f08112ff0 2024-09-21T21:20:17.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.408+0000 7f8f0559a640 1 -- 172.21.15.148:0/300012865 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef800e4d0 con 0x7f8f08112ff0 2024-09-21T21:20:17.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.408+0000 7f8f0c87f640 1 -- 172.21.15.148:0/300012865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 msgr2=0x7f8f08113400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.410 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.408+0000 7f8f0c87f640 1 --2- 172.21.15.148:0/300012865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f08113400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.409+0000 7f8f0c87f640 1 -- 172.21.15.148:0/300012865 shutdown_connections 2024-09-21T21:20:17.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.409+0000 7f8f0c87f640 1 --2- 172.21.15.148:0/300012865 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f08113400 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.409+0000 7f8f0c87f640 1 -- 172.21.15.148:0/300012865 >> 172.21.15.148:0/300012865 conn(0x7f8f08072430 msgr2=0x7f8f08074850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.409+0000 7f8f0c87f640 1 -- 172.21.15.148:0/300012865 shutdown_connections 2024-09-21T21:20:17.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.409+0000 7f8f0c87f640 1 -- 172.21.15.148:0/300012865 wait complete. 2024-09-21T21:20:17.411 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.409+0000 7f8f0c87f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.410+0000 7f8f0c87f640 1 Processor -- start 2024-09-21T21:20:17.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.410+0000 7f8f0c87f640 1 -- start start 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.410+0000 7f8f0c87f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f081a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.410+0000 7f8f0c87f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8f081a7d70 con 0x7f8f08112ff0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.410+0000 7f8f0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f081a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.410+0000 7f8f0659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f081a77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36850/0 (socket says 172.21.15.148:36850) 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.410+0000 7f8f0659c640 1 -- 172.21.15.148:0/4171498803 learned_addr learned my addr 172.21.15.148:0/4171498803 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8f0659c640 1 -- 172.21.15.148:0/4171498803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f081a7eb0 con 0x7f8f08112ff0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8f0659c640 1 --2- 172.21.15.148:0/4171498803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f081a77a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8efeffd640 1 -- 172.21.15.148:0/4171498803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef800ee80 con 0x7f8f08112ff0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8efeffd640 1 -- 172.21.15.148:0/4171498803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8ef8015420 con 0x7f8f08112ff0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8efeffd640 1 -- 172.21.15.148:0/4171498803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8ef80156c0 con 0x7f8f08112ff0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f081a8100 con 0x7f8f08112ff0 2024-09-21T21:20:17.413 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f081ad000 con 0x7f8f08112ff0 2024-09-21T21:20:17.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8efeffd640 1 -- 172.21.15.148:0/4171498803 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f8ef8015c50 con 0x7f8f08112ff0 2024-09-21T21:20:17.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.411+0000 7f8efeffd640 1 -- 172.21.15.148:0/4171498803 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f8ef8011740 con 0x7f8f08112ff0 2024-09-21T21:20:17.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.412+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f08113400 con 0x7f8f08112ff0 2024-09-21T21:20:17.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.415+0000 7f8efeffd640 1 -- 172.21.15.148:0/4171498803 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8ef8011a00 con 0x7f8f08112ff0 2024-09-21T21:20:17.486 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.485+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bedebb15-7f73-41ce-8112-42af3e421377", "id": 1} v 0) -- 0x7f8f08118610 con 0x7f8f08112ff0 2024-09-21T21:20:17.488 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.487+0000 7f8efeffd640 1 -- 172.21.15.148:0/4171498803 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bedebb15-7f73-41ce-8112-42af3e421377", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f8ef8011cf0 con 0x7f8f08112ff0 2024-09-21T21:20:17.488 INFO:teuthology.orchestra.run.smithi148.stdout:1 2024-09-21T21:20:17.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.488+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 msgr2=0x7f8f081a77a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.488+0000 7f8f0c87f640 1 --2- 172.21.15.148:0/4171498803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f081a77a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.488+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 shutdown_connections 2024-09-21T21:20:17.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.488+0000 7f8f0c87f640 1 --2- 172.21.15.148:0/4171498803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8f08112ff0 0x7f8f081a77a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.488+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 >> 172.21.15.148:0/4171498803 conn(0x7f8f08072430 msgr2=0x7f8f08116510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.488+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 shutdown_connections 2024-09-21T21:20:17.489 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.488+0000 7f8f0c87f640 1 -- 172.21.15.148:0/4171498803 wait complete. 2024-09-21T21:20:17.499 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba 2 2024-09-21T21:20:17.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.599+0000 7f2b19f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.605+0000 7f2b19f91640 1 Processor -- start 2024-09-21T21:20:17.606 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.606+0000 7f2b19f91640 1 -- start start 2024-09-21T21:20:17.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.606+0000 7f2b19f91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b14114fa0 0x7f2b141153b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.606+0000 7f2b19f91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b14115b80 con 0x7f2b1411a830 2024-09-21T21:20:17.607 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.606+0000 7f2b19f91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2b1411b350 con 0x7f2b14114fa0 2024-09-21T21:20:17.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b14114fa0 0x7f2b141153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b137fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2b14114fa0 0x7f2b141153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36854/0 (socket says 172.21.15.148:36854) 2024-09-21T21:20:17.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b137fe640 1 -- 172.21.15.148:0/215630915 learned_addr learned my addr 172.21.15.148:0/215630915 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b12ffd640 1 --1- 172.21.15.148:0/215630915 >> v1:172.21.15.5:6789/0 conn(0x7f2b1411a830 0x7f2b1411ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.148:34724/0 (socket says 172.21.15.148:34724) 2024-09-21T21:20:17.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b137fe640 1 -- 172.21.15.148:0/215630915 >> v1:172.21.15.5:6789/0 conn(0x7f2b1411a830 legacy=0x7f2b1411ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b137fe640 1 -- 172.21.15.148:0/215630915 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b1411b4c0 con 0x7f2b14114fa0 2024-09-21T21:20:17.608 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b137fe640 1 --2- 172.21.15.148:0/215630915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141153b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9de8cff3ca17e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b127fc640 1 -- 172.21.15.148:0/215630915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b0400e040 con 0x7f2b14114fa0 2024-09-21T21:20:17.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b127fc640 1 -- 172.21.15.148:0/215630915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b040091e0 con 0x7f2b14114fa0 2024-09-21T21:20:17.609 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.607+0000 7f2b127fc640 1 -- 172.21.15.148:0/215630915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b04007730 con 0x7f2b14114fa0 2024-09-21T21:20:17.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 1 -- 172.21.15.148:0/215630915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 msgr2=0x7f2b141153b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 1 --2- 172.21.15.148:0/215630915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141153b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 1 -- 172.21.15.148:0/215630915 shutdown_connections 2024-09-21T21:20:17.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 1 --2- 172.21.15.148:0/215630915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141153b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 1 -- 172.21.15.148:0/215630915 >> 172.21.15.148:0/215630915 conn(0x7f2b1406fb90 msgr2=0x7f2b1406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 1 -- 172.21.15.148:0/215630915 shutdown_connections 2024-09-21T21:20:17.610 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 1 -- 172.21.15.148:0/215630915 wait complete. 2024-09-21T21:20:17.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.609+0000 7f2b19f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.610+0000 7f2b19f91640 1 Processor -- start 2024-09-21T21:20:17.611 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.610+0000 7f2b19f91640 1 -- start start 2024-09-21T21:20:17.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.611+0000 7f2b19f91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.611+0000 7f2b19f91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2b141a9e70 con 0x7f2b14114fa0 2024-09-21T21:20:17.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.611+0000 7f2b137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.611+0000 7f2b137fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36860/0 (socket says 172.21.15.148:36860) 2024-09-21T21:20:17.612 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.611+0000 7f2b137fe640 1 -- 172.21.15.148:0/2341408176 learned_addr learned my addr 172.21.15.148:0/2341408176 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.611+0000 7f2b137fe640 1 -- 172.21.15.148:0/2341408176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b141a9fb0 con 0x7f2b14114fa0 2024-09-21T21:20:17.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b137fe640 1 --2- 172.21.15.148:0/2341408176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141a98a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.613 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b0bfff640 1 -- 172.21.15.148:0/2341408176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b0400e040 con 0x7f2b14114fa0 2024-09-21T21:20:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b0bfff640 1 -- 172.21.15.148:0/2341408176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2b04010930 con 0x7f2b14114fa0 2024-09-21T21:20:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b0bfff640 1 -- 172.21.15.148:0/2341408176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2b04010bd0 con 0x7f2b14114fa0 2024-09-21T21:20:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b141aa200 con 0x7f2b14114fa0 2024-09-21T21:20:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b141af180 con 0x7f2b14114fa0 2024-09-21T21:20:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b0bfff640 1 -- 172.21.15.148:0/2341408176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f2b040157e0 con 0x7f2b14114fa0 2024-09-21T21:20:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.612+0000 7f2b0bfff640 1 -- 172.21.15.148:0/2341408176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f2b04014b90 con 0x7f2b14114fa0 2024-09-21T21:20:17.614 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.613+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b141153b0 con 0x7f2b14114fa0 2024-09-21T21:20:17.617 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.616+0000 7f2b0bfff640 1 -- 172.21.15.148:0/2341408176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f2b040095b0 con 0x7f2b14114fa0 2024-09-21T21:20:17.686 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.685+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba", "id": 2} v 0) -- 0x7f2b1411a830 con 0x7f2b14114fa0 2024-09-21T21:20:17.688 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.687+0000 7f2b0bfff640 1 -- 172.21.15.148:0/2341408176 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f2b04014df0 con 0x7f2b14114fa0 2024-09-21T21:20:17.688 INFO:teuthology.orchestra.run.smithi148.stdout:2 2024-09-21T21:20:17.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.688+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 msgr2=0x7f2b141a98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.688+0000 7f2b19f91640 1 --2- 172.21.15.148:0/2341408176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141a98a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.688+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 shutdown_connections 2024-09-21T21:20:17.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.688+0000 7f2b19f91640 1 --2- 172.21.15.148:0/2341408176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b14114fa0 0x7f2b141a98a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.688+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 >> 172.21.15.148:0/2341408176 conn(0x7f2b1406fb90 msgr2=0x7f2b141196f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.688+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 shutdown_connections 2024-09-21T21:20:17.689 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.688+0000 7f2b19f91640 1 -- 172.21.15.148:0/2341408176 wait complete. 2024-09-21T21:20:17.700 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 14b1cc33-c87a-4e37-b778-3005207ab080 3 2024-09-21T21:20:17.808 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.801+0000 7f8bfb663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.808+0000 7f8bfb663640 1 Processor -- start 2024-09-21T21:20:17.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.808+0000 7f8bfb663640 1 -- start start 2024-09-21T21:20:17.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.809+0000 7f8bfb663640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bf4114fa0 0x7f8bf41153b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.809+0000 7f8bfb663640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf4115b80 con 0x7f8bf411a830 2024-09-21T21:20:17.810 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.809+0000 7f8bfb663640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf411b350 con 0x7f8bf4114fa0 2024-09-21T21:20:17.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.809+0000 7f8bf93ff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bf4114fa0 0x7f8bf41153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.809+0000 7f8bf93ff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f8bf4114fa0 0x7f8bf41153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36876/0 (socket says 172.21.15.148:36876) 2024-09-21T21:20:17.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.809+0000 7f8bf93ff640 1 -- 172.21.15.148:0/1776864052 learned_addr learned my addr 172.21.15.148:0/1776864052 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.809+0000 7f8bf8bfe640 1 --1- 172.21.15.148:0/1776864052 >> v1:172.21.15.5:6789/0 conn(0x7f8bf411a830 0x7f8bf411ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.148:34732/0 (socket says 172.21.15.148:34732) 2024-09-21T21:20:17.811 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.810+0000 7f8bf93ff640 1 -- 172.21.15.148:0/1776864052 >> v1:172.21.15.5:6789/0 conn(0x7f8bf411a830 legacy=0x7f8bf411ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.810+0000 7f8bf93ff640 1 -- 172.21.15.148:0/1776864052 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf411b4c0 con 0x7f8bf4114fa0 2024-09-21T21:20:17.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.810+0000 7f8bf93ff640 1 --2- 172.21.15.148:0/1776864052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41153b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398af9ac3ff02fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.810+0000 7f8bebfff640 1 -- 172.21.15.148:0/1776864052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8be4009e50 con 0x7f8bf4114fa0 2024-09-21T21:20:17.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.810+0000 7f8bebfff640 1 -- 172.21.15.148:0/1776864052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8be400e230 con 0x7f8bf4114fa0 2024-09-21T21:20:17.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.810+0000 7f8bebfff640 1 -- 172.21.15.148:0/1776864052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8be400e4d0 con 0x7f8bf4114fa0 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 1 -- 172.21.15.148:0/1776864052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 msgr2=0x7f8bf41153b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 1 --2- 172.21.15.148:0/1776864052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41153b0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 1 -- 172.21.15.148:0/1776864052 shutdown_connections 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 1 --2- 172.21.15.148:0/1776864052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41153b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 1 -- 172.21.15.148:0/1776864052 >> 172.21.15.148:0/1776864052 conn(0x7f8bf406fb90 msgr2=0x7f8bf406ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 1 -- 172.21.15.148:0/1776864052 shutdown_connections 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 1 -- 172.21.15.148:0/1776864052 wait complete. 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.811+0000 7f8bfb663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:17.813 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.812+0000 7f8bfb663640 1 Processor -- start 2024-09-21T21:20:17.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.812+0000 7f8bfb663640 1 -- start start 2024-09-21T21:20:17.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.812+0000 7f8bfb663640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:17.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.812+0000 7f8bfb663640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41a9e70 con 0x7f8bf4114fa0 2024-09-21T21:20:17.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.813+0000 7f8bf93ff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:17.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.813+0000 7f8bf93ff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.148:36882/0 (socket says 172.21.15.148:36882) 2024-09-21T21:20:17.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.813+0000 7f8bf93ff640 1 -- 172.21.15.148:0/1996639603 learned_addr learned my addr 172.21.15.148:0/1996639603 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T21:20:17.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.813+0000 7f8bf93ff640 1 -- 172.21.15.148:0/1996639603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf41a9fb0 con 0x7f8bf4114fa0 2024-09-21T21:20:17.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.813+0000 7f8bf93ff640 1 --2- 172.21.15.148:0/1996639603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41a98a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.814+0000 7f8be9ffb640 1 -- 172.21.15.148:0/1996639603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8be400eea0 con 0x7f8bf4114fa0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.814+0000 7f8be9ffb640 1 -- 172.21.15.148:0/1996639603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8be4015420 con 0x7f8bf4114fa0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.814+0000 7f8be9ffb640 1 -- 172.21.15.148:0/1996639603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8be40156c0 con 0x7f8bf4114fa0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.814+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf41aa200 con 0x7f8bf4114fa0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.814+0000 7f8be9ffb640 1 -- 172.21.15.148:0/1996639603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f8be4015c00 con 0x7f8bf4114fa0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.814+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf41af180 con 0x7f8bf4114fa0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.814+0000 7f8be9ffb640 1 -- 172.21.15.148:0/1996639603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7f8be4014900 con 0x7f8bf4114fa0 2024-09-21T21:20:17.816 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.815+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf41153b0 con 0x7f8bf4114fa0 2024-09-21T21:20:17.818 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.817+0000 7f8be9ffb640 1 -- 172.21.15.148:0/1996639603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f8be4014ac0 con 0x7f8bf4114fa0 2024-09-21T21:20:17.888 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.887+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14b1cc33-c87a-4e37-b778-3005207ab080", "id": 3} v 0) -- 0x7f8bf411a830 con 0x7f8bf4114fa0 2024-09-21T21:20:17.889 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.888+0000 7f8be9ffb640 1 -- 172.21.15.148:0/1996639603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14b1cc33-c87a-4e37-b778-3005207ab080", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7f8bf411a830 con 0x7f8bf4114fa0 2024-09-21T21:20:17.889 INFO:teuthology.orchestra.run.smithi148.stdout:3 2024-09-21T21:20:17.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.889+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 msgr2=0x7f8bf41a98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:17.890 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.889+0000 7f8bfb663640 1 --2- 172.21.15.148:0/1996639603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41a98a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.889+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 shutdown_connections 2024-09-21T21:20:17.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.889+0000 7f8bfb663640 1 --2- 172.21.15.148:0/1996639603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8bf4114fa0 0x7f8bf41a98a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:17.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.889+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 >> 172.21.15.148:0/1996639603 conn(0x7f8bf406fb90 msgr2=0x7f8bf41196f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:17.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.889+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 shutdown_connections 2024-09-21T21:20:17.891 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T21:20:17.889+0000 7f8bfb663640 1 -- 172.21.15.148:0/1996639603 wait complete. 2024-09-21T21:20:17.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-21T21:20:17.938 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-21T21:20:17.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-21T21:20:17.981 INFO:tasks.ceph.osd.0:Started 2024-09-21T21:20:17.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-21T21:20:18.015 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-21T21:20:18.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-21T21:20:18.057 INFO:tasks.ceph.osd.1:Started 2024-09-21T21:20:18.058 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-21T21:20:18.087 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-21T21:20:18.087 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-21T21:20:18.129 INFO:tasks.ceph.osd.2:Started 2024-09-21T21:20:18.129 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-21T21:20:18.158 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-21T21:20:18.158 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-21T21:20:18.200 INFO:tasks.ceph.osd.3:Started 2024-09-21T21:20:18.201 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T21:20:18.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.314+0000 7f572bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:18.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.319+0000 7f572bd91640 1 Processor -- start 2024-09-21T21:20:18.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.320+0000 7f572bd91640 1 -- start start 2024-09-21T21:20:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.322+0000 7f572bd91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f572409eb00 0x7f5724135e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.322+0000 7f572bd91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f572409fb20 con 0x7f57241363b0 2024-09-21T21:20:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.322+0000 7f572bd91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f572409f810 con 0x7f572409eb00 2024-09-21T21:20:18.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.322+0000 7f5729b2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f572409eb00 0x7f5724135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.322+0000 7f572932c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f57241363b0 0x7f572409c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34804/0 (socket says 172.21.15.5:34804) 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.322+0000 7f5729b2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f572409eb00 0x7f5724135e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52590/0 (socket says 172.21.15.5:52590) 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.322+0000 7f572932c640 1 -- 172.21.15.5:0/4277155162 learned_addr learned my addr 172.21.15.5:0/4277155162 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.323+0000 7f5729b2d640 1 -- 172.21.15.5:0/4277155162 >> v1:172.21.15.5:6789/0 conn(0x7f57241363b0 legacy=0x7f572409c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.323+0000 7f5729b2d640 1 -- 172.21.15.5:0/4277155162 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572409fdb0 con 0x7f572409eb00 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.323+0000 7f5729b2d640 1 --2- 172.21.15.5:0/4277155162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f5724135e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c71b42868113939 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.323+0000 7f5728b2b640 1 -- 172.21.15.5:0/4277155162 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5718009d90 con 0x7f572409eb00 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.323+0000 7f5728b2b640 1 -- 172.21.15.5:0/4277155162 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f571800e230 con 0x7f572409eb00 2024-09-21T21:20:18.325 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.323+0000 7f5728b2b640 1 -- 172.21.15.5:0/4277155162 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f571800e4d0 con 0x7f572409eb00 2024-09-21T21:20:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.324+0000 7f572bd91640 1 -- 172.21.15.5:0/4277155162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 msgr2=0x7f5724135e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.324+0000 7f572bd91640 1 --2- 172.21.15.5:0/4277155162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f5724135e70 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.324+0000 7f572bd91640 1 -- 172.21.15.5:0/4277155162 shutdown_connections 2024-09-21T21:20:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.324+0000 7f572bd91640 1 --2- 172.21.15.5:0/4277155162 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f5724135e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.324+0000 7f572bd91640 1 -- 172.21.15.5:0/4277155162 >> 172.21.15.5:0/4277155162 conn(0x7f57240a51b0 msgr2=0x7f57240a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.324+0000 7f572bd91640 1 -- 172.21.15.5:0/4277155162 shutdown_connections 2024-09-21T21:20:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.324+0000 7f572bd91640 1 -- 172.21.15.5:0/4277155162 wait complete. 2024-09-21T21:20:18.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.325+0000 7f572bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.327+0000 7f572bd91640 1 Processor -- start 2024-09-21T21:20:18.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.328+0000 7f572bd91640 1 -- start start 2024-09-21T21:20:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.330+0000 7f572bd91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f57241229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.330+0000 7f572bd91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57241243c0 con 0x7f572409eb00 2024-09-21T21:20:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.330+0000 7f5729b2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f57241229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.330+0000 7f5729b2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f57241229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52592/0 (socket says 172.21.15.5:52592) 2024-09-21T21:20:18.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.330+0000 7f5729b2d640 1 -- 172.21.15.5:0/512686498 learned_addr learned my addr 172.21.15.5:0/512686498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.330+0000 7f5729b2d640 1 -- 172.21.15.5:0/512686498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5724135c00 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f5729b2d640 1 --2- 172.21.15.5:0/512686498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f57241229d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f57167fc640 1 -- 172.21.15.5:0/512686498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5718014620 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f57167fc640 1 -- 172.21.15.5:0/512686498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5718014780 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f57167fc640 1 -- 172.21.15.5:0/512686498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5718014a20 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5724123b60 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57241251e0 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f57167fc640 1 -- 172.21.15.5:0/512686498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f5718013400 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.331+0000 7f57167fc640 1 -- 172.21.15.5:0/512686498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f5718019040 con 0x7f572409eb00 2024-09-21T21:20:18.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.332+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f572406a8d0 con 0x7f572409eb00 2024-09-21T21:20:18.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.334+0000 7f57167fc640 1 -- 172.21.15.5:0/512686498 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f5718012bd0 con 0x7f572409eb00 2024-09-21T21:20:18.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.396+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5724135d90 con 0x7f572409eb00 2024-09-21T21:20:18.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.397+0000 7f57167fc640 1 -- 172.21.15.5:0/512686498 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f5718012e20 con 0x7f572409eb00 2024-09-21T21:20:18.398 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:18.398 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"fsid":"ad0a953a-14f9-495f-aee8-909b91df1365","created":"2024-09-21T21:20:15.771330+0000","modified":"2024-09-21T21:20:17.888469+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T21:20:17.888469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"8d775b7f-81e2-4b8c-9603-a1de80d82d23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bedebb15-7f73-41ce-8112-42af3e421377","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"14b1cc33-c87a-4e37-b778-3005207ab080","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T21:20:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.398+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 msgr2=0x7f57241229d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.398+0000 7f572bd91640 1 --2- 172.21.15.5:0/512686498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f57241229d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.398+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 shutdown_connections 2024-09-21T21:20:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.398+0000 7f572bd91640 1 --2- 172.21.15.5:0/512686498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409eb00 0x7f57241229d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.398+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 >> 172.21.15.5:0/512686498 conn(0x7f57240a51b0 msgr2=0x7f57240a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.398+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 shutdown_connections 2024-09-21T21:20:18.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:18.398+0000 7f572bd91640 1 -- 172.21.15.5:0/512686498 wait complete. 2024-09-21T21:20:18.410 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-21T21:20:18.410 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-21T21:20:18.813 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T21:20:18.920 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.914+0000 7f1f07791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:18.921 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.919+0000 7f1f07791640 1 Processor -- start 2024-09-21T21:20:18.922 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.919+0000 7f1f07791640 1 -- start start 2024-09-21T21:20:18.924 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.921+0000 7f1f07791640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f00136d70 0x7f1f0013b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:18.924 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.921+0000 7f1f07791640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0006a150 con 0x7f1f000a1650 2024-09-21T21:20:18.924 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.921+0000 7f1f07791640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1f000a29f0 con 0x7f1f00136d70 2024-09-21T21:20:18.924 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.921+0000 7f1f04d2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f00136d70 0x7f1f0013b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.921+0000 7f1f04d2c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1f00136d70 0x7f1f0013b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52606/0 (socket says 172.21.15.5:52606) 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.921+0000 7f1f0552d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1f000a1650 0x7f1f00136660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:34820/0 (socket says 172.21.15.5:34820) 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.921+0000 7f1f04d2c640 1 -- 172.21.15.5:0/1041227767 learned_addr learned my addr 172.21.15.5:0/1041227767 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.922+0000 7f1f04d2c640 1 -- 172.21.15.5:0/1041227767 >> v1:172.21.15.5:6789/0 conn(0x7f1f000a1650 legacy=0x7f1f00136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.922+0000 7f1ef3fff640 1 -- 172.21.15.5:0/1041227767 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083666061 0 0) 0x7f1f0006a150 con 0x7f1f000a1650 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.922+0000 7f1f04d2c640 1 -- 172.21.15.5:0/1041227767 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f000a0e40 con 0x7f1f00136d70 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.922+0000 7f1f04d2c640 1 --2- 172.21.15.5:0/1041227767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f00136d70 0x7f1f0013b8a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b52c3139fc1b897 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.922+0000 7f1ef3fff640 1 -- 172.21.15.5:0/1041227767 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ef4009e50 con 0x7f1f00136d70 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.922+0000 7f1ef3fff640 1 -- 172.21.15.5:0/1041227767 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1ef400e230 con 0x7f1f00136d70 2024-09-21T21:20:18.925 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.922+0000 7f1ef3fff640 1 -- 172.21.15.5:0/1041227767 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1ef400e4d0 con 0x7f1f00136d70 2024-09-21T21:20:18.926 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 1 -- 172.21.15.5:0/1041227767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f00136d70 msgr2=0x7f1f0013b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:18.926 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 1 --2- 172.21.15.5:0/1041227767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f00136d70 0x7f1f0013b8a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.926 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 1 -- 172.21.15.5:0/1041227767 shutdown_connections 2024-09-21T21:20:18.926 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 1 --2- 172.21.15.5:0/1041227767 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f00136d70 0x7f1f0013b8a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.927 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 1 -- 172.21.15.5:0/1041227767 >> 172.21.15.5:0/1041227767 conn(0x7f1f000a65b0 msgr2=0x7f1f000a69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:18.927 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 1 -- 172.21.15.5:0/1041227767 shutdown_connections 2024-09-21T21:20:18.927 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 1 -- 172.21.15.5:0/1041227767 wait complete. 2024-09-21T21:20:18.927 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.923+0000 7f1f07791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:18.928 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.925+0000 7f1f07791640 1 Processor -- start 2024-09-21T21:20:18.928 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.925+0000 7f1f07791640 1 -- start start 2024-09-21T21:20:18.929 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.927+0000 7f1f07791640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a1650 0x7f1f00132470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:18.929 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.927+0000 7f1f07791640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00132ea0 con 0x7f1f000a1650 2024-09-21T21:20:18.929 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.927+0000 7f1f0552d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a1650 0x7f1f00132470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:18.929 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.927+0000 7f1f0552d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a1650 0x7f1f00132470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52614/0 (socket says 172.21.15.5:52614) 2024-09-21T21:20:18.929 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.927+0000 7f1f0552d640 1 -- 172.21.15.5:0/3186038675 learned_addr learned my addr 172.21.15.5:0/3186038675 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.927+0000 7f1f0552d640 1 -- 172.21.15.5:0/3186038675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f00130dc0 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.927+0000 7f1f0552d640 1 --2- 172.21.15.5:0/3186038675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a1650 0x7f1f00132470 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.928+0000 7f1ef1ffb640 1 -- 172.21.15.5:0/3186038675 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1efc004b80 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.928+0000 7f1ef1ffb640 1 -- 172.21.15.5:0/3186038675 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1efc004ce0 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.928+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f00132bb0 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.928+0000 7f1ef1ffb640 1 -- 172.21.15.5:0/3186038675 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1efc007120 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.928+0000 7f1ef1ffb640 1 -- 172.21.15.5:0/3186038675 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f1efc00c520 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.928+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f00133220 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.928+0000 7f1ef1ffb640 1 -- 172.21.15.5:0/3186038675 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f1efc007660 con 0x7f1f000a1650 2024-09-21T21:20:18.931 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.929+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f00131b50 con 0x7f1f000a1650 2024-09-21T21:20:18.934 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.931+0000 7f1ef1ffb640 1 -- 172.21.15.5:0/3186038675 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (crc 0 0 0) 0x7f1efc00e1c0 con 0x7f1f000a1650 2024-09-21T21:20:18.996 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.994+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f00131580 con 0x7f1f000a1650 2024-09-21T21:20:18.997 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.995+0000 7f1ef1ffb640 1 -- 172.21.15.5:0/3186038675 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f1efc00ca50 con 0x7f1f000a1650 2024-09-21T21:20:18.997 INFO:teuthology.misc.health.smithi005.stdout: 2024-09-21T21:20:18.997 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":7,"fsid":"ad0a953a-14f9-495f-aee8-909b91df1365","created":"2024-09-21T21:20:15.771330+0000","modified":"2024-09-21T21:20:17.888469+0000","last_up_change":"0.000000","last_in_change":"2024-09-21T21:20:17.888469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"8d775b7f-81e2-4b8c-9603-a1de80d82d23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bedebb15-7f73-41ce-8112-42af3e421377","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"14b1cc33-c87a-4e37-b778-3005207ab080","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T21:20:18.998 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.996+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a1650 msgr2=0x7f1f00132470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:18.998 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.996+0000 7f1f07791640 1 --2- 172.21.15.5:0/3186038675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a1650 0x7f1f00132470 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.998 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.996+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 shutdown_connections 2024-09-21T21:20:18.998 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.996+0000 7f1f07791640 1 --2- 172.21.15.5:0/3186038675 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f000a1650 0x7f1f00132470 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:18.999 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.996+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 >> 172.21.15.5:0/3186038675 conn(0x7f1f000a65b0 msgr2=0x7f1f000a3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:18.999 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.996+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 shutdown_connections 2024-09-21T21:20:18.999 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:18.996+0000 7f1f07791640 1 -- 172.21.15.5:0/3186038675 wait complete. 2024-09-21T21:20:19.008 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-21T21:20:22.077 INFO:tasks.ceph.mgr.x.smithi148.stderr:2024-09-21T21:20:22.076+0000 7f490255c640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-21T21:20:25.412 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-21T21:20:25.529 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.524+0000 7f437f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:25.531 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.529+0000 7f437f151640 1 Processor -- start 2024-09-21T21:20:25.531 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.529+0000 7f437f151640 1 -- start start 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.531+0000 7f437f151640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4378134740 0x7f4378139070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.531+0000 7f437f151640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43780a5ae0 con 0x7f4378133c20 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.531+0000 7f437f151640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f437809dc80 con 0x7f4378134740 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.531+0000 7f4377fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4378134740 0x7f4378139070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.531+0000 7f437ceed640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4378133c20 0x7f4378134030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41862/0 (socket says 172.21.15.5:41862) 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.531+0000 7f437ceed640 1 -- 172.21.15.5:0/3957725217 learned_addr learned my addr 172.21.15.5:0/3957725217 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.532+0000 7f4377fff640 1 -- 172.21.15.5:0/3957725217 >> v1:172.21.15.5:6789/0 conn(0x7f4378133c20 legacy=0x7f4378134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.532+0000 7f4377fff640 1 -- 172.21.15.5:0/3957725217 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437809e250 con 0x7f4378134740 2024-09-21T21:20:25.533 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.532+0000 7f4377fff640 1 --2- 172.21.15.5:0/3957725217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378134740 0x7f4378139070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd968dfb583b58b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:25.534 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.532+0000 7f43777fe640 1 -- 172.21.15.5:0/3957725217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f436c009d90 con 0x7f4378134740 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.532+0000 7f43777fe640 1 -- 172.21.15.5:0/3957725217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f436c00e230 con 0x7f4378134740 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.532+0000 7f43777fe640 1 -- 172.21.15.5:0/3957725217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f436c00e4d0 con 0x7f4378134740 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 1 -- 172.21.15.5:0/3957725217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378134740 msgr2=0x7f4378139070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 1 --2- 172.21.15.5:0/3957725217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378134740 0x7f4378139070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 1 -- 172.21.15.5:0/3957725217 shutdown_connections 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 1 --2- 172.21.15.5:0/3957725217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378134740 0x7f4378139070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 1 -- 172.21.15.5:0/3957725217 >> 172.21.15.5:0/3957725217 conn(0x7f43780a43d0 msgr2=0x7f4378073af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 1 -- 172.21.15.5:0/3957725217 shutdown_connections 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 1 -- 172.21.15.5:0/3957725217 wait complete. 2024-09-21T21:20:25.535 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.533+0000 7f437f151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:25.536 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.535+0000 7f437f151640 1 Processor -- start 2024-09-21T21:20:25.536 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.535+0000 7f437f151640 1 -- start start 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437f151640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378133c20 0x7f4378120f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437f151640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4378133ae0 con 0x7f4378133c20 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437ceed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378133c20 0x7f4378120f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437ceed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378133c20 0x7f4378120f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34092/0 (socket says 172.21.15.5:34092) 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437ceed640 1 -- 172.21.15.5:0/2517319608 learned_addr learned my addr 172.21.15.5:0/2517319608 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437ceed640 1 -- 172.21.15.5:0/2517319608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4378124500 con 0x7f4378133c20 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437ceed640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378133c20 0x7f4378120f70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f43757fa640 1 -- 172.21.15.5:0/2517319608 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4368005a60 con 0x7f4378133c20 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f43757fa640 1 -- 172.21.15.5:0/2517319608 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4368005bc0 con 0x7f4378133c20 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f43757fa640 1 -- 172.21.15.5:0/2517319608 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4368005e60 con 0x7f4378133c20 2024-09-21T21:20:25.539 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4378120590 con 0x7f4378133c20 2024-09-21T21:20:25.540 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.537+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4378122f50 con 0x7f4378133c20 2024-09-21T21:20:25.540 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.539+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4378134030 con 0x7f4378133c20 2024-09-21T21:20:25.540 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.539+0000 7f43757fa640 1 -- 172.21.15.5:0/2517319608 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (crc 0 0 0) 0x7f43680070b0 con 0x7f4378133c20 2024-09-21T21:20:25.540 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.539+0000 7f43757fa640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f436403e9f0 0x7f4364040f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:25.541 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.539+0000 7f43757fa640 1 -- 172.21.15.5:0/2517319608 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2308+0+0 (crc 0 0 0) 0x7f436804f670 con 0x7f4378133c20 2024-09-21T21:20:25.541 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.539+0000 7f4377fff640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f436403e9f0 0x7f4364040f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:25.541 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.540+0000 7f4377fff640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f436403e9f0 0x7f4364040f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:25.546 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.545+0000 7f43757fa640 1 -- 172.21.15.5:0/2517319608 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f436800dc10 con 0x7f4378133c20 2024-09-21T21:20:25.738 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.736+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4378122ca0 con 0x7f4378133c20 2024-09-21T21:20:25.738 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.737+0000 7f43757fa640 1 -- 172.21.15.5:0/2517319608 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6940 (crc 0 0 0) 0x7f436800d610 con 0x7f4378133c20 2024-09-21T21:20:25.738 INFO:teuthology.misc.health.smithi005.stdout: 2024-09-21T21:20:25.739 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":11,"fsid":"ad0a953a-14f9-495f-aee8-909b91df1365","created":"2024-09-21T21:20:15.771330+0000","modified":"2024-09-21T21:20:25.135404+0000","last_up_change":"2024-09-21T21:20:24.128887+0000","last_in_change":"2024-09-21T21:20:17.888469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T21:20:25.091063+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d775b7f-81e2-4b8c-9603-a1de80d82d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":1340303177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1340303177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1340303177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1340303177}]},"public_addr":"172.21.15.5:6801/1340303177","cluster_addr":"172.21.15.5:6800/1340303177","heartbeat_back_addr":"172.21.15.5:6807/1340303177","heartbeat_front_addr":"172.21.15.5:6806/1340303177","state":["exists","up"]},{"osd":1,"uuid":"bedebb15-7f73-41ce-8112-42af3e421377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1102615197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":1102615197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1102615197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1102615197}]},"public_addr":"172.21.15.5:6804/1102615197","cluster_addr":"172.21.15.5:6803/1102615197","heartbeat_back_addr":"172.21.15.5:6805/1102615197","heartbeat_front_addr":"172.21.15.5:6802/1102615197","state":["exists","up"]},{"osd":2,"uuid":"8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6803","nonce":877610312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":877610312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":877610312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":877610312}]},"public_addr":"172.21.15.148:6803/877610312","cluster_addr":"172.21.15.148:6804/877610312","heartbeat_back_addr":"172.21.15.148:6815/877610312","heartbeat_front_addr":"172.21.15.148:6816/877610312","state":["exists","up"]},{"osd":3,"uuid":"14b1cc33-c87a-4e37-b778-3005207ab080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6805","nonce":1161645252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1161645252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1161645252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6809","nonce":1161645252}]},"public_addr":"172.21.15.148:6805/1161645252","cluster_addr":"172.21.15.148:6802/1161645252","heartbeat_back_addr":"172.21.15.148:6808/1161645252","heartbeat_front_addr":"172.21.15.148:6809/1161645252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T21:20:25.741 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f436403e9f0 msgr2=0x7f4364040f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:25.741 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f436403e9f0 0x7f4364040f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.741 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378133c20 msgr2=0x7f4378120f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:25.741 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378133c20 0x7f4378120f70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.741 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 shutdown_connections 2024-09-21T21:20:25.742 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f436403e9f0 0x7f4364040f00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.742 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 --2- 172.21.15.5:0/2517319608 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4378133c20 0x7f4378120f70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.742 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 >> 172.21.15.5:0/2517319608 conn(0x7f43780a43d0 msgr2=0x7f4378071ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:25.742 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 shutdown_connections 2024-09-21T21:20:25.742 INFO:teuthology.misc.health.smithi005.stderr:2024-09-21T21:20:25.740+0000 7f437f151640 1 -- 172.21.15.5:0/2517319608 wait complete. 2024-09-21T21:20:25.751 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-21T21:20:25.751 INFO:tasks.ceph:Creating RBD pool 2024-09-21T21:20:25.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-21T21:20:25.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.855+0000 7fd00e8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:25.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.864+0000 7fd00e8ac640 1 Processor -- start 2024-09-21T21:20:25.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.864+0000 7fd00e8ac640 1 -- start start 2024-09-21T21:20:25.868 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd00e8ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd00809e500 0x7fd00813b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd00e8ac640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0080a1100 con 0x7fd00809d9e0 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd00e8ac640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd0080a02d0 con 0x7fd00809e500 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fcffffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd00809e500 0x7fd00813b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd007fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd00809d9e0 0x7fd00809ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41864/0 (socket says 172.21.15.5:41864) 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fcffffff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd00809e500 0x7fd00813b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34102/0 (socket says 172.21.15.5:34102) 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd007fff640 1 -- 172.21.15.5:0/1175739443 learned_addr learned my addr 172.21.15.5:0/1175739443 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fcffffff640 1 -- 172.21.15.5:0/1175739443 >> v1:172.21.15.5:6789/0 conn(0x7fd00809d9e0 legacy=0x7fd00809ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fcffffff640 1 -- 172.21.15.5:0/1175739443 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00809fd90 con 0x7fd00809e500 2024-09-21T21:20:25.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd0077fe640 1 -- 172.21.15.5:0/1175739443 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566035981 0 0) 0x7fd0080a1100 con 0x7fd00809d9e0 2024-09-21T21:20:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fcffffff640 1 --2- 172.21.15.5:0/1175739443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809e500 0x7fd00813b1e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561962d0e0e8e254 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd0077fe640 1 -- 172.21.15.5:0/1175739443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff0009d80 con 0x7fd00809e500 2024-09-21T21:20:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd0077fe640 1 -- 172.21.15.5:0/1175739443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcff000e230 con 0x7fd00809e500 2024-09-21T21:20:25.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.866+0000 7fd0077fe640 1 -- 172.21.15.5:0/1175739443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff000e4d0 con 0x7fd00809e500 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.867+0000 7fd00e8ac640 1 -- 172.21.15.5:0/1175739443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809e500 msgr2=0x7fd00813b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.867+0000 7fd00e8ac640 1 --2- 172.21.15.5:0/1175739443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809e500 0x7fd00813b1e0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.867+0000 7fd00e8ac640 1 -- 172.21.15.5:0/1175739443 shutdown_connections 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.867+0000 7fd00e8ac640 1 --2- 172.21.15.5:0/1175739443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809e500 0x7fd00813b1e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.867+0000 7fd00e8ac640 1 -- 172.21.15.5:0/1175739443 >> 172.21.15.5:0/1175739443 conn(0x7fd00806ea80 msgr2=0x7fd00806ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.867+0000 7fd00e8ac640 1 -- 172.21.15.5:0/1175739443 shutdown_connections 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.867+0000 7fd00e8ac640 1 -- 172.21.15.5:0/1175739443 wait complete. 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.868+0000 7fd00e8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:25.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.869+0000 7fd00e8ac640 1 Processor -- start 2024-09-21T21:20:25.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.869+0000 7fd00e8ac640 1 -- start start 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd00e8ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809d9e0 0x7fd008124100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd00e8ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd0081237b0 con 0x7fd00809d9e0 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd007fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809d9e0 0x7fd008124100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd007fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809d9e0 0x7fd008124100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34116/0 (socket says 172.21.15.5:34116) 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd007fff640 1 -- 172.21.15.5:0/288220785 learned_addr learned my addr 172.21.15.5:0/288220785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd007fff640 1 -- 172.21.15.5:0/288220785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd008123d40 con 0x7fd00809d9e0 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd007fff640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809d9e0 0x7fd008124100 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.871+0000 7fd0057fa640 1 -- 172.21.15.5:0/288220785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff8004b80 con 0x7fd00809d9e0 2024-09-21T21:20:25.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.872+0000 7fd0057fa640 1 -- 172.21.15.5:0/288220785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcff8004ce0 con 0x7fd00809d9e0 2024-09-21T21:20:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.872+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0081252a0 con 0x7fd00809d9e0 2024-09-21T21:20:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.872+0000 7fd0057fa640 1 -- 172.21.15.5:0/288220785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcff8007120 con 0x7fd00809d9e0 2024-09-21T21:20:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.872+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd008127720 con 0x7fd00809d9e0 2024-09-21T21:20:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.873+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd008123ba0 con 0x7fd00809d9e0 2024-09-21T21:20:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.873+0000 7fd0057fa640 1 -- 172.21.15.5:0/288220785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (crc 0 0 0) 0x7fcff80072d0 con 0x7fd00809d9e0 2024-09-21T21:20:25.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.873+0000 7fd0057fa640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcfe803ea70 0x7fcfe8040f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:25.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.873+0000 7fd0057fa640 1 -- 172.21.15.5:0/288220785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2308+0+0 (crc 0 0 0) 0x7fcff804f730 con 0x7fd00809d9e0 2024-09-21T21:20:25.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.873+0000 7fcffffff640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcfe803ea70 0x7fcfe8040f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:25.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.874+0000 7fcffffff640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcfe803ea70 0x7fcfe8040f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:25.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:25.879+0000 7fd0057fa640 1 -- 172.21.15.5:0/288220785 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fd008123ba0 con 0x7fd00809d9e0 2024-09-21T21:20:26.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.070+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fd008123ba0 con 0x7fd00809d9e0 2024-09-21T21:20:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.139+0000 7fd0057fa640 1 -- 172.21.15.5:0/288220785 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7fd008123ba0 con 0x7fd00809d9e0 2024-09-21T21:20:26.141 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcfe803ea70 msgr2=0x7fcfe8040f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcfe803ea70 0x7fcfe8040f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809d9e0 msgr2=0x7fd008124100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809d9e0 0x7fd008124100 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 shutdown_connections 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcfe803ea70 0x7fcfe8040f80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 --2- 172.21.15.5:0/288220785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd00809d9e0 0x7fd008124100 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.142+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 >> 172.21.15.5:0/288220785 conn(0x7fd00806ea80 msgr2=0x7fd0081bbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:26.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.143+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 shutdown_connections 2024-09-21T21:20:26.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.143+0000 7fd00e8ac640 1 -- 172.21.15.5:0/288220785 wait complete. 2024-09-21T21:20:26.160 DEBUG:teuthology.orchestra.run.smithi005:> rbd --cluster ceph pool init rbd 2024-09-21T21:20:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.255+0000 7fac4623eac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:26.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.255+0000 7fac4623eac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.256+0000 7fac4623eac0 1 Processor -- start 2024-09-21T21:20:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.256+0000 7fac4623eac0 1 -- start start 2024-09-21T21:20:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac4623eac0 1 --2- >> v2:172.21.15.5:3300/0 conn(0x1901ea0 0x19022b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:26.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac4623eac0 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x1766180 con 0x19027f0 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac4623eac0 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x17a5b90 con 0x1901ea0 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac3bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x1901ea0 0x19022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac3bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x1901ea0 0x19022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34124/0 (socket says 172.21.15.5:34124) 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac337fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x19027f0 0x1996be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41868/0 (socket says 172.21.15.5:41868) 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac3bfff640 1 -- 172.21.15.5:0/1833131078 learned_addr learned my addr 172.21.15.5:0/1833131078 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac3bfff640 1 -- 172.21.15.5:0/1833131078 >> v1:172.21.15.5:6789/0 conn(0x19027f0 legacy=0x1996be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac3bfff640 1 -- 172.21.15.5:0/1833131078 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x173bf80 con 0x1901ea0 2024-09-21T21:20:26.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.258+0000 7fac3b7fe640 1 -- 172.21.15.5:0/1833131078 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954481764 0 0) 0x1766180 con 0x19027f0 2024-09-21T21:20:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac3bfff640 1 --2- 172.21.15.5:0/1833131078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x19022b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3260014a3069f45c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac3b7fe640 1 -- 172.21.15.5:0/1833131078 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fac2c02d820 con 0x1901ea0 2024-09-21T21:20:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac3b7fe640 1 -- 172.21.15.5:0/1833131078 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fac2c02d980 con 0x1901ea0 2024-09-21T21:20:26.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac3b7fe640 1 -- 172.21.15.5:0/1833131078 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fac2c02dc20 con 0x1901ea0 2024-09-21T21:20:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac4623eac0 1 -- 172.21.15.5:0/1833131078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 msgr2=0x19022b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac4623eac0 1 --2- 172.21.15.5:0/1833131078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x19022b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac4623eac0 1 -- 172.21.15.5:0/1833131078 shutdown_connections 2024-09-21T21:20:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac4623eac0 1 --2- 172.21.15.5:0/1833131078 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x19022b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:26.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac4623eac0 1 -- 172.21.15.5:0/1833131078 >> 172.21.15.5:0/1833131078 conn(0x170ef70 msgr2=0x18ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac4623eac0 1 -- 172.21.15.5:0/1833131078 shutdown_connections 2024-09-21T21:20:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.260+0000 7fac4623eac0 1 -- 172.21.15.5:0/1833131078 wait complete. 2024-09-21T21:20:26.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.261+0000 7fac4623eac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.262+0000 7fac4623eac0 1 Processor -- start 2024-09-21T21:20:26.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.263+0000 7fac4623eac0 1 -- start start 2024-09-21T21:20:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.264+0000 7fac4623eac0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x1985a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.264+0000 7fac4623eac0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x17b08f0 con 0x1901ea0 2024-09-21T21:20:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.264+0000 7fac3bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x1985a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.264+0000 7fac3bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x1985a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34130/0 (socket says 172.21.15.5:34130) 2024-09-21T21:20:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.264+0000 7fac3bfff640 1 -- 172.21.15.5:0/2709835246 learned_addr learned my addr 172.21.15.5:0/2709835246 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:26.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.264+0000 7fac3bfff640 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x174a800 con 0x1901ea0 2024-09-21T21:20:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.265+0000 7fac3bfff640 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x1985a90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.265+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fac2c02d820 con 0x1901ea0 2024-09-21T21:20:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.265+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fac2c0057c0 con 0x1901ea0 2024-09-21T21:20:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.265+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x173c310 con 0x1901ea0 2024-09-21T21:20:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.265+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fac2c02dc20 con 0x1901ea0 2024-09-21T21:20:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.265+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x173bd70 con 0x1901ea0 2024-09-21T21:20:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.266+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (crc 0 0 0) 0x7fac2c006d60 con 0x1901ea0 2024-09-21T21:20:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.266+0000 7fac38ff9640 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fac1c03d2d0 0x7fac1c03f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.266+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7fac2c032040 con 0x1901ea0 2024-09-21T21:20:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.266+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x1986b10 con 0x1901ea0 2024-09-21T21:20:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.266+0000 7fac337fe640 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fac1c03d2d0 0x7fac1c03f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:26.267+0000 7fac337fe640 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fac1c03d2d0 0x7fac1c03f7e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:27.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.147+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 141+0+0 (crc 0 0 0) 0x7fac2c0385d0 con 0x1901ea0 2024-09-21T21:20:27.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.147+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x1763520 con 0x1901ea0 2024-09-21T21:20:27.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.149+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (crc 0 0 0) 0x7fac2c0385d0 con 0x1901ea0 2024-09-21T21:20:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.149+0000 7fac3affd640 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=13}) -- 0x7fac20002ae0 con 0x1901ea0 2024-09-21T21:20:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.150+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(13..13 src has 1..13) ==== 1028+0+0 (crc 0 0 0) 0x7fac2c039e40 con 0x1901ea0 2024-09-21T21:20:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.150+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6804/1102615197 conn(0x19027f0 0x19ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:27.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.150+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) -- 0x19ac720 con 0x19027f0 2024-09-21T21:20:27.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.155+0000 7fac4173a640 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6804/1102615197 conn(0x19027f0 0x19ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:20:27.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.232+0000 7fac4173a640 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6804/1102615197 conn(0x19027f0 0x19ac1e0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:27.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.248+0000 7fac4173a640 1 -- 172.21.15.5:0/2709835246 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== osd_op_reply(1 rbd_trash [create] v13'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7fac3400a4b0 con 0x19027f0 2024-09-21T21:20:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.251+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6801/1340303177 conn(0x1a033a0 0x1a05880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:27.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.251+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x1a05e50 con 0x1a033a0 2024-09-21T21:20:27.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.252+0000 7fac3bfff640 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6801/1340303177 conn(0x1a033a0 0x1a05880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:20:27.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.255+0000 7fac3bfff640 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6801/1340303177 conn(0x1a033a0 0x1a05880 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.260+0000 7fac3bfff640 1 -- 172.21.15.5:0/2709835246 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fac2c035040 con 0x1a033a0 2024-09-21T21:20:27.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.260+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e13) -- 0x1a02860 con 0x1a033a0 2024-09-21T21:20:27.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.263+0000 7fac3bfff640 1 -- 172.21.15.5:0/2709835246 <== osd.0 v2:172.21.15.5:6801/1340303177 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fac2c035040 con 0x1a033a0 2024-09-21T21:20:27.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.263+0000 7fac3a7fc640 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fac14001f60 con 0x1901ea0 2024-09-21T21:20:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:27.795+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fac2c035ba0 con 0x1901ea0 2024-09-21T21:20:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:28.150+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v14) ==== 55+0+0 (crc 0 0 0) 0x7fac2c033d40 con 0x1901ea0 2024-09-21T21:20:28.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:28.150+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=14}) -- 0x7fac1c042c40 con 0x1901ea0 2024-09-21T21:20:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:28.154+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 11 ==== osd_map(14..14 src has 1..14) ==== 626+0+0 (crc 0 0 0) 0x7fac2c072750 con 0x1901ea0 2024-09-21T21:20:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:28.154+0000 7fac3affd640 1 -- 172.21.15.5:0/2709835246 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) -- 0x7fac20005640 con 0x1a033a0 2024-09-21T21:20:28.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:28.177+0000 7fac3bfff640 1 -- 172.21.15.5:0/2709835246 <== osd.0 v2:172.21.15.5:6801/1340303177 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v14'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fac2c035040 con 0x1a033a0 2024-09-21T21:20:28.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:28.177+0000 7fac3a7fc640 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v14) -- 0x7fac14003370 con 0x1901ea0 2024-09-21T21:20:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.154+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v15) ==== 43+0+0 (crc 0 0 0) 0x7fac2c056590 con 0x1901ea0 2024-09-21T21:20:29.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.154+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7fac1c042dd0 con 0x1901ea0 2024-09-21T21:20:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.159+0000 7fac38ff9640 1 -- 172.21.15.5:0/2709835246 <== mon.0 v2:172.21.15.5:3300/0 13 ==== osd_map(15..15 src has 1..15) ==== 654+0+0 (crc 0 0 0) 0x7fac2c056590 con 0x1901ea0 2024-09-21T21:20:29.161 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.159+0000 7fac3affd640 1 -- 172.21.15.5:0/2709835246 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x7fac200059e0 con 0x1a033a0 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.182+0000 7fac3bfff640 1 -- 172.21.15.5:0/2709835246 <== osd.0 v2:172.21.15.5:6801/1340303177 4 ==== osd_op_reply(7 rbd_info [write 0~19] v15'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac2c035040 con 0x1a033a0 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6801/1340303177 conn(0x1a033a0 msgr2=0x1a05880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6801/1340303177 conn(0x1a033a0 0x1a05880 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6804/1102615197 conn(0x19027f0 msgr2=0x19ac1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6804/1102615197 conn(0x19027f0 0x19ac1e0 crc :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fac1c03d2d0 msgr2=0x7fac1c03f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fac1c03d2d0 0x7fac1c03f7e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 msgr2=0x1985a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x1985a90 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 shutdown_connections 2024-09-21T21:20:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6801/1340303177 conn(0x1a033a0 0x1a05880 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> v2:172.21.15.5:6804/1102615197 conn(0x19027f0 0x19ac1e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fac1c03d2d0 0x7fac1c03f7e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 --2- 172.21.15.5:0/2709835246 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1901ea0 0x1985a90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 >> 172.21.15.5:0/2709835246 conn(0x170ef70 msgr2=0x190a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 shutdown_connections 2024-09-21T21:20:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.183+0000 7fac4623eac0 1 -- 172.21.15.5:0/2709835246 wait complete. 2024-09-21T21:20:29.189 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-21T21:20:29.190 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-21T21:20:29.190 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-21T21:20:29.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.299+0000 7f0f64f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.305+0000 7f0f64f91640 1 Processor -- start 2024-09-21T21:20:29.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.306+0000 7f0f64f91640 1 -- start start 2024-09-21T21:20:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.307+0000 7f0f64f91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f6009be00 0x7f0f6009c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:29.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.307+0000 7f0f64f91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6006f8e0 con 0x7f0f6009c750 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.307+0000 7f0f64f91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f0f6006f3b0 con 0x7f0f6009be00 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.307+0000 7f0f5e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f6009be00 0x7f0f6009c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.307+0000 7f0f5dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f0f6009c750 0x7f0f6009a120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41884/0 (socket says 172.21.15.5:41884) 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.307+0000 7f0f5e59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f0f6009be00 0x7f0f6009c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34136/0 (socket says 172.21.15.5:34136) 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.307+0000 7f0f5dd9b640 1 -- 172.21.15.5:0/2711755746 learned_addr learned my addr 172.21.15.5:0/2711755746 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.308+0000 7f0f5e59c640 1 -- 172.21.15.5:0/2711755746 >> v1:172.21.15.5:6789/0 conn(0x7f0f6009c750 legacy=0x7f0f6009a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.308+0000 7f0f5d59a640 1 -- 172.21.15.5:0/2711755746 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1848502700 0 0) 0x7f0f6006f8e0 con 0x7f0f6009c750 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.308+0000 7f0f5e59c640 1 -- 172.21.15.5:0/2711755746 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6009cf30 con 0x7f0f6009be00 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.308+0000 7f0f5e59c640 1 --2- 172.21.15.5:0/2711755746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f6009c210 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a22072ef7b4fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:29.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.308+0000 7f0f5d59a640 1 -- 172.21.15.5:0/2711755746 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f5000f040 con 0x7f0f6009be00 2024-09-21T21:20:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.308+0000 7f0f5d59a640 1 -- 172.21.15.5:0/2711755746 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f5000a1e0 con 0x7f0f6009be00 2024-09-21T21:20:29.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.308+0000 7f0f5d59a640 1 -- 172.21.15.5:0/2711755746 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f50008780 con 0x7f0f6009be00 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 1 -- 172.21.15.5:0/2711755746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 msgr2=0x7f0f6009c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 1 --2- 172.21.15.5:0/2711755746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f6009c210 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 1 -- 172.21.15.5:0/2711755746 shutdown_connections 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 1 --2- 172.21.15.5:0/2711755746 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f6009c210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 1 -- 172.21.15.5:0/2711755746 >> 172.21.15.5:0/2711755746 conn(0x7f0f600a4070 msgr2=0x7f0f600a4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 1 -- 172.21.15.5:0/2711755746 shutdown_connections 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 1 -- 172.21.15.5:0/2711755746 wait complete. 2024-09-21T21:20:29.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.309+0000 7f0f64f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.311+0000 7f0f64f91640 1 Processor -- start 2024-09-21T21:20:29.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.311+0000 7f0f64f91640 1 -- start start 2024-09-21T21:20:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f64f91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f601c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f64f91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601305b0 con 0x7f0f6009be00 2024-09-21T21:20:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f5e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f601c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f5e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f601c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34142/0 (socket says 172.21.15.5:34142) 2024-09-21T21:20:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f5e59c640 1 -- 172.21.15.5:0/1940781309 learned_addr learned my addr 172.21.15.5:0/1940781309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f5e59c640 1 -- 172.21.15.5:0/1940781309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f601307e0 con 0x7f0f6009be00 2024-09-21T21:20:29.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f5e59c640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f601c6670 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f4effd640 1 -- 172.21.15.5:0/1940781309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f50017040 con 0x7f0f6009be00 2024-09-21T21:20:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f4effd640 1 -- 172.21.15.5:0/1940781309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0f5000a520 con 0x7f0f6009be00 2024-09-21T21:20:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f60132a60 con 0x7f0f6009be00 2024-09-21T21:20:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f4effd640 1 -- 172.21.15.5:0/1940781309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0f5000f040 con 0x7f0f6009be00 2024-09-21T21:20:29.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.313+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6012ef70 con 0x7f0f6009be00 2024-09-21T21:20:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.314+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6009e370 con 0x7f0f6009be00 2024-09-21T21:20:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.314+0000 7f0f4effd640 1 -- 172.21.15.5:0/1940781309 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f0f50012b40 con 0x7f0f6009be00 2024-09-21T21:20:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.315+0000 7f0f4effd640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0f4003ead0 0x7f0f40040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.315+0000 7f0f4effd640 1 -- 172.21.15.5:0/1940781309 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f0f500527f0 con 0x7f0f6009be00 2024-09-21T21:20:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.315+0000 7f0f5dd9b640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0f4003ead0 0x7f0f40040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:29.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.316+0000 7f0f5dd9b640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0f4003ead0 0x7f0f40040fe0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:29.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.320+0000 7f0f4effd640 1 -- 172.21.15.5:0/1940781309 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f0f5000e8b0 con 0x7f0f6009be00 2024-09-21T21:20:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.509+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f0f6006a8d0 con 0x7f0f6009be00 2024-09-21T21:20:29.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.510+0000 7f0f4effd640 1 -- 172.21.15.5:0/1940781309 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (crc 0 0 0) 0x7f0f5000e130 con 0x7f0f6009be00 2024-09-21T21:20:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:29.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.512+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0f4003ead0 msgr2=0x7f0f40040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.512+0000 7f0f64f91640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0f4003ead0 0x7f0f40040fe0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.512+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 msgr2=0x7f0f601c6670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.514 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.512+0000 7f0f64f91640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f601c6670 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.513+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 shutdown_connections 2024-09-21T21:20:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.513+0000 7f0f64f91640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0f4003ead0 0x7f0f40040fe0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.513+0000 7f0f64f91640 1 --2- 172.21.15.5:0/1940781309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6009be00 0x7f0f601c6670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.513+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 >> 172.21.15.5:0/1940781309 conn(0x7f0f600a4070 msgr2=0x7f0f60072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.513+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 shutdown_connections 2024-09-21T21:20:29.515 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.513+0000 7f0f64f91640 1 -- 172.21.15.5:0/1940781309 wait complete. 2024-09-21T21:20:29.525 INFO:teuthology.orchestra.run.smithi005.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-21T21:20:29.525 INFO:tasks.ceph_manager:config epoch is 1 2024-09-21T21:20:29.525 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T21:20:29.525 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-21T21:20:29.525 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-21T21:20:29.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.633+0000 7f35e2cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.638+0000 7f35e2cfd640 1 Processor -- start 2024-09-21T21:20:29.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.638+0000 7f35e2cfd640 1 -- start start 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e2cfd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35dc09da50 0x7f35dc09c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e2cfd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc09e2e0 con 0x7f35dc09cf10 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e2cfd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f35dc073d20 con 0x7f35dc09da50 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e0a99640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35dc09da50 0x7f35dc09c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e0a99640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f35dc09da50 0x7f35dc09c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34148/0 (socket says 172.21.15.5:34148) 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35dbfff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f35dc09cf10 0x7f35dc133b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41898/0 (socket says 172.21.15.5:41898) 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e0a99640 1 -- 172.21.15.5:0/1602599322 learned_addr learned my addr 172.21.15.5:0/1602599322 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e0a99640 1 -- 172.21.15.5:0/1602599322 >> v1:172.21.15.5:6789/0 conn(0x7f35dc09cf10 legacy=0x7f35dc133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e0a99640 1 -- 172.21.15.5:0/1602599322 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc09ee80 con 0x7f35dc09da50 2024-09-21T21:20:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35e0a99640 1 --2- 172.21.15.5:0/1602599322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09da50 0x7f35dc09c9d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2aee49dc598068 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.640+0000 7f35db7fe640 1 -- 172.21.15.5:0/1602599322 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35cc00e040 con 0x7f35dc09da50 2024-09-21T21:20:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35db7fe640 1 -- 172.21.15.5:0/1602599322 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f35cc0091e0 con 0x7f35dc09da50 2024-09-21T21:20:29.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35db7fe640 1 -- 172.21.15.5:0/1602599322 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35cc007730 con 0x7f35dc09da50 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1602599322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09da50 msgr2=0x7f35dc09c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35e2cfd640 1 --2- 172.21.15.5:0/1602599322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09da50 0x7f35dc09c9d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1602599322 shutdown_connections 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35e2cfd640 1 --2- 172.21.15.5:0/1602599322 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09da50 0x7f35dc09c9d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1602599322 >> 172.21.15.5:0/1602599322 conn(0x7f35dc0a42d0 msgr2=0x7f35dc073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1602599322 shutdown_connections 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.641+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1602599322 wait complete. 2024-09-21T21:20:29.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.642+0000 7f35e2cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:29.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.644+0000 7f35e2cfd640 1 Processor -- start 2024-09-21T21:20:29.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.644+0000 7f35e2cfd640 1 -- start start 2024-09-21T21:20:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.646+0000 7f35e2cfd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09cf10 0x7f35dc121710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.646+0000 7f35e2cfd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc123190 con 0x7f35dc09cf10 2024-09-21T21:20:29.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.646+0000 7f35e0a99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09cf10 0x7f35dc121710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.646+0000 7f35e0a99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09cf10 0x7f35dc121710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34152/0 (socket says 172.21.15.5:34152) 2024-09-21T21:20:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.646+0000 7f35e0a99640 1 -- 172.21.15.5:0/1536034857 learned_addr learned my addr 172.21.15.5:0/1536034857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:29.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.646+0000 7f35e0a99640 1 -- 172.21.15.5:0/1536034857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc122950 con 0x7f35dc09cf10 2024-09-21T21:20:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.646+0000 7f35e0a99640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09cf10 0x7f35dc121710 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.647+0000 7f35d97fa640 1 -- 172.21.15.5:0/1536034857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35cc00e040 con 0x7f35dc09cf10 2024-09-21T21:20:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.647+0000 7f35d97fa640 1 -- 172.21.15.5:0/1536034857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f35cc0136b0 con 0x7f35dc09cf10 2024-09-21T21:20:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.647+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc123a40 con 0x7f35dc09cf10 2024-09-21T21:20:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.647+0000 7f35d97fa640 1 -- 172.21.15.5:0/1536034857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35cc013950 con 0x7f35dc09cf10 2024-09-21T21:20:29.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.647+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1241c0 con 0x7f35dc09cf10 2024-09-21T21:20:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.648+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc1255e0 con 0x7f35dc09cf10 2024-09-21T21:20:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.648+0000 7f35d97fa640 1 -- 172.21.15.5:0/1536034857 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f35cc013ab0 con 0x7f35dc09cf10 2024-09-21T21:20:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.648+0000 7f35d97fa640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f35bc03eb00 0x7f35bc041010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.648+0000 7f35d97fa640 1 -- 172.21.15.5:0/1536034857 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f35cc0510d0 con 0x7f35dc09cf10 2024-09-21T21:20:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.649+0000 7f35dbfff640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f35bc03eb00 0x7f35bc041010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:29.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.649+0000 7f35dbfff640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f35bc03eb00 0x7f35bc041010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:29.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.653+0000 7f35d97fa640 1 -- 172.21.15.5:0/1536034857 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f35cc0145d0 con 0x7f35dc09cf10 2024-09-21T21:20:29.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.888+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f35dc09c9d0 con 0x7f35dc09cf10 2024-09-21T21:20:29.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.890+0000 7f35d97fa640 1 -- 172.21.15.5:0/1536034857 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+98092 (crc 0 0 0) 0x7f35cc00f210 con 0x7f35dc09cf10 2024-09-21T21:20:29.893 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f35bc03eb00 msgr2=0x7f35bc041010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f35bc03eb00 0x7f35bc041010 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09cf10 msgr2=0x7f35dc121710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09cf10 0x7f35dc121710 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 shutdown_connections 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f35bc03eb00 0x7f35bc041010 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 --2- 172.21.15.5:0/1536034857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35dc09cf10 0x7f35dc121710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 >> 172.21.15.5:0/1536034857 conn(0x7f35dc0a42d0 msgr2=0x7f35dc0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 shutdown_connections 2024-09-21T21:20:29.895 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:29.893+0000 7f35e2cfd640 1 -- 172.21.15.5:0/1536034857 wait complete. 2024-09-21T21:20:29.905 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":377023394},{"type":"v1","addr":"172.21.15.148:6801","nonce":377023394}]},"active_addr":"172.21.15.148:6801/377023394","active_change":"2024-09-21T21:20:21.068624+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":3187060481}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1098365758}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":4219369639}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2804446134}]}]} 2024-09-21T21:20:29.909 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-21T21:20:29.909 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-21T21:20:29.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T21:20:30.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.017+0000 7f1ab4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.022+0000 7f1ab4191640 1 Processor -- start 2024-09-21T21:20:30.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.022+0000 7f1ab4191640 1 -- start start 2024-09-21T21:20:30.025 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.023+0000 7f1ab4191640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1aac09eb00 0x7f1aac135e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.023+0000 7f1ab4191640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aac09fb20 con 0x7f1aac1363b0 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.023+0000 7f1ab4191640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1aac09f810 con 0x7f1aac09eb00 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab1f2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1aac09eb00 0x7f1aac135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab1f2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1aac09eb00 0x7f1aac135e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34160/0 (socket says 172.21.15.5:34160) 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab1f2d640 1 -- 172.21.15.5:0/2236862303 learned_addr learned my addr 172.21.15.5:0/2236862303 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab172c640 1 --1- 172.21.15.5:0/2236862303 >> v1:172.21.15.5:6789/0 conn(0x7f1aac1363b0 0x7f1aac09c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:41902/0 (socket says 172.21.15.5:41902) 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab1f2d640 1 -- 172.21.15.5:0/2236862303 >> v1:172.21.15.5:6789/0 conn(0x7f1aac1363b0 legacy=0x7f1aac09c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab1f2d640 1 -- 172.21.15.5:0/2236862303 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac09fdb0 con 0x7f1aac09eb00 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab1f2d640 1 --2- 172.21.15.5:0/2236862303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac135e70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4b97b31c7c7c21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab0f2b640 1 -- 172.21.15.5:0/2236862303 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a9c00e040 con 0x7f1aac09eb00 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab0f2b640 1 -- 172.21.15.5:0/2236862303 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a9c0091e0 con 0x7f1aac09eb00 2024-09-21T21:20:30.026 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.024+0000 7f1ab0f2b640 1 -- 172.21.15.5:0/2236862303 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a9c007730 con 0x7f1aac09eb00 2024-09-21T21:20:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 1 -- 172.21.15.5:0/2236862303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 msgr2=0x7f1aac135e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 1 --2- 172.21.15.5:0/2236862303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac135e70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 1 -- 172.21.15.5:0/2236862303 shutdown_connections 2024-09-21T21:20:30.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 1 --2- 172.21.15.5:0/2236862303 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac135e70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 1 -- 172.21.15.5:0/2236862303 >> 172.21.15.5:0/2236862303 conn(0x7f1aac0a51b0 msgr2=0x7f1aac0a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 1 -- 172.21.15.5:0/2236862303 shutdown_connections 2024-09-21T21:20:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 1 -- 172.21.15.5:0/2236862303 wait complete. 2024-09-21T21:20:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.025+0000 7f1ab4191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.027+0000 7f1ab4191640 1 Processor -- start 2024-09-21T21:20:30.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.027+0000 7f1ab4191640 1 -- start start 2024-09-21T21:20:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab4191640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac1229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab4191640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac1243c0 con 0x7f1aac09eb00 2024-09-21T21:20:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab1f2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac1229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab1f2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac1229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34164/0 (socket says 172.21.15.5:34164) 2024-09-21T21:20:30.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab1f2d640 1 -- 172.21.15.5:0/3405403401 learned_addr learned my addr 172.21.15.5:0/3405403401 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab1f2d640 1 -- 172.21.15.5:0/3405403401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac135c00 con 0x7f1aac09eb00 2024-09-21T21:20:30.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab1f2d640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac1229d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1aaa7fc640 1 -- 172.21.15.5:0/3405403401 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a9c00e040 con 0x7f1aac09eb00 2024-09-21T21:20:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1aaa7fc640 1 -- 172.21.15.5:0/3405403401 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1a9c013790 con 0x7f1aac09eb00 2024-09-21T21:20:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac123b60 con 0x7f1aac09eb00 2024-09-21T21:20:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1aaa7fc640 1 -- 172.21.15.5:0/3405403401 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1a9c013a30 con 0x7f1aac09eb00 2024-09-21T21:20:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.029+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac1251e0 con 0x7f1aac09eb00 2024-09-21T21:20:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.030+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac06a8d0 con 0x7f1aac09eb00 2024-09-21T21:20:30.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.030+0000 7f1aaa7fc640 1 -- 172.21.15.5:0/3405403401 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f1a9c013be0 con 0x7f1aac09eb00 2024-09-21T21:20:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.031+0000 7f1aaa7fc640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1a9803ead0 0x7f1a98040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.031+0000 7f1aaa7fc640 1 -- 172.21.15.5:0/3405403401 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f1a9c050f90 con 0x7f1aac09eb00 2024-09-21T21:20:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.031+0000 7f1ab172c640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1a9803ead0 0x7f1a98040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.032+0000 7f1ab172c640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1a9803ead0 0x7f1a98040fe0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.036+0000 7f1aaa7fc640 1 -- 172.21.15.5:0/3405403401 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f1a9c014770 con 0x7f1aac09eb00 2024-09-21T21:20:30.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.225+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1aac135df0 con 0x7f1aac09eb00 2024-09-21T21:20:30.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.226+0000 7f1aaa7fc640 1 -- 172.21.15.5:0/3405403401 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8861 (crc 0 0 0) 0x7f1a9c00e1a0 con 0x7f1aac09eb00 2024-09-21T21:20:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"fsid":"ad0a953a-14f9-495f-aee8-909b91df1365","created":"2024-09-21T21:20:15.771330+0000","modified":"2024-09-21T21:20:29.152051+0000","last_up_change":"2024-09-21T21:20:24.128887+0000","last_in_change":"2024-09-21T21:20:17.888469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T21:20:25.091063+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T21:20:26.074228+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d775b7f-81e2-4b8c-9603-a1de80d82d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":1340303177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1340303177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1340303177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1340303177}]},"public_addr":"172.21.15.5:6801/1340303177","cluster_addr":"172.21.15.5:6800/1340303177","heartbeat_back_addr":"172.21.15.5:6807/1340303177","heartbeat_front_addr":"172.21.15.5:6806/1340303177","state":["exists","up"]},{"osd":1,"uuid":"bedebb15-7f73-41ce-8112-42af3e421377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1102615197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":1102615197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1102615197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1102615197}]},"public_addr":"172.21.15.5:6804/1102615197","cluster_addr":"172.21.15.5:6803/1102615197","heartbeat_back_addr":"172.21.15.5:6805/1102615197","heartbeat_front_addr":"172.21.15.5:6802/1102615197","state":["exists","up"]},{"osd":2,"uuid":"8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6803","nonce":877610312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":877610312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":877610312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":877610312}]},"public_addr":"172.21.15.148:6803/877610312","cluster_addr":"172.21.15.148:6804/877610312","heartbeat_back_addr":"172.21.15.148:6815/877610312","heartbeat_front_addr":"172.21.15.148:6816/877610312","state":["exists","up"]},{"osd":3,"uuid":"14b1cc33-c87a-4e37-b778-3005207ab080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6805","nonce":1161645252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1161645252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1161645252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6809","nonce":1161645252}]},"public_addr":"172.21.15.148:6805/1161645252","cluster_addr":"172.21.15.148:6802/1161645252","heartbeat_back_addr":"172.21.15.148:6808/1161645252","heartbeat_front_addr":"172.21.15.148:6809/1161645252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T21:20:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1a9803ead0 msgr2=0x7f1a98040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1a9803ead0 0x7f1a98040fe0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 msgr2=0x7f1aac1229d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac1229d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 shutdown_connections 2024-09-21T21:20:30.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1a9803ead0 0x7f1a98040fe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 --2- 172.21.15.5:0/3405403401 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1aac09eb00 0x7f1aac1229d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.228+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 >> 172.21.15.5:0/3405403401 conn(0x7f1aac0a51b0 msgr2=0x7f1aac0a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.229+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 shutdown_connections 2024-09-21T21:20:30.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.229+0000 7f1ab4191640 1 -- 172.21.15.5:0/3405403401 wait complete. 2024-09-21T21:20:30.241 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-21T21:20:30.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T21:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.349+0000 7f2a41391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.354+0000 7f2a41391640 1 Processor -- start 2024-09-21T21:20:30.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.354+0000 7f2a41391640 1 -- start start 2024-09-21T21:20:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a41391640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a3c09fae0 0x7f2a3c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a41391640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a3c09f390 con 0x7f2a3c06eff0 2024-09-21T21:20:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a41391640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f2a3c0a03a0 con 0x7f2a3c09fae0 2024-09-21T21:20:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a3affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a3c09fae0 0x7f2a3c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a3affd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f2a3c09fae0 0x7f2a3c06eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38706/0 (socket says 172.21.15.5:38706) 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a3a7fc640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f2a3c06eff0 0x7f2a3c135e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42416/0 (socket says 172.21.15.5:42416) 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a3affd640 1 -- 172.21.15.5:0/499705547 learned_addr learned my addr 172.21.15.5:0/499705547 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a3affd640 1 -- 172.21.15.5:0/499705547 >> v1:172.21.15.5:6789/0 conn(0x7f2a3c06eff0 legacy=0x7f2a3c135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a3affd640 1 -- 172.21.15.5:0/499705547 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c0a0090 con 0x7f2a3c09fae0 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.356+0000 7f2a39ffb640 1 -- 172.21.15.5:0/499705547 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543561261 0 0) 0x7f2a3c09f390 con 0x7f2a3c06eff0 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a3affd640 1 --2- 172.21.15.5:0/499705547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c09fae0 0x7f2a3c06eab0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578cde73e48f09ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a39ffb640 1 -- 172.21.15.5:0/499705547 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2a2c00e040 con 0x7f2a3c09fae0 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a39ffb640 1 -- 172.21.15.5:0/499705547 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2a2c0091e0 con 0x7f2a3c09fae0 2024-09-21T21:20:30.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a39ffb640 1 -- 172.21.15.5:0/499705547 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2a2c007730 con 0x7f2a3c09fae0 2024-09-21T21:20:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a41391640 1 -- 172.21.15.5:0/499705547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c09fae0 msgr2=0x7f2a3c06eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a41391640 1 --2- 172.21.15.5:0/499705547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c09fae0 0x7f2a3c06eab0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a41391640 1 -- 172.21.15.5:0/499705547 shutdown_connections 2024-09-21T21:20:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.357+0000 7f2a41391640 1 --2- 172.21.15.5:0/499705547 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c09fae0 0x7f2a3c06eab0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.358+0000 7f2a41391640 1 -- 172.21.15.5:0/499705547 >> 172.21.15.5:0/499705547 conn(0x7f2a3c0a76f0 msgr2=0x7f2a3c0a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.358+0000 7f2a41391640 1 -- 172.21.15.5:0/499705547 shutdown_connections 2024-09-21T21:20:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.358+0000 7f2a41391640 1 -- 172.21.15.5:0/499705547 wait complete. 2024-09-21T21:20:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.358+0000 7f2a41391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.360+0000 7f2a41391640 1 Processor -- start 2024-09-21T21:20:30.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.360+0000 7f2a41391640 1 -- start start 2024-09-21T21:20:30.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.361+0000 7f2a41391640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c06eff0 0x7f2a3c124150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.361+0000 7f2a41391640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c136c80 con 0x7f2a3c06eff0 2024-09-21T21:20:30.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.361+0000 7f2a3affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c06eff0 0x7f2a3c124150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.361+0000 7f2a3affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c06eff0 0x7f2a3c124150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38720/0 (socket says 172.21.15.5:38720) 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.361+0000 7f2a3affd640 1 -- 172.21.15.5:0/2861242096 learned_addr learned my addr 172.21.15.5:0/2861242096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.362+0000 7f2a3affd640 1 -- 172.21.15.5:0/2861242096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c123d90 con 0x7f2a3c06eff0 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.362+0000 7f2a3affd640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c06eff0 0x7f2a3c124150 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.362+0000 7f2a237fe640 1 -- 172.21.15.5:0/2861242096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2a2c00e040 con 0x7f2a3c06eff0 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.362+0000 7f2a237fe640 1 -- 172.21.15.5:0/2861242096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2a2c0094d0 con 0x7f2a3c06eff0 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.362+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c1239f0 con 0x7f2a3c06eff0 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.362+0000 7f2a237fe640 1 -- 172.21.15.5:0/2861242096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2a2c011950 con 0x7f2a3c06eff0 2024-09-21T21:20:30.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.362+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c127430 con 0x7f2a3c06eff0 2024-09-21T21:20:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.363+0000 7f2a237fe640 1 -- 172.21.15.5:0/2861242096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f2a2c011b00 con 0x7f2a3c06eff0 2024-09-21T21:20:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.363+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3c06eab0 con 0x7f2a3c06eff0 2024-09-21T21:20:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.363+0000 7f2a237fe640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f2a2803ead0 0x7f2a28040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.363+0000 7f2a237fe640 1 -- 172.21.15.5:0/2861242096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f2a2c051030 con 0x7f2a3c06eff0 2024-09-21T21:20:30.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.364+0000 7f2a3a7fc640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f2a2803ead0 0x7f2a28040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.364+0000 7f2a3a7fc640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f2a2803ead0 0x7f2a28040fe0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.369+0000 7f2a237fe640 1 -- 172.21.15.5:0/2861242096 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f2a2c0143e0 con 0x7f2a3c06eff0 2024-09-21T21:20:30.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.556+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a3c06a8d0 con 0x7f2a3c06eff0 2024-09-21T21:20:30.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.557+0000 7f2a237fe640 1 -- 172.21.15.5:0/2861242096 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8861 (crc 0 0 0) 0x7f2a2c00e1a0 con 0x7f2a3c06eff0 2024-09-21T21:20:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:30.558 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":15,"fsid":"ad0a953a-14f9-495f-aee8-909b91df1365","created":"2024-09-21T21:20:15.771330+0000","modified":"2024-09-21T21:20:29.152051+0000","last_up_change":"2024-09-21T21:20:24.128887+0000","last_in_change":"2024-09-21T21:20:17.888469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T21:20:25.091063+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T21:20:26.074228+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d775b7f-81e2-4b8c-9603-a1de80d82d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":1340303177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1340303177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1340303177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1340303177}]},"public_addr":"172.21.15.5:6801/1340303177","cluster_addr":"172.21.15.5:6800/1340303177","heartbeat_back_addr":"172.21.15.5:6807/1340303177","heartbeat_front_addr":"172.21.15.5:6806/1340303177","state":["exists","up"]},{"osd":1,"uuid":"bedebb15-7f73-41ce-8112-42af3e421377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1102615197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":1102615197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1102615197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1102615197}]},"public_addr":"172.21.15.5:6804/1102615197","cluster_addr":"172.21.15.5:6803/1102615197","heartbeat_back_addr":"172.21.15.5:6805/1102615197","heartbeat_front_addr":"172.21.15.5:6802/1102615197","state":["exists","up"]},{"osd":2,"uuid":"8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6803","nonce":877610312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":877610312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":877610312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":877610312}]},"public_addr":"172.21.15.148:6803/877610312","cluster_addr":"172.21.15.148:6804/877610312","heartbeat_back_addr":"172.21.15.148:6815/877610312","heartbeat_front_addr":"172.21.15.148:6816/877610312","state":["exists","up"]},{"osd":3,"uuid":"14b1cc33-c87a-4e37-b778-3005207ab080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6805","nonce":1161645252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1161645252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1161645252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6809","nonce":1161645252}]},"public_addr":"172.21.15.148:6805/1161645252","cluster_addr":"172.21.15.148:6802/1161645252","heartbeat_back_addr":"172.21.15.148:6808/1161645252","heartbeat_front_addr":"172.21.15.148:6809/1161645252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f2a2803ead0 msgr2=0x7f2a28040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f2a2803ead0 0x7f2a28040fe0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c06eff0 msgr2=0x7f2a3c124150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c06eff0 0x7f2a3c124150 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 shutdown_connections 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f2a2803ead0 0x7f2a28040fe0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 --2- 172.21.15.5:0/2861242096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2a3c06eff0 0x7f2a3c124150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 >> 172.21.15.5:0/2861242096 conn(0x7f2a3c0a76f0 msgr2=0x7f2a3c0a2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.561 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 shutdown_connections 2024-09-21T21:20:30.562 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.559+0000 7f2a41391640 1 -- 172.21.15.5:0/2861242096 wait complete. 2024-09-21T21:20:30.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-21T21:20:30.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-21T21:20:30.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-21T21:20:30.573 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-21T21:20:30.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.691+0000 7f53770fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.691+0000 7f3af4751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.691+0000 7f6cb3abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.691+0000 7fed4cb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.697+0000 7f3af4751640 1 Processor -- start 2024-09-21T21:20:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.697+0000 7f3af4751640 1 -- start start 2024-09-21T21:20:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.697+0000 7f53770fd640 1 Processor -- start 2024-09-21T21:20:30.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.697+0000 7f53770fd640 1 -- start start 2024-09-21T21:20:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.698+0000 7f6cb3abd640 1 Processor -- start 2024-09-21T21:20:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.698+0000 7fed4cb11640 1 Processor -- start 2024-09-21T21:20:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.698+0000 7fed4cb11640 1 -- start start 2024-09-21T21:20:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.698+0000 7f6cb3abd640 1 -- start start 2024-09-21T21:20:30.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f53770fd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5370136580 0x7f537013b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f3af4751640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3aec09eb00 0x7f3aec135e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f53770fd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f537009fb20 con 0x7f537009eb00 2024-09-21T21:20:30.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f3af4751640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aec09fb20 con 0x7f3aec1363b0 2024-09-21T21:20:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f3af4751640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3aec09f810 con 0x7f3aec09eb00 2024-09-21T21:20:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f5374e99640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f537009eb00 0x7f5370135e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42420/0 (socket says 172.21.15.5:42420) 2024-09-21T21:20:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f5374e99640 1 -- 172.21.15.5:0/1343403287 learned_addr learned my addr 172.21.15.5:0/1343403287 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:30.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f53770fd640 1 -- 172.21.15.5:0/1343403287 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f537009f810 con 0x7f5370136580 2024-09-21T21:20:30.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f3af1cec640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3aec1363b0 0x7f3aec09c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42426/0 (socket says 172.21.15.5:42426) 2024-09-21T21:20:30.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f3af1cec640 1 -- 172.21.15.5:0/1344877785 learned_addr learned my addr 172.21.15.5:0/1344877785 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:30.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f3af24ed640 1 --2- 172.21.15.5:0/1344877785 >> v2:172.21.15.5:3300/0 conn(0x7f3aec09eb00 0x7f3aec135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.699+0000 7f536ffff640 1 --2- 172.21.15.5:0/1343403287 >> v2:172.21.15.5:3300/0 conn(0x7f5370136580 0x7f537013b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f3af14eb640 1 -- 172.21.15.5:0/1344877785 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650703732 0 0) 0x7f3aec09fb20 con 0x7f3aec1363b0 2024-09-21T21:20:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f536f7fe640 1 -- 172.21.15.5:0/1343403287 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223666168 0 0) 0x7f537009fb20 con 0x7f537009eb00 2024-09-21T21:20:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f3af14eb640 1 -- 172.21.15.5:0/1344877785 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad8003580 con 0x7f3aec1363b0 2024-09-21T21:20:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f536f7fe640 1 -- 172.21.15.5:0/1343403287 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5360003580 con 0x7f537009eb00 2024-09-21T21:20:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f536ffff640 1 -- 172.21.15.5:0/1343403287 >> v1:172.21.15.5:6789/0 conn(0x7f537009eb00 legacy=0x7f5370135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f536ffff640 1 -- 172.21.15.5:0/1343403287 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537009fdb0 con 0x7f5370136580 2024-09-21T21:20:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7fed4cb11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fed48136f70 0x7fed48139390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7fed4cb11640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed481318c0 con 0x7fed48130da0 2024-09-21T21:20:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7fed4cb11640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fed4809f120 con 0x7fed48136f70 2024-09-21T21:20:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7fed4659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fed48130da0 0x7fed481311b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42440/0 (socket says 172.21.15.5:42440) 2024-09-21T21:20:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7fed4659c640 1 -- 172.21.15.5:0/2696800959 learned_addr learned my addr 172.21.15.5:0/2696800959 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f6cb3abd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cac09eb00 0x7f6cac135e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f6cb3abd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cac09fb20 con 0x7f6cac1363b0 2024-09-21T21:20:30.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f3af24ed640 1 -- 172.21.15.5:0/1344877785 >> v1:172.21.15.5:6789/0 conn(0x7f3aec1363b0 legacy=0x7f3aec09c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f3af24ed640 1 -- 172.21.15.5:0/1344877785 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec09fdb0 con 0x7f3aec09eb00 2024-09-21T21:20:30.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f6cb3abd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f6cac09f810 con 0x7f6cac09eb00 2024-09-21T21:20:30.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7fed45d9b640 1 --2- 172.21.15.5:0/2696800959 >> v2:172.21.15.5:3300/0 conn(0x7fed48136f70 0x7fed48139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f6cb1859640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cac09eb00 0x7f6cac135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f536ffff640 1 --2- 172.21.15.5:0/1343403287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5370136580 0x7f537013b0b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e53eb70d5be9b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f6cb1859640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f6cac09eb00 0x7f6cac135e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38764/0 (socket says 172.21.15.5:38764) 2024-09-21T21:20:30.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f6cb1859640 1 -- 172.21.15.5:0/1806229056 learned_addr learned my addr 172.21.15.5:0/1806229056 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7f3af24ed640 1 --2- 172.21.15.5:0/1344877785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec135e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f4e5dde06d7082 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.700+0000 7fed4559a640 1 -- 172.21.15.5:0/2696800959 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507827248 0 0) 0x7fed38001110 con 0x7fed48130da0 2024-09-21T21:20:30.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7fed4559a640 1 -- 172.21.15.5:0/2696800959 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed30003580 con 0x7fed48130da0 2024-09-21T21:20:30.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f536f7fe640 1 -- 172.21.15.5:0/1343403287 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f535c009d90 con 0x7f5370136580 2024-09-21T21:20:30.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f536f7fe640 1 -- 172.21.15.5:0/1343403287 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f535c00e230 con 0x7f5370136580 2024-09-21T21:20:30.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f536f7fe640 1 -- 172.21.15.5:0/1343403287 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f535c00e4d0 con 0x7f5370136580 2024-09-21T21:20:30.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7fed45d9b640 1 -- 172.21.15.5:0/2696800959 >> v1:172.21.15.5:6789/0 conn(0x7fed48130da0 legacy=0x7fed481311b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7fed45d9b640 1 -- 172.21.15.5:0/2696800959 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed480a23f0 con 0x7fed48136f70 2024-09-21T21:20:30.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f6cb1859640 1 -- 172.21.15.5:0/1806229056 >> v1:172.21.15.5:6789/0 conn(0x7f6cac1363b0 legacy=0x7f6cac09c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f3af14eb640 1 -- 172.21.15.5:0/1344877785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ae8009d90 con 0x7f3aec09eb00 2024-09-21T21:20:30.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f6cb1859640 1 -- 172.21.15.5:0/1806229056 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac09fdb0 con 0x7f6cac09eb00 2024-09-21T21:20:30.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f3af14eb640 1 -- 172.21.15.5:0/1344877785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3ae800e230 con 0x7f3aec09eb00 2024-09-21T21:20:30.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f3af14eb640 1 -- 172.21.15.5:0/1344877785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ae800e4d0 con 0x7f3aec09eb00 2024-09-21T21:20:30.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7fed45d9b640 1 --2- 172.21.15.5:0/2696800959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48136f70 0x7fed48139390 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49126b4a8c3b7496 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7fed4559a640 1 -- 172.21.15.5:0/2696800959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed3c009d90 con 0x7fed48136f70 2024-09-21T21:20:30.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f6cb1859640 1 --2- 172.21.15.5:0/1806229056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac135e70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78a3f20cc46ebff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f6cb0857640 1 -- 172.21.15.5:0/1806229056 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ca8009e50 con 0x7f6cac09eb00 2024-09-21T21:20:30.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7fed4559a640 1 -- 172.21.15.5:0/2696800959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed3c00e230 con 0x7fed48136f70 2024-09-21T21:20:30.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7fed4559a640 1 -- 172.21.15.5:0/2696800959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed3c00e4d0 con 0x7fed48136f70 2024-09-21T21:20:30.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 1 -- 172.21.15.5:0/1343403287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5370136580 msgr2=0x7f537013b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 1 --2- 172.21.15.5:0/1343403287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5370136580 0x7f537013b0b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f6cb0857640 1 -- 172.21.15.5:0/1806229056 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ca800e230 con 0x7f6cac09eb00 2024-09-21T21:20:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.701+0000 7f6cb0857640 1 -- 172.21.15.5:0/1806229056 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ca800e4d0 con 0x7f6cac09eb00 2024-09-21T21:20:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 1 -- 172.21.15.5:0/1343403287 shutdown_connections 2024-09-21T21:20:30.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 1 --2- 172.21.15.5:0/1343403287 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5370136580 0x7f537013b0b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 1 -- 172.21.15.5:0/1343403287 >> 172.21.15.5:0/1343403287 conn(0x7f53700a51b0 msgr2=0x7f53700a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 1 -- 172.21.15.5:0/1343403287 shutdown_connections 2024-09-21T21:20:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 1 -- 172.21.15.5:0/1343403287 wait complete. 2024-09-21T21:20:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1806229056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 msgr2=0x7f6cac135e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1806229056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac135e70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f3af4751640 1 -- 172.21.15.5:0/1344877785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 msgr2=0x7f3aec135e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f3af4751640 1 --2- 172.21.15.5:0/1344877785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec135e70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1806229056 shutdown_connections 2024-09-21T21:20:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1806229056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac135e70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1806229056 >> 172.21.15.5:0/1806229056 conn(0x7f6cac0a51b0 msgr2=0x7f6cac0a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f3af4751640 1 -- 172.21.15.5:0/1344877785 shutdown_connections 2024-09-21T21:20:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f3af4751640 1 --2- 172.21.15.5:0/1344877785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec135e70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f3af4751640 1 -- 172.21.15.5:0/1344877785 >> 172.21.15.5:0/1344877785 conn(0x7f3aec0a51b0 msgr2=0x7f3aec0a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f53770fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1806229056 shutdown_connections 2024-09-21T21:20:30.715 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1806229056 wait complete. 2024-09-21T21:20:30.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f3af4751640 1 -- 172.21.15.5:0/1344877785 shutdown_connections 2024-09-21T21:20:30.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7fed4cb11640 1 -- 172.21.15.5:0/2696800959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48136f70 msgr2=0x7fed48139390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2696800959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48136f70 0x7fed48139390 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.702+0000 7f3af4751640 1 -- 172.21.15.5:0/1344877785 wait complete. 2024-09-21T21:20:30.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7fed4cb11640 1 -- 172.21.15.5:0/2696800959 shutdown_connections 2024-09-21T21:20:30.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2696800959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48136f70 0x7fed48139390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7fed4cb11640 1 -- 172.21.15.5:0/2696800959 >> 172.21.15.5:0/2696800959 conn(0x7fed480a2f60 msgr2=0x7fed480a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7fed4cb11640 1 -- 172.21.15.5:0/2696800959 shutdown_connections 2024-09-21T21:20:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7fed4cb11640 1 -- 172.21.15.5:0/2696800959 wait complete. 2024-09-21T21:20:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7f3af4751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7fed4cb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.703+0000 7f6cb3abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.705+0000 7f3af4751640 1 Processor -- start 2024-09-21T21:20:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.706+0000 7f3af4751640 1 -- start start 2024-09-21T21:20:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.706+0000 7f53770fd640 1 Processor -- start 2024-09-21T21:20:30.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.706+0000 7f6cb3abd640 1 Processor -- start 2024-09-21T21:20:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.706+0000 7f53770fd640 1 -- start start 2024-09-21T21:20:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.706+0000 7f6cb3abd640 1 -- start start 2024-09-21T21:20:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.706+0000 7fed4cb11640 1 Processor -- start 2024-09-21T21:20:30.720 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.706+0000 7fed4cb11640 1 -- start start 2024-09-21T21:20:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.708+0000 7f3af4751640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec123140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.708+0000 7f3af4751640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3aec126720 con 0x7f3aec09eb00 2024-09-21T21:20:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.708+0000 7f3af24ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec123140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.708+0000 7f3af24ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec123140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38772/0 (socket says 172.21.15.5:38772) 2024-09-21T21:20:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.708+0000 7f3af24ed640 1 -- 172.21.15.5:0/1008014038 learned_addr learned my addr 172.21.15.5:0/1008014038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.708+0000 7f6cb3abd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac1229d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.708+0000 7fed4cb11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48130da0 0x7fed4811d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f53770fd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537009eb00 0x7f5370120c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7fed4cb11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed4811ded0 con 0x7fed48130da0 2024-09-21T21:20:30.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7fed4659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48130da0 0x7fed4811d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f3af24ed640 1 -- 172.21.15.5:0/1008014038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aec122db0 con 0x7f3aec09eb00 2024-09-21T21:20:30.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7fed4659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48130da0 0x7fed4811d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38786/0 (socket says 172.21.15.5:38786) 2024-09-21T21:20:30.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7fed4659c640 1 -- 172.21.15.5:0/2072356875 learned_addr learned my addr 172.21.15.5:0/2072356875 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f6cb1859640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac1229d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f6cb1859640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac1229d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38780/0 (socket says 172.21.15.5:38780) 2024-09-21T21:20:30.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f3af24ed640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec123140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f6cb1859640 1 -- 172.21.15.5:0/1085020777 learned_addr learned my addr 172.21.15.5:0/1085020777 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f5374e99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537009eb00 0x7f5370120c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f5374e99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537009eb00 0x7f5370120c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38792/0 (socket says 172.21.15.5:38792) 2024-09-21T21:20:30.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f5374e99640 1 -- 172.21.15.5:0/2576643543 learned_addr learned my addr 172.21.15.5:0/2576643543 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f53770fd640 1 -- 172.21.15.5:0/2576643543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5370124990 con 0x7f537009eb00 2024-09-21T21:20:30.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac1243c0 con 0x7f6cac09eb00 2024-09-21T21:20:30.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7fed4659c640 1 -- 172.21.15.5:0/2072356875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4811f9b0 con 0x7fed48130da0 2024-09-21T21:20:30.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ae8013400 con 0x7f3aec09eb00 2024-09-21T21:20:30.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3ae8013560 con 0x7f3aec09eb00 2024-09-21T21:20:30.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f3af4751640 1 -- 172.21.15.5:0/1008014038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aec1241a0 con 0x7f3aec09eb00 2024-09-21T21:20:30.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f3af4751640 1 -- 172.21.15.5:0/1008014038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aec122aa0 con 0x7f3aec09eb00 2024-09-21T21:20:30.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f5374e99640 1 -- 172.21.15.5:0/2576643543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5370124c80 con 0x7f537009eb00 2024-09-21T21:20:30.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3ae8013800 con 0x7f3aec09eb00 2024-09-21T21:20:30.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.709+0000 7fed4659c640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48130da0 0x7fed4811d280 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7f6cb1859640 1 -- 172.21.15.5:0/1085020777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac135c00 con 0x7f6cac09eb00 2024-09-21T21:20:30.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7f6cb1859640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac1229d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7f5374e99640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537009eb00 0x7f5370120c70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed38005930 con 0x7fed48130da0 2024-09-21T21:20:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed38005a90 con 0x7fed48130da0 2024-09-21T21:20:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed38005d30 con 0x7fed48130da0 2024-09-21T21:20:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed4811e780 con 0x7fed48130da0 2024-09-21T21:20:30.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed4811c9b0 con 0x7fed48130da0 2024-09-21T21:20:30.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f3af4751640 1 -- 172.21.15.5:0/1008014038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ad4000f80 con 0x7f3aec09eb00 2024-09-21T21:20:30.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f3ae80139b0 con 0x7f3aec09eb00 2024-09-21T21:20:30.729 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ca800ee20 con 0x7f6cac09eb00 2024-09-21T21:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5364004b80 con 0x7f537009eb00 2024-09-21T21:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5364004ce0 con 0x7f537009eb00 2024-09-21T21:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5364007120 con 0x7f537009eb00 2024-09-21T21:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f53770fd640 1 -- 172.21.15.5:0/2576643543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5370134d30 con 0x7f537009eb00 2024-09-21T21:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f53770fd640 1 -- 172.21.15.5:0/2576643543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5370134990 con 0x7f537009eb00 2024-09-21T21:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed4809ff60 con 0x7fed48130da0 2024-09-21T21:20:30.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.710+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ca8015420 con 0x7f6cac09eb00 2024-09-21T21:20:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac123b60 con 0x7f6cac09eb00 2024-09-21T21:20:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1251e0 con 0x7f6cac09eb00 2024-09-21T21:20:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ca80156c0 con 0x7f6cac09eb00 2024-09-21T21:20:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f3ae2ffd640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3ad003ead0 0x7f3ad0040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f3ae8018040 con 0x7f3aec09eb00 2024-09-21T21:20:30.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.711+0000 7f3ae2ffd640 1 --2- 172.21.15.5:0/1008014038 >> v2:172.21.15.148:6805/1161645252 conn(0x7f3ad0043ad0 0x7f3ad0045fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 --> v2:172.21.15.148:6805/1161645252 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ad0046630 con 0x7f3ad0043ad0 2024-09-21T21:20:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f3ae8013cb0 con 0x7f3aec09eb00 2024-09-21T21:20:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7f3af1cec640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3ad003ead0 0x7f3ad0040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fed3800c800 con 0x7fed48130da0 2024-09-21T21:20:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cac06fcf0 con 0x7f6cac09eb00 2024-09-21T21:20:30.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7f53770fd640 1 -- 172.21.15.5:0/2576643543 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f537006fcf0 con 0x7f537009eb00 2024-09-21T21:20:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.712+0000 7fed36ffd640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fed2803eb70 0x7fed28041080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fed3804f710 con 0x7fed48130da0 2024-09-21T21:20:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f6ca80158c0 con 0x7f6cac09eb00 2024-09-21T21:20:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f3af2cee640 1 --2- 172.21.15.5:0/1008014038 >> v2:172.21.15.148:6805/1161645252 conn(0x7f3ad0043ad0 0x7f3ad0045fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:20:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7fed36ffd640 1 --2- 172.21.15.5:0/2072356875 >> v2:172.21.15.5:6804/1102615197 conn(0x7fed28043bf0 0x7fed280460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 --> v2:172.21.15.5:6804/1102615197 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed28046750 con 0x7fed28043bf0 2024-09-21T21:20:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7fed45d9b640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fed2803eb70 0x7fed28041080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7fed38051b30 con 0x7fed48130da0 2024-09-21T21:20:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f6ca27fc640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f6c9003ead0 0x7f6c90040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f6ca8050fb0 con 0x7f6cac09eb00 2024-09-21T21:20:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f6ca27fc640 1 --2- 172.21.15.5:0/1085020777 >> v2:172.21.15.148:6803/877610312 conn(0x7f6c90043ad0 0x7f6c90045fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 --> v2:172.21.15.148:6803/877610312 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c90046630 con 0x7f6c90043ad0 2024-09-21T21:20:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f6ca8053450 con 0x7f6cac09eb00 2024-09-21T21:20:30.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f6cb1058640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f6c9003ead0 0x7f6c90040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f3af1cec640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3ad003ead0 0x7f3ad0040fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f5364007280 con 0x7f537009eb00 2024-09-21T21:20:30.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.713+0000 7fed45d9b640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fed2803eb70 0x7fed28041080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f536d7fa640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f535403eb50 0x7f5354041060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f536404fbb0 con 0x7f537009eb00 2024-09-21T21:20:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f536d7fa640 1 --2- 172.21.15.5:0/2576643543 >> v2:172.21.15.5:6801/1340303177 conn(0x7f5354043b50 0x7f5354046020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 --> v2:172.21.15.5:6801/1340303177 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53540466b0 con 0x7f5354043b50 2024-09-21T21:20:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (crc 0 0 0) 0x7f536404ff10 con 0x7f537009eb00 2024-09-21T21:20:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f536ffff640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f535403eb50 0x7f5354041060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f6cb1058640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f6c9003ead0 0x7f6c90040fe0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7fed46d9d640 1 --2- 172.21.15.5:0/2072356875 >> v2:172.21.15.5:6804/1102615197 conn(0x7fed28043bf0 0x7fed280460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:20:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.714+0000 7f6cb205a640 1 --2- 172.21.15.5:0/1085020777 >> v2:172.21.15.148:6803/877610312 conn(0x7f6c90043ad0 0x7f6c90045fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:20:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.715+0000 7f536ffff640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f535403eb50 0x7f5354041060 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.715+0000 7f537569a640 1 --2- 172.21.15.5:0/2576643543 >> v2:172.21.15.5:6801/1340303177 conn(0x7f5354043b50 0x7f5354046020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:20:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.717+0000 7f3af2cee640 1 --2- 172.21.15.5:0/1008014038 >> v2:172.21.15.148:6805/1161645252 conn(0x7f3ad0043ad0 0x7f3ad0045fa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.718+0000 7fed46d9d640 1 --2- 172.21.15.5:0/2072356875 >> v2:172.21.15.5:6804/1102615197 conn(0x7fed28043bf0 0x7fed280460c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.718+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f3ad0046630 con 0x7f3ad0043ad0 2024-09-21T21:20:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.719+0000 7f537569a640 1 --2- 172.21.15.5:0/2576643543 >> v2:172.21.15.5:6801/1340303177 conn(0x7f5354043b50 0x7f5354046020 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.719+0000 7f6cb205a640 1 --2- 172.21.15.5:0/1085020777 >> v2:172.21.15.148:6803/877610312 conn(0x7f6c90043ad0 0x7f6c90045fa0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.720+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f53540466b0 con 0x7f5354043b50 2024-09-21T21:20:30.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.721+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fed28046750 con 0x7fed28043bf0 2024-09-21T21:20:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.721+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== osd.2 v2:172.21.15.148:6803/877610312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f6c90046630 con 0x7f6c90043ad0 2024-09-21T21:20:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.723+0000 7f3af4751640 1 -- 172.21.15.5:0/1008014038 --> v2:172.21.15.148:6805/1161645252 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3ad4002c30 con 0x7f3ad0043ad0 2024-09-21T21:20:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.724+0000 7f53770fd640 1 -- 172.21.15.5:0/2576643543 --> v2:172.21.15.5:6801/1340303177 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5370135e70 con 0x7f5354043b50 2024-09-21T21:20:30.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.724+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 --> v2:172.21.15.5:6804/1102615197 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed48120170 con 0x7fed28043bf0 2024-09-21T21:20:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.724+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 --> v2:172.21.15.148:6803/877610312 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cac123cf0 con 0x7f6c90043ad0 2024-09-21T21:20:30.742 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae2ffd640 1 -- 172.21.15.5:0/1008014038 <== osd.3 v2:172.21.15.148:6805/1161645252 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3ad4002c30 con 0x7f3ad0043ad0 2024-09-21T21:20:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 -- 172.21.15.5:0/1008014038 >> v2:172.21.15.148:6805/1161645252 conn(0x7f3ad0043ad0 msgr2=0x7f3ad0045fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 --2- 172.21.15.5:0/1008014038 >> v2:172.21.15.148:6805/1161645252 conn(0x7f3ad0043ad0 0x7f3ad0045fa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 -- 172.21.15.5:0/1008014038 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3ad003ead0 msgr2=0x7f3ad0040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3ad003ead0 0x7f3ad0040fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 -- 172.21.15.5:0/1008014038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 msgr2=0x7f3aec123140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec123140 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.743 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 -- 172.21.15.5:0/1008014038 shutdown_connections 2024-09-21T21:20:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 --2- 172.21.15.5:0/1008014038 >> v2:172.21.15.148:6805/1161645252 conn(0x7f3ad0043ad0 0x7f3ad0045fa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3ad003ead0 0x7f3ad0040fe0 crc :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.726+0000 7f536d7fa640 1 -- 172.21.15.5:0/2576643543 <== osd.0 v2:172.21.15.5:6801/1340303177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5370135e70 con 0x7f5354043b50 2024-09-21T21:20:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 --2- 172.21.15.5:0/1008014038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3aec09eb00 0x7f3aec123140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.725+0000 7f3ae0ff9640 1 -- 172.21.15.5:0/1008014038 >> 172.21.15.5:0/1008014038 conn(0x7f3aec0a51b0 msgr2=0x7f3aec0a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.744 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.726+0000 7f3ae0ff9640 1 -- 172.21.15.5:0/1008014038 shutdown_connections 2024-09-21T21:20:30.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.726+0000 7fed36ffd640 1 -- 172.21.15.5:0/2072356875 <== osd.1 v2:172.21.15.5:6804/1102615197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fed48120170 con 0x7fed28043bf0 2024-09-21T21:20:30.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.726+0000 7f3ae0ff9640 1 -- 172.21.15.5:0/1008014038 wait complete. 2024-09-21T21:20:30.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.726+0000 7f6ca27fc640 1 -- 172.21.15.5:0/1085020777 <== osd.2 v2:172.21.15.148:6803/877610312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ca400a820 con 0x7f6c90043ad0 2024-09-21T21:20:30.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.726+0000 7f535affd640 1 -- 172.21.15.5:0/2576643543 >> v2:172.21.15.5:6801/1340303177 conn(0x7f5354043b50 msgr2=0x7f5354046020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.726+0000 7f535affd640 1 --2- 172.21.15.5:0/2576643543 >> v2:172.21.15.5:6801/1340303177 conn(0x7f5354043b50 0x7f5354046020 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 -- 172.21.15.5:0/2576643543 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f535403eb50 msgr2=0x7f5354041060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.746 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f535403eb50 0x7f5354041060 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 -- 172.21.15.5:0/2576643543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537009eb00 msgr2=0x7f5370120c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537009eb00 0x7f5370120c70 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 >> v2:172.21.15.148:6803/877610312 conn(0x7f6c90043ad0 msgr2=0x7f6c90045fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1085020777 >> v2:172.21.15.148:6803/877610312 conn(0x7f6c90043ad0 0x7f6c90045fa0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f6c9003ead0 msgr2=0x7f6c90040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f6c9003ead0 0x7f6c90040fe0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 msgr2=0x7f6cac1229d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 >> v2:172.21.15.5:6804/1102615197 conn(0x7fed28043bf0 msgr2=0x7fed280460c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2072356875 >> v2:172.21.15.5:6804/1102615197 conn(0x7fed28043bf0 0x7fed280460c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac1229d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 shutdown_connections 2024-09-21T21:20:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 -- 172.21.15.5:0/2576643543 shutdown_connections 2024-09-21T21:20:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 --2- 172.21.15.5:0/2576643543 >> v2:172.21.15.5:6801/1340303177 conn(0x7f5354043b50 0x7f5354046020 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f535403eb50 0x7f5354041060 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 --2- 172.21.15.5:0/2576643543 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f537009eb00 0x7f5370120c70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 -- 172.21.15.5:0/2576643543 >> 172.21.15.5:0/2576643543 conn(0x7f53700a51b0 msgr2=0x7f53701bde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fed2803eb70 msgr2=0x7fed28041080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1085020777 >> v2:172.21.15.148:6803/877610312 conn(0x7f6c90043ad0 0x7f6c90045fa0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fed2803eb70 0x7fed28041080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f6c9003ead0 0x7f6c90040fe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48130da0 msgr2=0x7fed4811d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48130da0 0x7fed4811d280 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f535affd640 1 -- 172.21.15.5:0/2576643543 shutdown_connections 2024-09-21T21:20:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 --2- 172.21.15.5:0/1085020777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6cac09eb00 0x7f6cac1229d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.727+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 >> 172.21.15.5:0/1085020777 conn(0x7f6cac0a51b0 msgr2=0x7f6cac0a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7f535affd640 1 -- 172.21.15.5:0/2576643543 wait complete. 2024-09-21T21:20:30.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 shutdown_connections 2024-09-21T21:20:30.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7f6cb3abd640 1 -- 172.21.15.5:0/1085020777 wait complete. 2024-09-21T21:20:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 shutdown_connections 2024-09-21T21:20:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2072356875 >> v2:172.21.15.5:6804/1102615197 conn(0x7fed28043bf0 0x7fed280460c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fed2803eb70 0x7fed28041080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 --2- 172.21.15.5:0/2072356875 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed48130da0 0x7fed4811d280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 >> 172.21.15.5:0/2072356875 conn(0x7fed480a2f60 msgr2=0x7fed48134d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.728+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 shutdown_connections 2024-09-21T21:20:30.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.729+0000 7fed4cb11640 1 -- 172.21.15.5:0/2072356875 wait complete. 2024-09-21T21:20:30.754 INFO:teuthology.orchestra.run.smithi005.stdout:42949672966 2024-09-21T21:20:30.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-21T21:20:30.755 INFO:teuthology.orchestra.run.smithi005.stdout:38654705671 2024-09-21T21:20:30.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-21T21:20:30.756 INFO:teuthology.orchestra.run.smithi005.stdout:42949672966 2024-09-21T21:20:30.756 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-21T21:20:30.757 INFO:teuthology.orchestra.run.smithi005.stdout:38654705671 2024-09-21T21:20:30.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-21T21:20:30.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.913+0000 7fd221ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.913+0000 7f10e78ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.913+0000 7fd1cc591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.919+0000 7fd221ad1640 1 Processor -- start 2024-09-21T21:20:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.919+0000 7fd221ad1640 1 -- start start 2024-09-21T21:20:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.919+0000 7f10e78ac640 1 Processor -- start 2024-09-21T21:20:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.914+0000 7fa5418bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.921 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.920+0000 7f10e78ac640 1 -- start start 2024-09-21T21:20:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.920+0000 7fd1cc591640 1 Processor -- start 2024-09-21T21:20:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.920+0000 7fd1cc591640 1 -- start start 2024-09-21T21:20:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fa5418bd640 1 Processor -- start 2024-09-21T21:20:30.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fa5418bd640 1 -- start start 2024-09-21T21:20:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fd221ad1640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd21c09eb00 0x7fd21c135e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fd221ad1640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c09fb20 con 0x7fd21c1363b0 2024-09-21T21:20:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fd221ad1640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c09f810 con 0x7fd21c09eb00 2024-09-21T21:20:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fd21b7fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd21c09eb00 0x7fd21c135e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fd21affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd21c1363b0 0x7fd21c09c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42456/0 (socket says 172.21.15.5:42456) 2024-09-21T21:20:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.921+0000 7fd21affd640 1 -- 172.21.15.5:0/2623115788 learned_addr learned my addr 172.21.15.5:0/2623115788 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd21b7fe640 1 -- 172.21.15.5:0/2623115788 >> v1:172.21.15.5:6789/0 conn(0x7fd21c1363b0 legacy=0x7fd21c09c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd21b7fe640 1 -- 172.21.15.5:0/2623115788 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c09fdb0 con 0x7fd21c09eb00 2024-09-21T21:20:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1cc591640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd1c4136f70 0x7fd1c4139390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7f10e78ac640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f10e0136f70 0x7f10e0139390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd21b7fe640 1 --2- 172.21.15.5:0/2623115788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c135e70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de815d3b041d98c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1cc591640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c41318c0 con 0x7fd1c4130da0 2024-09-21T21:20:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1cc591640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c409f120 con 0x7fd1c4136f70 2024-09-21T21:20:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1ca32d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd1c4130da0 0x7fd1c41311b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42458/0 (socket says 172.21.15.5:42458) 2024-09-21T21:20:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1ca32d640 1 -- 172.21.15.5:0/4177334889 learned_addr learned my addr 172.21.15.5:0/4177334889 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:30.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1c9b2c640 1 --2- 172.21.15.5:0/4177334889 >> v2:172.21.15.5:3300/0 conn(0x7fd1c4136f70 0x7fd1c4139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7f10e5648640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f10e0130da0 0x7f10e01311b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42470/0 (socket says 172.21.15.5:42470) 2024-09-21T21:20:30.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7f10e5648640 1 -- 172.21.15.5:0/3242694436 learned_addr learned my addr 172.21.15.5:0/3242694436 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7f10e78ac640 1 -- 172.21.15.5:0/3242694436 --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e01318c0 con 0x7f10e0130da0 2024-09-21T21:20:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7f10e78ac640 1 -- 172.21.15.5:0/3242694436 --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f10e009f120 con 0x7f10e0136f70 2024-09-21T21:20:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7f10e4e47640 1 --2- 172.21.15.5:0/3242694436 >> v2:172.21.15.5:3300/0 conn(0x7f10e0136f70 0x7f10e0139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd21a7fc640 1 -- 172.21.15.5:0/2623115788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd20c009d90 con 0x7fd21c09eb00 2024-09-21T21:20:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd21a7fc640 1 -- 172.21.15.5:0/2623115788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd20c00e230 con 0x7fd21c09eb00 2024-09-21T21:20:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd21a7fc640 1 -- 172.21.15.5:0/2623115788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd20c009d90 con 0x7fd21c09eb00 2024-09-21T21:20:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1c9b2c640 1 -- 172.21.15.5:0/4177334889 >> v1:172.21.15.5:6789/0 conn(0x7fd1c4130da0 legacy=0x7fd1c41311b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7fd1c9b2c640 1 -- 172.21.15.5:0/4177334889 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c40a23f0 con 0x7fd1c4136f70 2024-09-21T21:20:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.922+0000 7f10d7fff640 1 -- 172.21.15.5:0/3242694436 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687156019 0 0) 0x7f10dc001110 con 0x7f10e0130da0 2024-09-21T21:20:30.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7f10d7fff640 1 -- 172.21.15.5:0/3242694436 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10cc003580 con 0x7f10e0130da0 2024-09-21T21:20:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7f10e4e47640 1 -- 172.21.15.5:0/3242694436 >> v1:172.21.15.5:6789/0 conn(0x7f10e0130da0 legacy=0x7f10e01311b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fd1c9b2c640 1 --2- 172.21.15.5:0/4177334889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4136f70 0x7fd1c4139390 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e92c85932f479db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7f10e4e47640 1 -- 172.21.15.5:0/3242694436 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e00a23f0 con 0x7f10e0136f70 2024-09-21T21:20:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7f10e4e47640 1 --2- 172.21.15.5:0/3242694436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0136f70 0x7f10e0139390 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaafaa63bb2ca76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fd1c932b640 1 -- 172.21.15.5:0/4177334889 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1b4009d90 con 0x7fd1c4136f70 2024-09-21T21:20:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fd1c932b640 1 -- 172.21.15.5:0/4177334889 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd1b400e230 con 0x7fd1c4136f70 2024-09-21T21:20:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fd1c932b640 1 -- 172.21.15.5:0/4177334889 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1b400e4d0 con 0x7fd1c4136f70 2024-09-21T21:20:30.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7f10d7fff640 1 -- 172.21.15.5:0/3242694436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f10d0009d90 con 0x7f10e0136f70 2024-09-21T21:20:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fa5418bd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa53c09d4f0 0x7fa53c137310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7f10d7fff640 1 -- 172.21.15.5:0/3242694436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f10d000e230 con 0x7f10e0136f70 2024-09-21T21:20:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fa5418bd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa53c074c10 con 0x7fa53c09c9d0 2024-09-21T21:20:30.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fa5418bd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa53c06fc40 con 0x7fa53c09d4f0 2024-09-21T21:20:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7f10d7fff640 1 -- 172.21.15.5:0/3242694436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f10d000e4d0 con 0x7f10e0136f70 2024-09-21T21:20:30.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fa53affd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa53c09c9d0 0x7fa53c09cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42486/0 (socket says 172.21.15.5:42486) 2024-09-21T21:20:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fa53affd640 1 -- 172.21.15.5:0/88582776 learned_addr learned my addr 172.21.15.5:0/88582776 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.923+0000 7fa53a7fc640 1 --2- 172.21.15.5:0/88582776 >> v2:172.21.15.5:3300/0 conn(0x7fa53c09d4f0 0x7fa53c137310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 1 -- 172.21.15.5:0/2623115788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 msgr2=0x7fd21c135e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 1 --2- 172.21.15.5:0/2623115788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c135e70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fa53a7fc640 1 -- 172.21.15.5:0/88582776 >> v1:172.21.15.5:6789/0 conn(0x7fa53c09c9d0 legacy=0x7fa53c09cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fa53a7fc640 1 -- 172.21.15.5:0/88582776 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53c09e420 con 0x7fa53c09d4f0 2024-09-21T21:20:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 1 -- 172.21.15.5:0/2623115788 shutdown_connections 2024-09-21T21:20:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 1 --2- 172.21.15.5:0/2623115788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c135e70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 1 -- 172.21.15.5:0/2623115788 >> 172.21.15.5:0/2623115788 conn(0x7fd21c0a51b0 msgr2=0x7fd21c0a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 1 -- 172.21.15.5:0/2623115788 shutdown_connections 2024-09-21T21:20:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fa53a7fc640 1 --2- 172.21.15.5:0/88582776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09d4f0 0x7fa53c137310 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e916f0721dafd9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 1 -- 172.21.15.5:0/2623115788 wait complete. 2024-09-21T21:20:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd1cc591640 1 -- 172.21.15.5:0/4177334889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4136f70 msgr2=0x7fd1c4139390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd1cc591640 1 --2- 172.21.15.5:0/4177334889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4136f70 0x7fd1c4139390 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fa539ffb640 1 -- 172.21.15.5:0/88582776 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa53000ad20 con 0x7fa53c09d4f0 2024-09-21T21:20:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fa539ffb640 1 -- 172.21.15.5:0/88582776 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa53000ae80 con 0x7fa53c09d4f0 2024-09-21T21:20:30.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fa539ffb640 1 -- 172.21.15.5:0/88582776 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa53000f470 con 0x7fa53c09d4f0 2024-09-21T21:20:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd1cc591640 1 -- 172.21.15.5:0/4177334889 shutdown_connections 2024-09-21T21:20:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd1cc591640 1 --2- 172.21.15.5:0/4177334889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4136f70 0x7fd1c4139390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd1cc591640 1 -- 172.21.15.5:0/4177334889 >> 172.21.15.5:0/4177334889 conn(0x7fd1c40a2f60 msgr2=0x7fd1c40a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd221ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7f10e78ac640 1 -- 172.21.15.5:0/3242694436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0136f70 msgr2=0x7f10e0139390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7f10e78ac640 1 --2- 172.21.15.5:0/3242694436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0136f70 0x7f10e0139390 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd1cc591640 1 -- 172.21.15.5:0/4177334889 shutdown_connections 2024-09-21T21:20:30.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.924+0000 7fd1cc591640 1 -- 172.21.15.5:0/4177334889 wait complete. 2024-09-21T21:20:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7f10e78ac640 1 -- 172.21.15.5:0/3242694436 shutdown_connections 2024-09-21T21:20:30.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7f10e78ac640 1 --2- 172.21.15.5:0/3242694436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0136f70 0x7f10e0139390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7f10e78ac640 1 -- 172.21.15.5:0/3242694436 >> 172.21.15.5:0/3242694436 conn(0x7f10e00a2f60 msgr2=0x7f10e00a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fd1cc591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7f10e78ac640 1 -- 172.21.15.5:0/3242694436 shutdown_connections 2024-09-21T21:20:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7f10e78ac640 1 -- 172.21.15.5:0/3242694436 wait complete. 2024-09-21T21:20:30.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7f10e78ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fa5418bd640 1 -- 172.21.15.5:0/88582776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09d4f0 msgr2=0x7fa53c137310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fa5418bd640 1 --2- 172.21.15.5:0/88582776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09d4f0 0x7fa53c137310 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fa5418bd640 1 -- 172.21.15.5:0/88582776 shutdown_connections 2024-09-21T21:20:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fa5418bd640 1 --2- 172.21.15.5:0/88582776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09d4f0 0x7fa53c137310 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fa5418bd640 1 -- 172.21.15.5:0/88582776 >> 172.21.15.5:0/88582776 conn(0x7fa53c09f170 msgr2=0x7fa53c09f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:30.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fa5418bd640 1 -- 172.21.15.5:0/88582776 shutdown_connections 2024-09-21T21:20:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.925+0000 7fa5418bd640 1 -- 172.21.15.5:0/88582776 wait complete. 2024-09-21T21:20:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.926+0000 7fa5418bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.926+0000 7fd221ad1640 1 Processor -- start 2024-09-21T21:20:30.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.927+0000 7fd221ad1640 1 -- start start 2024-09-21T21:20:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.927+0000 7fd1cc591640 1 Processor -- start 2024-09-21T21:20:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.927+0000 7f10e78ac640 1 Processor -- start 2024-09-21T21:20:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.927+0000 7fd1cc591640 1 -- start start 2024-09-21T21:20:30.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.927+0000 7f10e78ac640 1 -- start start 2024-09-21T21:20:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.928+0000 7fa5418bd640 1 Processor -- start 2024-09-21T21:20:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.928+0000 7fa5418bd640 1 -- start start 2024-09-21T21:20:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.928+0000 7fd221ad1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c121bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.928+0000 7fd221ad1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c125c30 con 0x7fd21c09eb00 2024-09-21T21:20:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.928+0000 7fd1cc591640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4130da0 0x7fd1c411d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.928+0000 7fd1cc591640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c411ded0 con 0x7fd1c4130da0 2024-09-21T21:20:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.928+0000 7fd21b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c121bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1ca32d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4130da0 0x7fd1c411d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd21b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c121bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38840/0 (socket says 172.21.15.5:38840) 2024-09-21T21:20:30.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd21b7fe640 1 -- 172.21.15.5:0/1793062799 learned_addr learned my addr 172.21.15.5:0/1793062799 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1ca32d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4130da0 0x7fd1c411d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38846/0 (socket says 172.21.15.5:38846) 2024-09-21T21:20:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1ca32d640 1 -- 172.21.15.5:0/3547931816 learned_addr learned my addr 172.21.15.5:0/3547931816 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7f10e78ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0130da0 0x7f10e0130450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7f10e78ac640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0121fb0 con 0x7f10e0130da0 2024-09-21T21:20:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1ca32d640 1 -- 172.21.15.5:0/3547931816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c411f9b0 con 0x7fd1c4130da0 2024-09-21T21:20:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1ca32d640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4130da0 0x7fd1c411d280 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7f10e5648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0130da0 0x7f10e0130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd21b7fe640 1 -- 172.21.15.5:0/1793062799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c125800 con 0x7fd21c09eb00 2024-09-21T21:20:30.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7f10e5648640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0130da0 0x7f10e0130450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38854/0 (socket says 172.21.15.5:38854) 2024-09-21T21:20:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1baffd640 1 -- 172.21.15.5:0/3547931816 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1c0005a60 con 0x7fd1c4130da0 2024-09-21T21:20:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c411e780 con 0x7fd1c4130da0 2024-09-21T21:20:30.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd21b7fe640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c121bc0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7f10e5648640 1 -- 172.21.15.5:0/962123387 learned_addr learned my addr 172.21.15.5:0/962123387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fa5418bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09c9d0 0x7fa53c1c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1baffd640 1 -- 172.21.15.5:0/3547931816 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd1c0005bc0 con 0x7fd1c4130da0 2024-09-21T21:20:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.929+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c411c9b0 con 0x7fd1c4130da0 2024-09-21T21:20:30.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fd203fff640 1 -- 172.21.15.5:0/1793062799 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd20c004170 con 0x7fd21c09eb00 2024-09-21T21:20:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fa5418bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa53c121d20 con 0x7fa53c09c9d0 2024-09-21T21:20:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fd203fff640 1 -- 172.21.15.5:0/1793062799 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd20c0042d0 con 0x7fd21c09eb00 2024-09-21T21:20:30.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fd221ad1640 1 -- 172.21.15.5:0/1793062799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1254a0 con 0x7fd21c09eb00 2024-09-21T21:20:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fa53affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09c9d0 0x7fa53c1c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fa53affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09c9d0 0x7fa53c1c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38866/0 (socket says 172.21.15.5:38866) 2024-09-21T21:20:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fa53affd640 1 -- 172.21.15.5:0/429416323 learned_addr learned my addr 172.21.15.5:0/429416323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7f10e5648640 1 -- 172.21.15.5:0/962123387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e0070370 con 0x7f10e0130da0 2024-09-21T21:20:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7f10e5648640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0130da0 0x7f10e0130450 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fa53affd640 1 -- 172.21.15.5:0/429416323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53c1242c0 con 0x7fa53c09c9d0 2024-09-21T21:20:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fd1baffd640 1 -- 172.21.15.5:0/3547931816 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd1c0005e60 con 0x7fd1c4130da0 2024-09-21T21:20:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fa53affd640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09c9d0 0x7fa53c1c64d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c4120530 con 0x7fd1c4130da0 2024-09-21T21:20:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7f10d5ffb640 1 -- 172.21.15.5:0/962123387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f10dc005930 con 0x7f10e0130da0 2024-09-21T21:20:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7f10d5ffb640 1 -- 172.21.15.5:0/962123387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f10dc005a90 con 0x7f10e0130da0 2024-09-21T21:20:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7f10d5ffb640 1 -- 172.21.15.5:0/962123387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f10dc005d30 con 0x7f10e0130da0 2024-09-21T21:20:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e0121c10 con 0x7f10e0130da0 2024-09-21T21:20:30.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e01228d0 con 0x7f10e0130da0 2024-09-21T21:20:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fd1baffd640 1 -- 172.21.15.5:0/3547931816 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fd1c000c7f0 con 0x7fd1c4130da0 2024-09-21T21:20:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fa523fff640 1 -- 172.21.15.5:0/429416323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa52c00cc50 con 0x7fa53c09c9d0 2024-09-21T21:20:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fa523fff640 1 -- 172.21.15.5:0/429416323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa52c00cdb0 con 0x7fa53c09c9d0 2024-09-21T21:20:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.930+0000 7fd221ad1640 1 -- 172.21.15.5:0/1793062799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c124600 con 0x7fd21c09eb00 2024-09-21T21:20:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fd203fff640 1 -- 172.21.15.5:0/1793062799 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd20c004570 con 0x7fd21c09eb00 2024-09-21T21:20:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fa523fff640 1 -- 172.21.15.5:0/429416323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa52c00f560 con 0x7fa53c09c9d0 2024-09-21T21:20:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.931+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53c09da60 con 0x7fa53c09c9d0 2024-09-21T21:20:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.932+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f40050f0 con 0x7fd21c09eb00 2024-09-21T21:20:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.932+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa53c0701a0 con 0x7fa53c09c9d0 2024-09-21T21:20:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.932+0000 7fd1baffd640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd1a803ead0 0x7fd1a8040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.932+0000 7fd1baffd640 1 -- 172.21.15.5:0/3547931816 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fd1c004f830 con 0x7fd1c4130da0 2024-09-21T21:20:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.932+0000 7fd1c9b2c640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd1a803ead0 0x7fd1a8040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.933+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e01233c0 con 0x7f10e0130da0 2024-09-21T21:20:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.933+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53c064a80 con 0x7fa53c09c9d0 2024-09-21T21:20:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.933+0000 7fd203fff640 1 -- 172.21.15.5:0/1793062799 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fd20c003670 con 0x7fd21c09eb00 2024-09-21T21:20:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.933+0000 7fd1c9b2c640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd1a803ead0 0x7fd1a8040fe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.933+0000 7fd203fff640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd20803ea70 0x7fd208040f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.933+0000 7fd203fff640 1 -- 172.21.15.5:0/1793062799 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fd20c019040 con 0x7fd21c09eb00 2024-09-21T21:20:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.934+0000 7fd21affd640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd20803ea70 0x7fd208040f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.934+0000 7fd21affd640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd20803ea70 0x7fd208040f80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.937+0000 7fd1baffd640 1 -- 172.21.15.5:0/3547931816 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fd1c4120530 con 0x7fd1c4130da0 2024-09-21T21:20:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.939+0000 7fa523fff640 1 -- 172.21.15.5:0/429416323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fa52c00f6c0 con 0x7fa53c09c9d0 2024-09-21T21:20:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.939+0000 7fa523fff640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa52803eb30 0x7fa528041040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.940+0000 7fa53a7fc640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa52803eb30 0x7fa528041040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.940+0000 7fa53a7fc640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa52803eb30 0x7fa528041040 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.943+0000 7fd203fff640 1 -- 172.21.15.5:0/1793062799 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fd20c014cc0 con 0x7fd21c09eb00 2024-09-21T21:20:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.943+0000 7fa523fff640 1 -- 172.21.15.5:0/429416323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fa52c006c50 con 0x7fa53c09c9d0 2024-09-21T21:20:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.944+0000 7f10d5ffb640 1 -- 172.21.15.5:0/962123387 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f10dc00c800 con 0x7f10e0130da0 2024-09-21T21:20:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.944+0000 7f10d5ffb640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f10c403eb20 0x7f10c4041030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.944+0000 7f10d5ffb640 1 -- 172.21.15.5:0/962123387 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7f10dc04f8f0 con 0x7f10e0130da0 2024-09-21T21:20:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.945+0000 7f10e4e47640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f10c403eb20 0x7f10c4041030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.945+0000 7f10e4e47640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f10c403eb20 0x7f10c4041030 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:30.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.949+0000 7fa523fff640 1 -- 172.21.15.5:0/429416323 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fa52c00ec70 con 0x7fa53c09c9d0 2024-09-21T21:20:30.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:30.954+0000 7f10d5ffb640 1 -- 172.21.15.5:0/962123387 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f10dc00abd0 con 0x7f10e0130da0 2024-09-21T21:20:31.143 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.142+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa53c06db20 con 0x7fa53c09c9d0 2024-09-21T21:20:31.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.142+0000 7fa523fff640 1 -- 172.21.15.5:0/429416323 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fa52c0061c0 con 0x7fa53c09c9d0 2024-09-21T21:20:31.145 INFO:teuthology.orchestra.run.smithi005.stdout:42949672966 2024-09-21T21:20:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.144+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa52803eb30 msgr2=0x7fa528041040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.144+0000 7fa5418bd640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa52803eb30 0x7fa528041040 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.144+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09c9d0 msgr2=0x7fa53c1c64d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.144+0000 7fa5418bd640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09c9d0 0x7fa53c1c64d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.144+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 shutdown_connections 2024-09-21T21:20:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.144+0000 7fa5418bd640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa52803eb30 0x7fa528041040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.145+0000 7fa5418bd640 1 --2- 172.21.15.5:0/429416323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa53c09c9d0 0x7fa53c1c64d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.147 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.145+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 >> 172.21.15.5:0/429416323 conn(0x7fa53c09f170 msgr2=0x7fa53c11ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.145+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 shutdown_connections 2024-09-21T21:20:31.148 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.145+0000 7fa5418bd640 1 -- 172.21.15.5:0/429416323 wait complete. 2024-09-21T21:20:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.147+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f10e01318c0 con 0x7f10e0130da0 2024-09-21T21:20:31.149 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.147+0000 7f10d5ffb640 1 -- 172.21.15.5:0/962123387 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f10e01318c0 con 0x7f10e0130da0 2024-09-21T21:20:31.149 INFO:teuthology.orchestra.run.smithi005.stdout:42949672966 2024-09-21T21:20:31.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f10c403eb20 msgr2=0x7f10c4041030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f10c403eb20 0x7f10c4041030 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0130da0 msgr2=0x7f10e0130450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0130da0 0x7f10e0130450 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 shutdown_connections 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f10c403eb20 0x7f10c4041030 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 --2- 172.21.15.5:0/962123387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10e0130da0 0x7f10e0130450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 >> 172.21.15.5:0/962123387 conn(0x7f10e00a2f60 msgr2=0x7f10e00a4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 shutdown_connections 2024-09-21T21:20:31.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.150+0000 7f10e78ac640 1 -- 172.21.15.5:0/962123387 wait complete. 2024-09-21T21:20:31.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-21T21:20:31.164 DEBUG:teuthology.parallel:result is None 2024-09-21T21:20:31.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2024-09-21T21:20:31.164 DEBUG:teuthology.parallel:result is None 2024-09-21T21:20:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.169+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd1c41318c0 con 0x7fd1c4130da0 2024-09-21T21:20:31.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.169+0000 7fd1baffd640 1 -- 172.21.15.5:0/3547931816 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fd1c41318c0 con 0x7fd1c4130da0 2024-09-21T21:20:31.171 INFO:teuthology.orchestra.run.smithi005.stdout:38654705671 2024-09-21T21:20:31.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.170+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd1f40053a0 con 0x7fd21c09eb00 2024-09-21T21:20:31.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.171+0000 7fd203fff640 1 -- 172.21.15.5:0/1793062799 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fd20c010310 con 0x7fd21c09eb00 2024-09-21T21:20:31.172 INFO:teuthology.orchestra.run.smithi005.stdout:38654705671 2024-09-21T21:20:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd1a803ead0 msgr2=0x7fd1a8040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd1a803ead0 0x7fd1a8040fe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4130da0 msgr2=0x7fd1c411d280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4130da0 0x7fd1c411d280 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 shutdown_connections 2024-09-21T21:20:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd1a803ead0 0x7fd1a8040fe0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 --2- 172.21.15.5:0/3547931816 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd1c4130da0 0x7fd1c411d280 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 >> 172.21.15.5:0/3547931816 conn(0x7fd1c40a2f60 msgr2=0x7fd1c4134d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 shutdown_connections 2024-09-21T21:20:31.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.172+0000 7fd1cc591640 1 -- 172.21.15.5:0/3547931816 wait complete. 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd20803ea70 msgr2=0x7fd208040f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd20803ea70 0x7fd208040f80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 msgr2=0x7fd21c121bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c121bc0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 shutdown_connections 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd20803ea70 0x7fd208040f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 --2- 172.21.15.5:0/1793062799 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd21c09eb00 0x7fd21c121bc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 >> 172.21.15.5:0/1793062799 conn(0x7fd21c0a51b0 msgr2=0x7fd21c0a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 shutdown_connections 2024-09-21T21:20:31.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.173+0000 7fd201ffb640 1 -- 172.21.15.5:0/1793062799 wait complete. 2024-09-21T21:20:31.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-21T21:20:31.188 DEBUG:teuthology.parallel:result is None 2024-09-21T21:20:31.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-21T21:20:31.189 DEBUG:teuthology.parallel:result is None 2024-09-21T21:20:31.189 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T21:20:31.189 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T21:20:31.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.338+0000 7fd6cc08e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.343+0000 7fd6cc08e640 1 Processor -- start 2024-09-21T21:20:31.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.343+0000 7fd6cc08e640 1 -- start start 2024-09-21T21:20:31.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.344+0000 7fd6cc08e640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c4136580 0x7fd6c413b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.344+0000 7fd6cc08e640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6c409fb20 con 0x7fd6c409eb00 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.344+0000 7fd6cc08e640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd6c409f810 con 0x7fd6c4136580 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.344+0000 7fd6c9629640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c4136580 0x7fd6c413b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c9629640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd6c4136580 0x7fd6c413b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38874/0 (socket says 172.21.15.5:38874) 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c9629640 1 -- 172.21.15.5:0/1729143913 learned_addr learned my addr 172.21.15.5:0/1729143913 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c9e2a640 1 --1- 172.21.15.5:0/1729143913 >> v1:172.21.15.5:6789/0 conn(0x7fd6c409eb00 0x7fd6c4135e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42494/0 (socket says 172.21.15.5:42494) 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c9629640 1 -- 172.21.15.5:0/1729143913 >> v1:172.21.15.5:6789/0 conn(0x7fd6c409eb00 legacy=0x7fd6c4135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c9629640 1 -- 172.21.15.5:0/1729143913 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c409fdb0 con 0x7fd6c4136580 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c8e28640 1 -- 172.21.15.5:0/1729143913 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1574550295 0 0) 0x7fd6c409fb20 con 0x7fd6c409eb00 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c9629640 1 --2- 172.21.15.5:0/1729143913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c4136580 0x7fd6c413b0b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a240468bcab07a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c8e28640 1 -- 172.21.15.5:0/1729143913 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6b8009e50 con 0x7fd6c4136580 2024-09-21T21:20:31.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c8e28640 1 -- 172.21.15.5:0/1729143913 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6b800e230 con 0x7fd6c4136580 2024-09-21T21:20:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.345+0000 7fd6c8e28640 1 -- 172.21.15.5:0/1729143913 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6b800e4d0 con 0x7fd6c4136580 2024-09-21T21:20:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 1 -- 172.21.15.5:0/1729143913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c4136580 msgr2=0x7fd6c413b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 1 --2- 172.21.15.5:0/1729143913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c4136580 0x7fd6c413b0b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 1 -- 172.21.15.5:0/1729143913 shutdown_connections 2024-09-21T21:20:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 1 --2- 172.21.15.5:0/1729143913 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c4136580 0x7fd6c413b0b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 1 -- 172.21.15.5:0/1729143913 >> 172.21.15.5:0/1729143913 conn(0x7fd6c40a51b0 msgr2=0x7fd6c40a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 1 -- 172.21.15.5:0/1729143913 shutdown_connections 2024-09-21T21:20:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 1 -- 172.21.15.5:0/1729143913 wait complete. 2024-09-21T21:20:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.346+0000 7fd6cc08e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.348+0000 7fd6cc08e640 1 Processor -- start 2024-09-21T21:20:31.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.348+0000 7fd6cc08e640 1 -- start start 2024-09-21T21:20:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.349+0000 7fd6cc08e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c409eb00 0x7fd6c4122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.349+0000 7fd6cc08e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4135d30 con 0x7fd6c409eb00 2024-09-21T21:20:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c9e2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c409eb00 0x7fd6c4122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c9e2a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c409eb00 0x7fd6c4122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38886/0 (socket says 172.21.15.5:38886) 2024-09-21T21:20:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c9e2a640 1 -- 172.21.15.5:0/3050446530 learned_addr learned my addr 172.21.15.5:0/3050446530 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:31.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c9e2a640 1 -- 172.21.15.5:0/3050446530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c4123dd0 con 0x7fd6c409eb00 2024-09-21T21:20:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c9e2a640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c409eb00 0x7fd6c4122930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c27fc640 1 -- 172.21.15.5:0/3050446530 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6bc004b80 con 0x7fd6c409eb00 2024-09-21T21:20:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c27fc640 1 -- 172.21.15.5:0/3050446530 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd6bc004ce0 con 0x7fd6c409eb00 2024-09-21T21:20:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c41243b0 con 0x7fd6c409eb00 2024-09-21T21:20:31.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6c27fc640 1 -- 172.21.15.5:0/3050446530 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd6bc007120 con 0x7fd6c409eb00 2024-09-21T21:20:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.350+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c4124c00 con 0x7fd6c409eb00 2024-09-21T21:20:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.351+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c4135e70 con 0x7fd6c409eb00 2024-09-21T21:20:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.351+0000 7fd6c27fc640 1 -- 172.21.15.5:0/3050446530 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fd6bc0072d0 con 0x7fd6c409eb00 2024-09-21T21:20:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.352+0000 7fd6c27fc640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd6b003ead0 0x7fd6b0040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:31.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.352+0000 7fd6c27fc640 1 -- 172.21.15.5:0/3050446530 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fd6bc04f9e0 con 0x7fd6c409eb00 2024-09-21T21:20:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.352+0000 7fd6c9629640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd6b003ead0 0x7fd6b0040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:31.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.353+0000 7fd6c9629640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd6b003ead0 0x7fd6b0040fe0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:31.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.357+0000 7fd6c27fc640 1 -- 172.21.15.5:0/3050446530 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fd6bc00f230 con 0x7fd6c409eb00 2024-09-21T21:20:31.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.547+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6c406fcf0 con 0x7fd6b003ead0 2024-09-21T21:20:31.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.549+0000 7fd6c27fc640 1 -- 172.21.15.5:0/3050446530 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31132 (crc 0 0 0) 0x7fd6b8009e20 con 0x7fd6b003ead0 2024-09-21T21:20:31.550 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:31.551 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-21T21:20:31.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd6b003ead0 msgr2=0x7fd6b0040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd6b003ead0 0x7fd6b0040fe0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c409eb00 msgr2=0x7fd6c4122930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c409eb00 0x7fd6c4122930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 shutdown_connections 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd6b003ead0 0x7fd6b0040fe0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 --2- 172.21.15.5:0/3050446530 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd6c409eb00 0x7fd6c4122930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 >> 172.21.15.5:0/3050446530 conn(0x7fd6c40a51b0 msgr2=0x7fd6c40a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 shutdown_connections 2024-09-21T21:20:31.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.551+0000 7fd6cc08e640 1 -- 172.21.15.5:0/3050446530 wait complete. 2024-09-21T21:20:31.563 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-21T21:20:31.073877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1314562,"data_compressed":59974,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.345365"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.167841+0000","last_change":"2024-09-21T21:20:29.170558+0000","last_active":"2024-09-21T21:20:29.167841+0000","last_peered":"2024-09-21T21:20:29.167841+0000","last_clean":"2024-09-21T21:20:29.167841+0000","last_became_active":"2024-09-21T21:20:27.209536+0000","last_became_peered":"2024-09-21T21:20:27.209536+0000","last_unstale":"2024-09-21T21:20:29.167841+0000","last_undegraded":"2024-09-21T21:20:29.167841+0000","last_fullsized":"2024-09-21T21:20:29.167841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.166904+0000","last_change":"2024-09-21T21:20:29.168730+0000","last_active":"2024-09-21T21:20:29.166904+0000","last_peered":"2024-09-21T21:20:29.166904+0000","last_clean":"2024-09-21T21:20:29.166904+0000","last_became_active":"2024-09-21T21:20:27.208215+0000","last_became_peered":"2024-09-21T21:20:27.208215+0000","last_unstale":"2024-09-21T21:20:29.166904+0000","last_undegraded":"2024-09-21T21:20:29.166904+0000","last_fullsized":"2024-09-21T21:20:29.166904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.166607+0000","last_change":"2024-09-21T21:20:29.169143+0000","last_active":"2024-09-21T21:20:29.166607+0000","last_peered":"2024-09-21T21:20:29.166607+0000","last_clean":"2024-09-21T21:20:29.166607+0000","last_became_active":"2024-09-21T21:20:27.191527+0000","last_became_peered":"2024-09-21T21:20:27.191527+0000","last_unstale":"2024-09-21T21:20:29.166607+0000","last_undegraded":"2024-09-21T21:20:29.166607+0000","last_fullsized":"2024-09-21T21:20:29.166607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.163238+0000","last_change":"2024-09-21T21:20:29.167100+0000","last_active":"2024-09-21T21:20:29.163238+0000","last_peered":"2024-09-21T21:20:29.163238+0000","last_clean":"2024-09-21T21:20:29.163238+0000","last_became_active":"2024-09-21T21:20:27.193527+0000","last_became_peered":"2024-09-21T21:20:27.193527+0000","last_unstale":"2024-09-21T21:20:29.163238+0000","last_undegraded":"2024-09-21T21:20:29.163238+0000","last_fullsized":"2024-09-21T21:20:29.163238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.169124+0000","last_change":"2024-09-21T21:20:29.169124+0000","last_active":"2024-09-21T21:20:29.169124+0000","last_peered":"2024-09-21T21:20:29.169124+0000","last_clean":"2024-09-21T21:20:29.169124+0000","last_became_active":"2024-09-21T21:20:27.194367+0000","last_became_peered":"2024-09-21T21:20:27.194367+0000","last_unstale":"2024-09-21T21:20:29.169124+0000","last_undegraded":"2024-09-21T21:20:29.169124+0000","last_fullsized":"2024-09-21T21:20:29.169124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.164117+0000","last_change":"2024-09-21T21:20:29.166574+0000","last_active":"2024-09-21T21:20:29.164117+0000","last_peered":"2024-09-21T21:20:29.164117+0000","last_clean":"2024-09-21T21:20:29.164117+0000","last_became_active":"2024-09-21T21:20:27.194446+0000","last_became_peered":"2024-09-21T21:20:27.194446+0000","last_unstale":"2024-09-21T21:20:29.164117+0000","last_undegraded":"2024-09-21T21:20:29.164117+0000","last_fullsized":"2024-09-21T21:20:29.164117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.167266+0000","last_change":"2024-09-21T21:20:29.170643+0000","last_active":"2024-09-21T21:20:29.167266+0000","last_peered":"2024-09-21T21:20:29.167266+0000","last_clean":"2024-09-21T21:20:29.167266+0000","last_became_active":"2024-09-21T21:20:27.204212+0000","last_became_peered":"2024-09-21T21:20:27.204212+0000","last_unstale":"2024-09-21T21:20:29.167266+0000","last_undegraded":"2024-09-21T21:20:29.167266+0000","last_fullsized":"2024-09-21T21:20:29.167266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.167595+0000","last_change":"2024-09-21T21:20:29.170295+0000","last_active":"2024-09-21T21:20:29.167595+0000","last_peered":"2024-09-21T21:20:29.167595+0000","last_clean":"2024-09-21T21:20:29.167595+0000","last_became_active":"2024-09-21T21:20:27.211878+0000","last_became_peered":"2024-09-21T21:20:27.211878+0000","last_unstale":"2024-09-21T21:20:29.167595+0000","last_undegraded":"2024-09-21T21:20:29.167595+0000","last_fullsized":"2024-09-21T21:20:29.167595+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.163532+0000","last_change":"2024-09-21T21:20:26.198858+0000","last_active":"2024-09-21T21:20:29.163532+0000","last_peered":"2024-09-21T21:20:29.163532+0000","last_clean":"2024-09-21T21:20:29.163532+0000","last_became_active":"2024-09-21T21:20:26.190843+0000","last_became_peered":"2024-09-21T21:20:26.190843+0000","last_unstale":"2024-09-21T21:20:29.163532+0000","last_undegraded":"2024-09-21T21:20:29.163532+0000","last_fullsized":"2024-09-21T21:20:29.163532+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_clean_scrub_stamp":"2024-09-21T21:20:25.135404+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":623815,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":623834,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T21:20:31.564 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T21:20:31.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.672+0000 7fe17e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.677+0000 7fe17e511640 1 Processor -- start 2024-09-21T21:20:31.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.677+0000 7fe17e511640 1 -- start start 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe17e511640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe178136580 0x7fe17813b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe17e511640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17809fb20 con 0x7fe17809eb00 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe17e511640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe17809f810 con 0x7fe178136580 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe1777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe178136580 0x7fe17813b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe177fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe17809eb00 0x7fe178135e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42506/0 (socket says 172.21.15.5:42506) 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe1777fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe178136580 0x7fe17813b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38900/0 (socket says 172.21.15.5:38900) 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe177fff640 1 -- 172.21.15.5:0/2151990299 learned_addr learned my addr 172.21.15.5:0/2151990299 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe1777fe640 1 -- 172.21.15.5:0/2151990299 >> v1:172.21.15.5:6789/0 conn(0x7fe17809eb00 legacy=0x7fe178135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe1777fe640 1 -- 172.21.15.5:0/2151990299 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17809fdb0 con 0x7fe178136580 2024-09-21T21:20:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe176ffd640 1 -- 172.21.15.5:0/2151990299 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037756165 0 0) 0x7fe17809fb20 con 0x7fe17809eb00 2024-09-21T21:20:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe1777fe640 1 --2- 172.21.15.5:0/2151990299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe178136580 0x7fe17813b0b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb0d384fd5a9180 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.679+0000 7fe176ffd640 1 -- 172.21.15.5:0/2151990299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe16c009d90 con 0x7fe178136580 2024-09-21T21:20:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe176ffd640 1 -- 172.21.15.5:0/2151990299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe16c00e230 con 0x7fe178136580 2024-09-21T21:20:31.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe176ffd640 1 -- 172.21.15.5:0/2151990299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe16c00e4d0 con 0x7fe178136580 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe17e511640 1 -- 172.21.15.5:0/2151990299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe178136580 msgr2=0x7fe17813b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe17e511640 1 --2- 172.21.15.5:0/2151990299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe178136580 0x7fe17813b0b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe17e511640 1 -- 172.21.15.5:0/2151990299 shutdown_connections 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe17e511640 1 --2- 172.21.15.5:0/2151990299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe178136580 0x7fe17813b0b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe17e511640 1 -- 172.21.15.5:0/2151990299 >> 172.21.15.5:0/2151990299 conn(0x7fe1780a51b0 msgr2=0x7fe1780a55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe17e511640 1 -- 172.21.15.5:0/2151990299 shutdown_connections 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.680+0000 7fe17e511640 1 -- 172.21.15.5:0/2151990299 wait complete. 2024-09-21T21:20:31.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.681+0000 7fe17e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.682+0000 7fe17e511640 1 Processor -- start 2024-09-21T21:20:31.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.682+0000 7fe17e511640 1 -- start start 2024-09-21T21:20:31.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.684+0000 7fe17e511640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17809eb00 0x7fe178122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.684+0000 7fe17e511640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe178135d30 con 0x7fe17809eb00 2024-09-21T21:20:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.684+0000 7fe177fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17809eb00 0x7fe178122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.684+0000 7fe177fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17809eb00 0x7fe178122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38906/0 (socket says 172.21.15.5:38906) 2024-09-21T21:20:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.684+0000 7fe177fff640 1 -- 172.21.15.5:0/4229823231 learned_addr learned my addr 172.21.15.5:0/4229823231 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:31.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.684+0000 7fe177fff640 1 -- 172.21.15.5:0/4229823231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178123dd0 con 0x7fe17809eb00 2024-09-21T21:20:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.685+0000 7fe177fff640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17809eb00 0x7fe178122930 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.685+0000 7fe174ff9640 1 -- 172.21.15.5:0/4229823231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe168004b80 con 0x7fe17809eb00 2024-09-21T21:20:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.685+0000 7fe174ff9640 1 -- 172.21.15.5:0/4229823231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe168004ce0 con 0x7fe17809eb00 2024-09-21T21:20:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.685+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1781243b0 con 0x7fe17809eb00 2024-09-21T21:20:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.685+0000 7fe174ff9640 1 -- 172.21.15.5:0/4229823231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe168007120 con 0x7fe17809eb00 2024-09-21T21:20:31.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.685+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe178124c00 con 0x7fe17809eb00 2024-09-21T21:20:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.686+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe178135e70 con 0x7fe17809eb00 2024-09-21T21:20:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.686+0000 7fe174ff9640 1 -- 172.21.15.5:0/4229823231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fe1680072d0 con 0x7fe17809eb00 2024-09-21T21:20:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.687+0000 7fe174ff9640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe16403ead0 0x7fe164040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.687+0000 7fe174ff9640 1 -- 172.21.15.5:0/4229823231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fe16804f9e0 con 0x7fe17809eb00 2024-09-21T21:20:31.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.687+0000 7fe1777fe640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe16403ead0 0x7fe164040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:31.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.688+0000 7fe1777fe640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe16403ead0 0x7fe164040fe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:31.693 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.692+0000 7fe174ff9640 1 -- 172.21.15.5:0/4229823231 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fe16800f230 con 0x7fe17809eb00 2024-09-21T21:20:31.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.876+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe17806fcf0 con 0x7fe16403ead0 2024-09-21T21:20:31.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.877+0000 7fe174ff9640 1 -- 172.21.15.5:0/4229823231 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31132 (crc 0 0 0) 0x7fe16c009db0 con 0x7fe16403ead0 2024-09-21T21:20:31.879 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:31.879 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe16403ead0 msgr2=0x7fe164040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe16403ead0 0x7fe164040fe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17809eb00 msgr2=0x7fe178122930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17809eb00 0x7fe178122930 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 shutdown_connections 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe16403ead0 0x7fe164040fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 --2- 172.21.15.5:0/4229823231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe17809eb00 0x7fe178122930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:31.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 >> 172.21.15.5:0/4229823231 conn(0x7fe1780a51b0 msgr2=0x7fe1780a2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 shutdown_connections 2024-09-21T21:20:31.882 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:31.879+0000 7fe17e511640 1 -- 172.21.15.5:0/4229823231 wait complete. 2024-09-21T21:20:31.892 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-21T21:20:31.073877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":107984,"kb_used_data":624,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379376,"statfs":{"total":386547056640,"available":386436481024,"internally_reserved":0,"allocated":638976,"data_stored":1314562,"data_compressed":59974,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.345365"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.167841+0000","last_change":"2024-09-21T21:20:29.170558+0000","last_active":"2024-09-21T21:20:29.167841+0000","last_peered":"2024-09-21T21:20:29.167841+0000","last_clean":"2024-09-21T21:20:29.167841+0000","last_became_active":"2024-09-21T21:20:27.209536+0000","last_became_peered":"2024-09-21T21:20:27.209536+0000","last_unstale":"2024-09-21T21:20:29.167841+0000","last_undegraded":"2024-09-21T21:20:29.167841+0000","last_fullsized":"2024-09-21T21:20:29.167841+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.166904+0000","last_change":"2024-09-21T21:20:29.168730+0000","last_active":"2024-09-21T21:20:29.166904+0000","last_peered":"2024-09-21T21:20:29.166904+0000","last_clean":"2024-09-21T21:20:29.166904+0000","last_became_active":"2024-09-21T21:20:27.208215+0000","last_became_peered":"2024-09-21T21:20:27.208215+0000","last_unstale":"2024-09-21T21:20:29.166904+0000","last_undegraded":"2024-09-21T21:20:29.166904+0000","last_fullsized":"2024-09-21T21:20:29.166904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.166607+0000","last_change":"2024-09-21T21:20:29.169143+0000","last_active":"2024-09-21T21:20:29.166607+0000","last_peered":"2024-09-21T21:20:29.166607+0000","last_clean":"2024-09-21T21:20:29.166607+0000","last_became_active":"2024-09-21T21:20:27.191527+0000","last_became_peered":"2024-09-21T21:20:27.191527+0000","last_unstale":"2024-09-21T21:20:29.166607+0000","last_undegraded":"2024-09-21T21:20:29.166607+0000","last_fullsized":"2024-09-21T21:20:29.166607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.163238+0000","last_change":"2024-09-21T21:20:29.167100+0000","last_active":"2024-09-21T21:20:29.163238+0000","last_peered":"2024-09-21T21:20:29.163238+0000","last_clean":"2024-09-21T21:20:29.163238+0000","last_became_active":"2024-09-21T21:20:27.193527+0000","last_became_peered":"2024-09-21T21:20:27.193527+0000","last_unstale":"2024-09-21T21:20:29.163238+0000","last_undegraded":"2024-09-21T21:20:29.163238+0000","last_fullsized":"2024-09-21T21:20:29.163238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.169124+0000","last_change":"2024-09-21T21:20:29.169124+0000","last_active":"2024-09-21T21:20:29.169124+0000","last_peered":"2024-09-21T21:20:29.169124+0000","last_clean":"2024-09-21T21:20:29.169124+0000","last_became_active":"2024-09-21T21:20:27.194367+0000","last_became_peered":"2024-09-21T21:20:27.194367+0000","last_unstale":"2024-09-21T21:20:29.169124+0000","last_undegraded":"2024-09-21T21:20:29.169124+0000","last_fullsized":"2024-09-21T21:20:29.169124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.164117+0000","last_change":"2024-09-21T21:20:29.166574+0000","last_active":"2024-09-21T21:20:29.164117+0000","last_peered":"2024-09-21T21:20:29.164117+0000","last_clean":"2024-09-21T21:20:29.164117+0000","last_became_active":"2024-09-21T21:20:27.194446+0000","last_became_peered":"2024-09-21T21:20:27.194446+0000","last_unstale":"2024-09-21T21:20:29.164117+0000","last_undegraded":"2024-09-21T21:20:29.164117+0000","last_fullsized":"2024-09-21T21:20:29.164117+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.167266+0000","last_change":"2024-09-21T21:20:29.170643+0000","last_active":"2024-09-21T21:20:29.167266+0000","last_peered":"2024-09-21T21:20:29.167266+0000","last_clean":"2024-09-21T21:20:29.167266+0000","last_became_active":"2024-09-21T21:20:27.204212+0000","last_became_peered":"2024-09-21T21:20:27.204212+0000","last_unstale":"2024-09-21T21:20:29.167266+0000","last_undegraded":"2024-09-21T21:20:29.167266+0000","last_fullsized":"2024-09-21T21:20:29.167266+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.167595+0000","last_change":"2024-09-21T21:20:29.170295+0000","last_active":"2024-09-21T21:20:29.167595+0000","last_peered":"2024-09-21T21:20:29.167595+0000","last_clean":"2024-09-21T21:20:29.167595+0000","last_became_active":"2024-09-21T21:20:27.211878+0000","last_became_peered":"2024-09-21T21:20:27.211878+0000","last_unstale":"2024-09-21T21:20:29.167595+0000","last_undegraded":"2024-09-21T21:20:29.167595+0000","last_fullsized":"2024-09-21T21:20:29.167595+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":84,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-21T21:20:29.163532+0000","last_change":"2024-09-21T21:20:26.198858+0000","last_active":"2024-09-21T21:20:29.163532+0000","last_peered":"2024-09-21T21:20:29.163532+0000","last_clean":"2024-09-21T21:20:29.163532+0000","last_became_active":"2024-09-21T21:20:26.190843+0000","last_became_peered":"2024-09-21T21:20:26.190843+0000","last_unstale":"2024-09-21T21:20:29.163532+0000","last_undegraded":"2024-09-21T21:20:29.163532+0000","last_fullsized":"2024-09-21T21:20:29.163532+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_clean_scrub_stamp":"2024-09-21T21:20:25.135404+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27032,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344808,"statfs":{"total":96636764160,"available":96609083392,"internally_reserved":0,"allocated":188416,"data_stored":623815,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":33466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26956,"kb_used_data":124,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344884,"statfs":{"total":96636764160,"available":96609161216,"internally_reserved":0,"allocated":126976,"data_stored":33447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":623834,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T21:20:31.893 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T21:20:31.893 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T21:20:31.893 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-21T21:20:31.893 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-21T21:20:32.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.000+0000 7fbc188c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.005+0000 7fbc188c8640 1 Processor -- start 2024-09-21T21:20:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.005+0000 7fbc188c8640 1 -- start start 2024-09-21T21:20:32.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.006+0000 7fbc188c8640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc1409fae0 0x7fbc1406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:32.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.006+0000 7fbc188c8640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc1409f390 con 0x7fbc1406eff0 2024-09-21T21:20:32.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.006+0000 7fbc188c8640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbc140a03a0 con 0x7fbc1409fae0 2024-09-21T21:20:32.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.006+0000 7fbc1259c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbc1409fae0 0x7fbc1406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:32.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.006+0000 7fbc09d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbc1406eff0 0x7fbc14135e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42518/0 (socket says 172.21.15.5:42518) 2024-09-21T21:20:32.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.006+0000 7fbc09d9b640 1 -- 172.21.15.5:0/2371122330 learned_addr learned my addr 172.21.15.5:0/2371122330 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:20:32.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.007+0000 7fbc1259c640 1 -- 172.21.15.5:0/2371122330 >> v1:172.21.15.5:6789/0 conn(0x7fbc1406eff0 legacy=0x7fbc14135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:32.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.007+0000 7fbc1259c640 1 -- 172.21.15.5:0/2371122330 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc140a0090 con 0x7fbc1409fae0 2024-09-21T21:20:32.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.007+0000 7fbc11d9b640 1 -- 172.21.15.5:0/2371122330 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 263454666 0 0) 0x7fbc1409f390 con 0x7fbc1406eff0 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.007+0000 7fbc1259c640 1 --2- 172.21.15.5:0/2371122330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1409fae0 0x7fbc1406eab0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d263277b8de1047e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.007+0000 7fbc11d9b640 1 -- 172.21.15.5:0/2371122330 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc04009d90 con 0x7fbc1409fae0 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.007+0000 7fbc11d9b640 1 -- 172.21.15.5:0/2371122330 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbc0400e230 con 0x7fbc1409fae0 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.007+0000 7fbc11d9b640 1 -- 172.21.15.5:0/2371122330 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc0400e4d0 con 0x7fbc1409fae0 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 1 -- 172.21.15.5:0/2371122330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1409fae0 msgr2=0x7fbc1406eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 1 --2- 172.21.15.5:0/2371122330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1409fae0 0x7fbc1406eab0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 1 -- 172.21.15.5:0/2371122330 shutdown_connections 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 1 --2- 172.21.15.5:0/2371122330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1409fae0 0x7fbc1406eab0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:32.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 1 -- 172.21.15.5:0/2371122330 >> 172.21.15.5:0/2371122330 conn(0x7fbc140a76f0 msgr2=0x7fbc140a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 1 -- 172.21.15.5:0/2371122330 shutdown_connections 2024-09-21T21:20:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 1 -- 172.21.15.5:0/2371122330 wait complete. 2024-09-21T21:20:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.008+0000 7fbc188c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:20:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.010+0000 7fbc188c8640 1 Processor -- start 2024-09-21T21:20:32.011 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.010+0000 7fbc188c8640 1 -- start start 2024-09-21T21:20:32.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc188c8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1406eff0 0x7fbc14124150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:32.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc188c8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc14136c80 con 0x7fbc1406eff0 2024-09-21T21:20:32.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc1259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1406eff0 0x7fbc14124150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:32.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc1259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1406eff0 0x7fbc14124150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38924/0 (socket says 172.21.15.5:38924) 2024-09-21T21:20:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc1259c640 1 -- 172.21.15.5:0/3842724574 learned_addr learned my addr 172.21.15.5:0/3842724574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:20:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc1259c640 1 -- 172.21.15.5:0/3842724574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc14123d90 con 0x7fbc1406eff0 2024-09-21T21:20:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc1259c640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1406eff0 0x7fbc14124150 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:32.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.012+0000 7fbc0b7fe640 1 -- 172.21.15.5:0/3842724574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc04013610 con 0x7fbc1406eff0 2024-09-21T21:20:32.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.013+0000 7fbc0b7fe640 1 -- 172.21.15.5:0/3842724574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbc04013770 con 0x7fbc1406eff0 2024-09-21T21:20:32.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.013+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc141239f0 con 0x7fbc1406eff0 2024-09-21T21:20:32.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.013+0000 7fbc0b7fe640 1 -- 172.21.15.5:0/3842724574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbc04013a10 con 0x7fbc1406eff0 2024-09-21T21:20:32.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.013+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc14127430 con 0x7fbc1406eff0 2024-09-21T21:20:32.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.014+0000 7fbc0b7fe640 1 -- 172.21.15.5:0/3842724574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fbc04013bc0 con 0x7fbc1406eff0 2024-09-21T21:20:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.014+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1406eab0 con 0x7fbc1406eff0 2024-09-21T21:20:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.014+0000 7fbc0b7fe640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbbf403ead0 0x7fbbf4040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:20:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.014+0000 7fbc0b7fe640 1 -- 172.21.15.5:0/3842724574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2728+0+0 (crc 0 0 0) 0x7fbc04018040 con 0x7fbc1406eff0 2024-09-21T21:20:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.014+0000 7fbc09d9b640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbbf403ead0 0x7fbbf4040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:20:32.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.015+0000 7fbc09d9b640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbbf403ead0 0x7fbbf4040fe0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:20:32.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.019+0000 7fbc0b7fe640 1 -- 172.21.15.5:0/3842724574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fbc04011380 con 0x7fbc1406eff0 2024-09-21T21:20:32.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.251+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbc1406a8d0 con 0x7fbc1406eff0 2024-09-21T21:20:32.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.251+0000 7fbc0b7fe640 1 -- 172.21.15.5:0/3842724574 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7fbc04018bf0 con 0x7fbc1406eff0 2024-09-21T21:20:32.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:20:32.253 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T21:20:32.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbbf403ead0 msgr2=0x7fbbf4040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbbf403ead0 0x7fbbf4040fe0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1406eff0 msgr2=0x7fbc14124150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1406eff0 0x7fbc14124150 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 shutdown_connections 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbbf403ead0 0x7fbbf4040fe0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 --2- 172.21.15.5:0/3842724574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc1406eff0 0x7fbc14124150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 >> 172.21.15.5:0/3842724574 conn(0x7fbc140a76f0 msgr2=0x7fbc140a2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 shutdown_connections 2024-09-21T21:20:32.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:20:32.254+0000 7fbc188c8640 1 -- 172.21.15.5:0/3842724574 wait complete. 2024-09-21T21:20:32.266 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-21T21:20:32.267 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T21:20:32.281 INFO:tasks.workunit:Pulling workunits from ref 62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-21T21:20:32.282 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T21:20:32.282 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T21:20:32.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:20:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-21T21:20:32.298 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T21:20:32.354 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-21T21:20:32.354 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-21T21:20:32.410 INFO:tasks.workunit:timeout=3h 2024-09-21T21:20:32.410 INFO:tasks.workunit:cleanup=True 2024-09-21T21:20:32.411 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 62da54b4b83a96ca9976b7e1d0c8272a564a2208 2024-09-21T21:20:32.467 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T21:21:29.804 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 95% (12325/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '62da54b4b83a96ca9976b7e1d0c8272a564a2208'. 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-09-21T21:21:30.425 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-21T21:21:30.426 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-09-21T21:21:30.426 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-21T21:21:30.426 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-09-21T21:21:30.426 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-21T21:21:30.426 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T21:21:30.426 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-21T21:21:30.426 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 62da54b4b83 Merge pull request #59904 from mcv21/patch-2 2024-09-21T21:21:30.427 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T21:21:30.492 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T21:21:30.494 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T21:21:30.494 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T21:21:31.234 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T21:21:31.318 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T21:21:31.359 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T21:21:31.361 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T21:21:31.361 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T21:21:31.402 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T21:21:31.406 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-21T21:21:31.406 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T21:21:31.464 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-09-21T21:21:31.466 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-09-21T21:21:31.467 DEBUG:teuthology.orchestra.run.smithi005:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=62da54b4b83a96ca9976b7e1d0c8272a564a2208 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-09-21T21:21:31.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ parallel=1 2024-09-21T21:21:31.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' --crimson = --serial ']' 2024-09-21T21:21:31.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ crimson=0 2024-09-21T21:21:31.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' --crimson = --crimson ']' 2024-09-21T21:21:31.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ parallel=0 2024-09-21T21:21:31.526 INFO:tasks.workunit.client.0.smithi005.stderr:+ crimson=1 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ color= 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' -t 1 ']' 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ declare -A pids 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:21:31.527 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_aio 2024-09-21T21:21:31.544 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:21:31.544 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 42 tests from 2 test suites. 2024-09-21T21:21:31.544 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:21:31.544 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 26 tests from LibRadosAio 2024-09-21T21:21:31.544 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.TooBig 2024-09-21T21:21:33.804 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.TooBig (2260 ms) 2024-09-21T21:21:33.804 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-09-21T21:21:36.815 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.SimpleWrite (3012 ms) 2024-09-21T21:21:36.816 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-09-21T21:21:39.829 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.WaitForSafe (3013 ms) 2024-09-21T21:21:39.829 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-09-21T21:21:42.842 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTrip (3013 ms) 2024-09-21T21:21:42.842 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-09-21T21:21:45.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTrip2 (3016 ms) 2024-09-21T21:21:45.858 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-09-21T21:21:48.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTrip3 (3015 ms) 2024-09-21T21:21:48.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-09-21T21:21:51.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripAppend (3012 ms) 2024-09-21T21:21:51.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-09-21T21:21:54.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RemoveTest (3014 ms) 2024-09-21T21:21:54.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-09-21T21:21:57.912 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3014 ms) 2024-09-21T21:21:57.912 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RmXattr 2024-09-21T21:22:00.924 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RmXattr (3011 ms) 2024-09-21T21:22:00.924 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.XattrIter 2024-09-21T21:22:03.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.XattrIter (3018 ms) 2024-09-21T21:22:03.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.IsComplete 2024-09-21T21:22:06.957 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.IsComplete (3016 ms) 2024-09-21T21:22:06.957 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.IsSafe 2024-09-21T21:22:09.970 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.IsSafe (3012 ms) 2024-09-21T21:22:09.971 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-09-21T21:22:12.984 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.ReturnValue (3015 ms) 2024-09-21T21:22:12.984 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.Flush 2024-09-21T21:22:16.000 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.Flush (3015 ms) 2024-09-21T21:22:16.000 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-09-21T21:22:19.009 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.FlushAsync (3009 ms) 2024-09-21T21:22:19.009 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-09-21T21:22:22.024 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3015 ms) 2024-09-21T21:22:22.024 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-09-21T21:22:25.036 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3012 ms) 2024-09-21T21:22:25.036 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-09-21T21:22:27.792 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.SimpleStat (2757 ms) 2024-09-21T21:22:27.792 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-21T21:22:30.801 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.OperateMtime (3009 ms) 2024-09-21T21:22:30.801 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-09-21T21:22:33.821 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.Operate2Mtime (3020 ms) 2024-09-21T21:22:33.821 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-09-21T21:22:36.833 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.SimpleStatNS (3012 ms) 2024-09-21T21:22:36.833 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.StatRemove 2024-09-21T21:22:39.850 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.StatRemove (3016 ms) 2024-09-21T21:22:39.850 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-09-21T21:22:42.864 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.ExecuteClass (3014 ms) 2024-09-21T21:22:42.864 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-09-21T21:22:45.794 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.MultiWrite (2930 ms) 2024-09-21T21:22:45.794 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-09-21T21:22:48.888 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.AioUnlock (3089 ms) 2024-09-21T21:22:48.888 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 26 tests from LibRadosAio (77339 ms total) 2024-09-21T21:22:48.888 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:22:48.889 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 16 tests from LibRadosAioEC 2024-09-21T21:22:48.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-09-21T21:22:48.889 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1100: Skipped 2024-09-21T21:22:48.889 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-09-21T21:22:48.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-09-21T21:22:48.890 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1132: Skipped 2024-09-21T21:22:48.890 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.890 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-09-21T21:22:48.890 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-09-21T21:22:48.890 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1149: Skipped 2024-09-21T21:22:48.890 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.891 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-09-21T21:22:48.891 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-09-21T21:22:48.891 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1182: Skipped 2024-09-21T21:22:48.891 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.891 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-09-21T21:22:48.891 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-09-21T21:22:48.892 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1215: Skipped 2024-09-21T21:22:48.892 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.892 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-09-21T21:22:48.892 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-09-21T21:22:48.892 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1286: Skipped 2024-09-21T21:22:48.892 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.893 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-09-21T21:22:48.893 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-09-21T21:22:48.893 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1326: Skipped 2024-09-21T21:22:48.893 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.893 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-09-21T21:22:48.893 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-09-21T21:22:48.894 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1366: Skipped 2024-09-21T21:22:48.894 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.894 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-09-21T21:22:48.894 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.Flush 2024-09-21T21:22:48.894 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1385: Skipped 2024-09-21T21:22:48.894 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.894 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-09-21T21:22:48.895 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-09-21T21:22:48.895 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1415: Skipped 2024-09-21T21:22:48.895 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.895 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-09-21T21:22:48.895 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-09-21T21:22:48.895 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1454: Skipped 2024-09-21T21:22:48.896 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.896 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-09-21T21:22:48.896 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-09-21T21:22:48.896 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1498: Skipped 2024-09-21T21:22:48.896 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.896 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-09-21T21:22:48.897 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-09-21T21:22:48.897 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1532: Skipped 2024-09-21T21:22:48.897 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.897 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-09-21T21:22:48.897 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-09-21T21:22:48.897 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1593: Skipped 2024-09-21T21:22:48.897 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-09-21T21:22:48.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-09-21T21:22:48.898 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1649: Skipped 2024-09-21T21:22:48.898 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-09-21T21:22:48.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-09-21T21:22:48.899 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio.cc:1681: Skipped 2024-09-21T21:22:48.899 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:22:48.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-09-21T21:22:48.899 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-09-21T21:22:48.899 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:22:48.900 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:22:48.900 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 42 tests from 2 test suites ran. (77339 ms total) 2024-09-21T21:22:48.900 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 26 tests. 2024-09-21T21:22:48.900 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 16 tests, listed below: 2024-09-21T21:22:48.900 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-09-21T21:22:48.900 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-09-21T21:22:48.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-09-21T21:22:48.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-09-21T21:22:48.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-09-21T21:22:48.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-09-21T21:22:48.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-09-21T21:22:48.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-09-21T21:22:48.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-09-21T21:22:48.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-09-21T21:22:48.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-09-21T21:22:48.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-09-21T21:22:48.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-09-21T21:22:48.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-09-21T21:22:48.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-09-21T21:22:48.903 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-09-21T21:22:48.903 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:22:48.903 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:22:48.903 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_aio_pp 2024-09-21T21:22:48.910 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:22:48.910 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 57 tests from 4 test suites. 2024-09-21T21:22:48.910 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:22:48.910 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 32 tests from LibRadosAio 2024-09-21T21:22:48.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-09-21T21:22:51.894 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.TooBigPP (2985 ms) 2024-09-21T21:22:51.895 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-09-21T21:23:06.975 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.PoolQuotaPP (15081 ms) 2024-09-21T21:23:06.975 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-09-21T21:23:12.807 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.SimpleWritePP (5831 ms) 2024-09-21T21:23:12.807 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-09-21T21:23:15.820 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.WaitForSafePP (3014 ms) 2024-09-21T21:23:15.821 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-09-21T21:23:18.831 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripPP (3010 ms) 2024-09-21T21:23:18.831 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-09-21T21:23:21.846 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3013 ms) 2024-09-21T21:23:21.846 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-09-21T21:23:24.855 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripPP3 (3011 ms) 2024-09-21T21:23:24.855 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-09-21T21:23:27.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3015 ms) 2024-09-21T21:23:27.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-09-21T21:23:30.803 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.IsCompletePP (2934 ms) 2024-09-21T21:23:30.804 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-09-21T21:23:33.814 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.IsSafePP (3010 ms) 2024-09-21T21:23:33.814 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-09-21T21:23:36.825 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.ReturnValuePP (3012 ms) 2024-09-21T21:23:36.825 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.FlushPP 2024-09-21T21:23:39.840 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.FlushPP (3014 ms) 2024-09-21T21:23:39.840 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-09-21T21:23:42.842 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.FlushAsyncPP (3002 ms) 2024-09-21T21:23:42.842 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-09-21T21:23:45.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3015 ms) 2024-09-21T21:23:45.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-09-21T21:23:48.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3015 ms) 2024-09-21T21:23:48.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-09-21T21:23:51.880 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3008 ms) 2024-09-21T21:23:51.880 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-09-21T21:23:54.894 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (3014 ms) 2024-09-21T21:23:54.894 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-09-21T21:23:57.906 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3013 ms) 2024-09-21T21:23:57.907 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-09-21T21:24:00.812 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.SimpleStatPP (2905 ms) 2024-09-21T21:24:00.812 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-09-21T21:24:03.826 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.OperateMtime (3014 ms) 2024-09-21T21:24:03.826 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-09-21T21:24:06.839 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.OperateMtime2 (3014 ms) 2024-09-21T21:24:06.839 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-09-21T21:24:09.854 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.StatRemovePP (3014 ms) 2024-09-21T21:24:09.854 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-09-21T21:24:12.856 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.ExecuteClassPP (3002 ms) 2024-09-21T21:24:12.856 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.OmapPP 2024-09-21T21:24:15.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.OmapPP (3014 ms) 2024-09-21T21:24:15.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-09-21T21:24:18.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.MultiWritePP (3011 ms) 2024-09-21T21:24:18.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-09-21T21:24:21.892 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.AioUnlockPP (3011 ms) 2024-09-21T21:24:21.892 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-09-21T21:24:24.907 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (3016 ms) 2024-09-21T21:24:24.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-09-21T21:24:27.923 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RacingRemovePP (3015 ms) 2024-09-21T21:24:27.923 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-09-21T21:24:30.817 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (2894 ms) 2024-09-21T21:24:30.817 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-09-21T21:24:33.828 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3011 ms) 2024-09-21T21:24:33.828 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-09-21T21:24:36.336 INFO:tasks.workunit.client.0.smithi005.stdout:setting pool EIO 2024-09-21T21:24:46.022 INFO:tasks.workunit.client.0.smithi005.stdout:waiting for 898 2024-09-21T21:24:47.022 INFO:tasks.workunit.client.0.smithi005.stdout:waiting for 898 2024-09-21T21:24:48.022 INFO:tasks.workunit.client.0.smithi005.stdout:waiting for 898 2024-09-21T21:24:49.022 INFO:tasks.workunit.client.0.smithi005.stdout:max_success 102, min_failed 103 2024-09-21T21:24:49.856 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAio.PoolEIOFlag (16029 ms) 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAio.MultiReads 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:2427: Skipped 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 32 tests from LibRadosAio (120947 ms total) 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosAioPP 2024-09-21T21:24:49.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-09-21T21:24:52.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (3001 ms) 2024-09-21T21:24:52.858 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-09-21T21:25:01.828 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (8971 ms) 2024-09-21T21:25:01.829 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-09-21T21:25:16.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAioPP.RmXattrPP (15022 ms) 2024-09-21T21:25:16.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-09-21T21:25:19.863 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3012 ms) 2024-09-21T21:25:19.863 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosAioPP (30006 ms total) 2024-09-21T21:25:19.863 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:19.864 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosIoPP 2024-09-21T21:25:19.864 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-21T21:25:22.865 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.XattrListPP (3002 ms) 2024-09-21T21:25:22.865 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosIoPP (3002 ms total) 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 20 tests from LibRadosAioEC 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1384: Skipped 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1419: Skipped 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-09-21T21:25:22.866 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1436: Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1467: Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1500: Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1605: Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1637: Skipped 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1705: Skipped 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1742: Skipped 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-09-21T21:25:22.868 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1780: Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1796: Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1824: Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1859: Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1904: Skipped 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1946: Skipped 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:1977: Skipped 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-09-21T21:25:22.870 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:2008: Skipped 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:2059: Skipped 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:2089: Skipped 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-09-21T21:25:22.871 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/aio_cxx.cc:2124: Skipped 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 57 tests from 4 test suites ran. (153955 ms total) 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 36 tests. 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 21 tests, listed below: 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-09-21T21:25:22.872 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-09-21T21:25:22.873 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-09-21T21:25:22.874 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-09-21T21:25:22.874 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-09-21T21:25:22.874 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-09-21T21:25:22.874 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-09-21T21:25:22.874 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:25:22.874 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:25:22.874 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_io 2024-09-21T21:25:22.892 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:25:22.892 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 24 tests from 2 test suites. 2024-09-21T21:25:22.892 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:25:22.892 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from LibRadosIo 2024-09-21T21:25:24.875 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-09-21T21:25:25.191 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.SimpleWrite (315 ms) 2024-09-21T21:25:25.191 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.TooBig 2024-09-21T21:25:25.191 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-09-21T21:25:25.191 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-09-21T21:25:25.264 INFO:tasks.workunit.client.0.smithi005.stdout:no timeout :/ 2024-09-21T21:25:25.264 INFO:tasks.workunit.client.0.smithi005.stdout:no timeout :/ 2024-09-21T21:25:25.264 INFO:tasks.workunit.client.0.smithi005.stdout:no timeout :/ 2024-09-21T21:25:25.264 INFO:tasks.workunit.client.0.smithi005.stdout:no timeout :/ 2024-09-21T21:25:25.264 INFO:tasks.workunit.client.0.smithi005.stdout:no timeout :/ 2024-09-21T21:25:25.264 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.ReadTimeout (73 ms) 2024-09-21T21:25:25.265 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-09-21T21:25:25.305 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.RoundTrip (42 ms) 2024-09-21T21:25:25.305 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.Checksum 2024-09-21T21:25:25.323 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.Checksum (18 ms) 2024-09-21T21:25:25.323 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-09-21T21:25:25.356 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (32 ms) 2024-09-21T21:25:25.356 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-09-21T21:25:25.388 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (33 ms) 2024-09-21T21:25:25.388 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-09-21T21:25:25.421 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.AppendRoundTrip (33 ms) 2024-09-21T21:25:25.421 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-09-21T21:25:25.426 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.ZeroLenZero (5 ms) 2024-09-21T21:25:25.426 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.TruncTest 2024-09-21T21:25:25.457 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.TruncTest (30 ms) 2024-09-21T21:25:25.457 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-09-21T21:25:25.484 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.RemoveTest (28 ms) 2024-09-21T21:25:25.485 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-09-21T21:25:25.521 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (37 ms) 2024-09-21T21:25:25.521 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.RmXattr 2024-09-21T21:25:25.607 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.RmXattr (85 ms) 2024-09-21T21:25:25.607 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIo.XattrIter 2024-09-21T21:25:25.652 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIo.XattrIter (45 ms) 2024-09-21T21:25:25.879 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from LibRadosIo (776 ms total) 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 10 tests from LibRadosIoEC 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:168: Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.880 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.881 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.882 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-09-21T21:25:25.883 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:176: Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-09-21T21:25:25.884 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 24 tests from 2 test suites ran. (2987 ms total) 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 14 tests. 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 10 tests, listed below: 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-09-21T21:25:25.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-09-21T21:25:25.886 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:25:25.886 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:25:25.886 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_io_pp 2024-09-21T21:25:25.900 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:25:25.900 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 40 tests from 2 test suites. 2024-09-21T21:25:25.900 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:25:25.901 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 22 tests from LibRadosIoPP 2024-09-21T21:25:25.901 INFO:tasks.workunit.client.0.smithi005.stdout:seed 31170 2024-09-21T21:25:27.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-09-21T21:25:27.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-09-21T21:25:27.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-09-21T21:25:28.176 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (287 ms) 2024-09-21T21:25:28.176 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-09-21T21:25:28.254 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.ReadOpPP (78 ms) 2024-09-21T21:25:28.254 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-09-21T21:25:28.278 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (24 ms) 2024-09-21T21:25:28.278 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-09-21T21:25:31.123 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2845 ms) 2024-09-21T21:25:31.123 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-09-21T21:25:31.147 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.RoundTripPP (24 ms) 2024-09-21T21:25:31.147 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-09-21T21:25:31.166 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (19 ms) 2024-09-21T21:25:31.166 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-09-21T21:25:31.187 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.Checksum (20 ms) 2024-09-21T21:25:31.187 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-09-21T21:25:31.208 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (22 ms) 2024-09-21T21:25:31.209 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-09-21T21:25:31.247 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (38 ms) 2024-09-21T21:25:31.247 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-09-21T21:25:31.279 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (32 ms) 2024-09-21T21:25:31.279 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-09-21T21:25:31.298 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (20 ms) 2024-09-21T21:25:31.298 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-09-21T21:25:31.334 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (36 ms) 2024-09-21T21:25:31.334 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-09-21T21:25:31.366 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.TruncTestPP (31 ms) 2024-09-21T21:25:31.366 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-09-21T21:25:31.397 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (32 ms) 2024-09-21T21:25:31.398 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-09-21T21:25:31.432 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (35 ms) 2024-09-21T21:25:31.433 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-09-21T21:25:31.521 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.RmXattrPP (88 ms) 2024-09-21T21:25:31.521 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-09-21T21:25:31.563 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.XattrListPP (42 ms) 2024-09-21T21:25:31.563 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.CrcZeroWrite 2024-09-21T21:25:31.594 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.CrcZeroWrite (32 ms) 2024-09-21T21:25:31.594 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-09-21T21:25:31.626 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.CmpExtPP (32 ms) 2024-09-21T21:25:31.627 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-09-21T21:25:31.646 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (19 ms) 2024-09-21T21:25:31.646 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-09-21T21:25:31.674 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (29 ms) 2024-09-21T21:25:31.901 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 22 tests from LibRadosIoPP (3786 ms total) 2024-09-21T21:25:31.901 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 18 tests from LibRadosIoECPP 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.902 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.903 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-09-21T21:25:31.904 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-09-21T21:25:31.905 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.906 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.907 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.CrcZeroWrite 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite (0 ms) 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-21T21:25:31.909 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 18 tests from LibRadosIoECPP (0 ms total) 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 40 tests from 2 test suites ran. (5998 ms total) 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 22 tests. 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 18 tests, listed below: 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-09-21T21:25:31.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CrcZeroWrite 2024-09-21T21:25:31.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-09-21T21:25:31.912 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-09-21T21:25:31.912 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-09-21T21:25:31.912 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-09-21T21:25:31.912 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:25:31.912 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:25:31.912 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_asio 2024-09-21T21:25:31.943 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.941+0000 7f54be8356c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:31.953 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.952+0000 7f54be8356c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:31.954 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.952+0000 7f54be8356c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:31.954 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-21T21:25:31.954 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:25:31.954 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 12 tests from AsioRados 2024-09-21T21:25:31.958 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.954+0000 7f54be8356c0 1 Processor -- start 2024-09-21T21:25:31.962 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.959+0000 7f54be8356c0 1 -- start start 2024-09-21T21:25:31.963 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.961+0000 7f54be8356c0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x1fe9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:25:31.963 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.961+0000 7f54be8356c0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1ebe520 con 0x1f5a0e0 2024-09-21T21:25:31.963 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.962+0000 7f54b6c3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x1fe9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:25:31.964 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.962+0000 7f54b6c3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x1fe9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55226/0 (socket says 172.21.15.5:55226) 2024-09-21T21:25:31.964 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.962+0000 7f54b6c3f640 1 -- 172.21.15.5:0/399076145 learned_addr learned my addr 172.21.15.5:0/399076145 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:25:31.964 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.962+0000 7f54b6c3f640 1 -- 172.21.15.5:0/399076145 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e5ae10 con 0x1f5a0e0 2024-09-21T21:25:31.964 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.963+0000 7f54b6c3f640 1 --2- 172.21.15.5:0/399076145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x1fe9ca0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5c2654b0424a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:25:31.965 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.963+0000 7f54b543c640 1 -- 172.21.15.5:0/399076145 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54a000c5e0 con 0x1f5a0e0 2024-09-21T21:25:31.965 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.963+0000 7f54b543c640 1 -- 172.21.15.5:0/399076145 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f54a000c740 con 0x1f5a0e0 2024-09-21T21:25:31.965 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.963+0000 7f54b543c640 1 -- 172.21.15.5:0/399076145 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54a000c9e0 con 0x1f5a0e0 2024-09-21T21:25:31.971 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.968+0000 7f54be8356c0 1 -- 172.21.15.5:0/399076145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 msgr2=0x1fe9ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:25:31.971 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.968+0000 7f54be8356c0 1 --2- 172.21.15.5:0/399076145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x1fe9ca0 crc :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:31.971 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.969+0000 7f54be8356c0 1 -- 172.21.15.5:0/399076145 shutdown_connections 2024-09-21T21:25:31.971 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.969+0000 7f54be8356c0 1 --2- 172.21.15.5:0/399076145 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x1fe9ca0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:31.971 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.969+0000 7f54be8356c0 1 -- 172.21.15.5:0/399076145 >> 172.21.15.5:0/399076145 conn(0x1e7e770 msgr2=0x1ff09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:25:31.971 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.970+0000 7f54be8356c0 1 -- 172.21.15.5:0/399076145 shutdown_connections 2024-09-21T21:25:31.972 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.971+0000 7f54be8356c0 1 -- 172.21.15.5:0/399076145 wait complete. 2024-09-21T21:25:31.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.973+0000 7f54be8356c0 1 Processor -- start 2024-09-21T21:25:31.975 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.973+0000 7f54be8356c0 1 -- start start 2024-09-21T21:25:31.977 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.976+0000 7f54be8356c0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x2079a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:25:31.978 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.976+0000 7f54be8356c0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1ebc280 con 0x1f5a0e0 2024-09-21T21:25:31.978 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.976+0000 7f54b6c3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x2079a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.976+0000 7f54b6c3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x2079a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55236/0 (socket says 172.21.15.5:55236) 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.976+0000 7f54b6c3f640 1 -- 172.21.15.5:0/2840323933 learned_addr learned my addr 172.21.15.5:0/2840323933 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.976+0000 7f54b6c3f640 1 -- 172.21.15.5:0/2840323933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e4c920 con 0x1f5a0e0 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.977+0000 7f54b6c3f640 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x2079a20 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.977+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54a00137e0 con 0x1f5a0e0 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.977+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f54a0013940 con 0x1f5a0e0 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.977+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f54a0013be0 con 0x1f5a0e0 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.977+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e4c380 con 0x1f5a0e0 2024-09-21T21:25:31.979 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.977+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20802b0 con 0x1f5a0e0 2024-09-21T21:25:31.980 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.979+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f54a0010400 con 0x1f5a0e0 2024-09-21T21:25:31.981 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.979+0000 7f54af7fe640 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f549c03d3b0 0x7f549c03f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:25:31.981 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.979+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 2700+0+0 (crc 0 0 0) 0x7f54a0008040 con 0x1f5a0e0 2024-09-21T21:25:31.981 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.980+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x1eb4df0 con 0x1f5a0e0 2024-09-21T21:25:31.982 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.980+0000 7f54b643e640 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f549c03d3b0 0x7f549c03f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:25:31.982 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.980+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7f54a000f720 con 0x1f5a0e0 2024-09-21T21:25:31.982 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.980+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x1ec7bf0 con 0x1f5a0e0 2024-09-21T21:25:31.982 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:31.981+0000 7f54b643e640 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f549c03d3b0 0x7f549c03f8c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:25:32.901 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:32.899+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7f54a0013d90 con 0x1f5a0e0 2024-09-21T21:25:32.901 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:32.899+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7f549c041d30 con 0x1f5a0e0 2024-09-21T21:25:32.901 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:32.900+0000 7f54af7fe640 1 -- 172.21.15.5:0/2840323933 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(236..236 src has 1..236) ==== 651+0+0 (crc 0 0 0) 0x7f54a00030d0 con 0x1f5a0e0 2024-09-21T21:25:32.902 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:32.900+0000 7f54be8356c0 1 --2- 172.21.15.5:0/2840323933 >> v2:172.21.15.5:6804/1102615197 conn(0x1fed9b0 0x208bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:25:32.902 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:32.900+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x208c4b0 con 0x1fed9b0 2024-09-21T21:25:32.908 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:32.907+0000 7f54b7440640 1 --2- 172.21.15.5:0/2840323933 >> v2:172.21.15.5:6804/1102615197 conn(0x1fed9b0 0x208bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:25:32.919 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:32.918+0000 7f54b7440640 1 --2- 172.21.15.5:0/2840323933 >> v2:172.21.15.5:6804/1102615197 conn(0x1fed9b0 0x208bf70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:25:34.104 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.102+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.104 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-09-21T21:25:34.105 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.102+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x20766c0 con 0x1fed9b0 2024-09-21T21:25:34.105 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.102+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x2076f80 con 0x1fed9b0 2024-09-21T21:25:34.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.114+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.114+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.116 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncReadCallback (12 ms) 2024-09-21T21:25:34.116 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-09-21T21:25:34.116 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.114+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x2077360 con 0x1fed9b0 2024-09-21T21:25:34.116 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.114+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x208c810 con 0x1fed9b0 2024-09-21T21:25:34.127 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.125+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 4 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.127 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.125+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 5 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.127 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncReadFuture (11 ms) 2024-09-21T21:25:34.127 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-09-21T21:25:34.128 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.125+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x2076ab0 con 0x1fed9b0 2024-09-21T21:25:34.128 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.125+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x20cd040 con 0x1fed9b0 2024-09-21T21:25:34.137 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.135+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.137 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.136+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.137 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncReadYield (11 ms) 2024-09-21T21:25:34.138 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-09-21T21:25:34.138 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.136+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x208db80 con 0x1fed9b0 2024-09-21T21:25:34.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.161+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.163 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncWriteCallback (25 ms) 2024-09-21T21:25:34.163 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-09-21T21:25:34.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.161+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x208e130 con 0x1fed9b0 2024-09-21T21:25:34.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.180+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.181 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncWriteFuture (19 ms) 2024-09-21T21:25:34.182 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-09-21T21:25:34.182 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.180+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x20b0100 con 0x1fed9b0 2024-09-21T21:25:34.196 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.195+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.197 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncWriteYield (15 ms) 2024-09-21T21:25:34.197 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-09-21T21:25:34.197 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.195+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x208cb70 con 0x1fed9b0 2024-09-21T21:25:34.197 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.195+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x208d4d0 con 0x1fed9b0 2024-09-21T21:25:34.207 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.205+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.207 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.205+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.207 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (10 ms) 2024-09-21T21:25:34.207 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-09-21T21:25:34.208 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.205+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x208cb70 con 0x1fed9b0 2024-09-21T21:25:34.208 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.206+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x208d4d0 con 0x1fed9b0 2024-09-21T21:25:34.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.217+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 13 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.217+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 14 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.219 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (12 ms) 2024-09-21T21:25:34.219 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-09-21T21:25:34.219 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.217+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x20b0100 con 0x1fed9b0 2024-09-21T21:25:34.219 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.217+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x208d4d0 con 0x1fed9b0 2024-09-21T21:25:34.227 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.225+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 15 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.227+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 16 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.229 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncReadOperationYield (10 ms) 2024-09-21T21:25:34.229 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-09-21T21:25:34.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.227+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x208d020 con 0x1fed9b0 2024-09-21T21:25:34.248 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.246+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.248 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (19 ms) 2024-09-21T21:25:34.248 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-09-21T21:25:34.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.247+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x208d020 con 0x1fed9b0 2024-09-21T21:25:34.264 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.263+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.264 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (17 ms) 2024-09-21T21:25:34.265 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-09-21T21:25:34.265 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.263+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x208d020 con 0x1fed9b0 2024-09-21T21:25:34.282 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54b7440640 1 -- 172.21.15.5:0/2840323933 <== osd.1 v2:172.21.15.5:6804/1102615197 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54a800a430 con 0x1fed9b0 2024-09-21T21:25:34.283 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (18 ms) 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 >> v2:172.21.15.5:6804/1102615197 conn(0x1fed9b0 msgr2=0x208bf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 --2- 172.21.15.5:0/2840323933 >> v2:172.21.15.5:6804/1102615197 conn(0x1fed9b0 0x208bf70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f549c03d3b0 msgr2=0x7f549c03f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f549c03d3b0 0x7f549c03f8c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 msgr2=0x2079a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x2079a20 crc :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 shutdown_connections 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 --2- 172.21.15.5:0/2840323933 >> v2:172.21.15.5:6804/1102615197 conn(0x1fed9b0 0x208bf70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f549c03d3b0 0x7f549c03f8c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:34.284 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 --2- 172.21.15.5:0/2840323933 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f5a0e0 0x2079a20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 >> 172.21.15.5:0/2840323933 conn(0x1e7e770 msgr2=0x1fe9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 shutdown_connections 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.281+0000 7f54be8356c0 1 -- 172.21.15.5:0/2840323933 wait complete. 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 12 tests from AsioRados (179 ms total) 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 12 tests from 1 test suite ran. (2329 ms total) 2024-09-21T21:25:34.285 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 12 tests. 2024-09-21T21:25:34.286 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:25:34.286 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:25:34.286 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_list 2024-09-21T21:25:34.317 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.315+0000 7fe5b48339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:34.317 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.315+0000 7fe5b48339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:34.317 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:34.315+0000 7fe5b48339c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:34.317 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 11 tests from 3 test suites. 2024-09-21T21:25:34.317 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:25:34.317 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from LibRadosList 2024-09-21T21:25:35.917 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosList.ListObjects 2024-09-21T21:25:36.454 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosList.ListObjects (537 ms) 2024-09-21T21:25:36.454 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-09-21T21:25:36.675 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (221 ms) 2024-09-21T21:25:36.675 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-09-21T21:25:36.780 INFO:tasks.workunit.client.0.smithi005.stdout:myset foo1,foo2,foo3 2024-09-21T21:25:36.880 INFO:tasks.workunit.client.0.smithi005.stdout:foo1 2024-09-21T21:25:36.880 INFO:tasks.workunit.client.0.smithi005.stdout:foo2 2024-09-21T21:25:36.880 INFO:tasks.workunit.client.0.smithi005.stdout:foo3 2024-09-21T21:25:36.880 INFO:tasks.workunit.client.0.smithi005.stdout:myset foo1,foo4,foo5 2024-09-21T21:25:37.004 INFO:tasks.workunit.client.0.smithi005.stdout:foo4 2024-09-21T21:25:37.004 INFO:tasks.workunit.client.0.smithi005.stdout:foo5 2024-09-21T21:25:37.004 INFO:tasks.workunit.client.0.smithi005.stdout:foo1 2024-09-21T21:25:37.004 INFO:tasks.workunit.client.0.smithi005.stdout:myset foo6,foo7 2024-09-21T21:25:37.105 INFO:tasks.workunit.client.0.smithi005.stdout:foo7 2024-09-21T21:25:37.105 INFO:tasks.workunit.client.0.smithi005.stdout:foo6 2024-09-21T21:25:37.105 INFO:tasks.workunit.client.0.smithi005.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-09-21T21:25:37.205 INFO:tasks.workunit.client.0.smithi005.stdout:ns1:foo4 2024-09-21T21:25:37.205 INFO:tasks.workunit.client.0.smithi005.stdout:ns1:foo5 2024-09-21T21:25:37.205 INFO:tasks.workunit.client.0.smithi005.stdout:ns2:foo7 2024-09-21T21:25:37.205 INFO:tasks.workunit.client.0.smithi005.stdout:ns2:foo6 2024-09-21T21:25:37.205 INFO:tasks.workunit.client.0.smithi005.stdout:ns1:foo1 2024-09-21T21:25:37.205 INFO:tasks.workunit.client.0.smithi005.stdout::foo1 2024-09-21T21:25:37.206 INFO:tasks.workunit.client.0.smithi005.stdout::foo2 2024-09-21T21:25:37.206 INFO:tasks.workunit.client.0.smithi005.stdout::foo3 2024-09-21T21:25:37.402 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosList.ListObjectsNS (728 ms) 2024-09-21T21:25:37.403 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-09-21T21:25:37.719 INFO:tasks.workunit.client.0.smithi005.stdout:1 0 2024-09-21T21:25:37.719 INFO:tasks.workunit.client.0.smithi005.stdout:10 0 2024-09-21T21:25:37.719 INFO:tasks.workunit.client.0.smithi005.stdout:13 0 2024-09-21T21:25:37.719 INFO:tasks.workunit.client.0.smithi005.stdout:7 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:14 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:0 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:15 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:11 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:5 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:8 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:6 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:3 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:4 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:12 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:9 0 2024-09-21T21:25:37.720 INFO:tasks.workunit.client.0.smithi005.stdout:2 0 2024-09-21T21:25:37.822 INFO:tasks.workunit.client.0.smithi005.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-09-21T21:25:38.117 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosList.ListObjectsStart (714 ms) 2024-09-21T21:25:38.117 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-09-21T21:25:38.318 INFO:tasks.workunit.client.0.smithi005.stdout:x cursor=MIN 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-09-21T21:25:38.424 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-09-21T21:25:38.425 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-09-21T21:25:38.425 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-09-21T21:25:38.425 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-09-21T21:25:38.425 INFO:tasks.workunit.client.0.smithi005.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-09-21T21:25:38.525 INFO:tasks.workunit.client.0.smithi005.stdout:FIRST> seek to MIN oid=1 2024-09-21T21:25:38.627 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-09-21T21:25:38.627 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:02547ec2:::1:head 2024-09-21T21:25:38.733 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:02547ec2:::1:head -> 1 2024-09-21T21:25:38.733 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-09-21T21:25:38.733 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:52ea6a34:::10:head 2024-09-21T21:25:38.801 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-21T21:25:38.801 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-09-21T21:25:38.801 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:566253c9:::13:head 2024-09-21T21:25:38.870 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:566253c9:::13:head -> 13 2024-09-21T21:25:38.870 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-09-21T21:25:38.870 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-21T21:25:38.935 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-21T21:25:38.935 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-09-21T21:25:38.935 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:62a1935d:::14:head 2024-09-21T21:25:38.998 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:62a1935d:::14:head -> 14 2024-09-21T21:25:38.998 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-09-21T21:25:38.998 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:6cac518f:::0:head 2024-09-21T21:25:39.058 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:6cac518f:::0:head -> 0 2024-09-21T21:25:39.058 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-09-21T21:25:39.058 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:863748b0:::15:head 2024-09-21T21:25:39.107 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:863748b0:::15:head -> 15 2024-09-21T21:25:39.107 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-09-21T21:25:39.108 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:89d3ae78:::11:head 2024-09-21T21:25:39.155 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-21T21:25:39.155 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-09-21T21:25:39.155 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:b29083e3:::5:head 2024-09-21T21:25:39.186 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:b29083e3:::5:head -> 5 2024-09-21T21:25:39.186 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-09-21T21:25:39.186 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-21T21:25:39.224 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-21T21:25:39.224 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-09-21T21:25:39.224 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-21T21:25:39.249 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-21T21:25:39.249 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-09-21T21:25:39.249 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:cfc208b3:::3:head 2024-09-21T21:25:39.271 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-21T21:25:39.271 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-09-21T21:25:39.271 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:d83876eb:::4:head 2024-09-21T21:25:39.287 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:d83876eb:::4:head -> 4 2024-09-21T21:25:39.287 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-09-21T21:25:39.287 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-21T21:25:39.304 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-21T21:25:39.304 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-09-21T21:25:39.304 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:e960b815:::9:head 2024-09-21T21:25:39.313 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:e960b815:::9:head -> 9 2024-09-21T21:25:39.313 INFO:tasks.workunit.client.0.smithi005.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-09-21T21:25:39.314 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:f905c69b:::2:head 2024-09-21T21:25:39.316 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:f905c69b:::2:head -> 2 2024-09-21T21:25:39.317 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:52ea6a34:::10:head 2024-09-21T21:25:39.317 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-09-21T21:25:39.384 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:52ea6a34:::10:head -> 10 2024-09-21T21:25:39.385 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=10 expected=10 2024-09-21T21:25:39.385 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:d83876eb:::4:head 2024-09-21T21:25:39.385 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-09-21T21:25:39.401 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:d83876eb:::4:head -> 4 2024-09-21T21:25:39.401 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=4 expected=4 2024-09-21T21:25:39.401 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:cfc208b3:::3:head 2024-09-21T21:25:39.401 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-09-21T21:25:39.423 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:cfc208b3:::3:head -> 3 2024-09-21T21:25:39.424 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=3 expected=3 2024-09-21T21:25:39.424 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:c4fdafeb:::6:head 2024-09-21T21:25:39.424 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-09-21T21:25:39.448 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:c4fdafeb:::6:head -> 6 2024-09-21T21:25:39.448 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=6 expected=6 2024-09-21T21:25:39.448 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:e960b815:::9:head 2024-09-21T21:25:39.448 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-09-21T21:25:39.458 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:e960b815:::9:head -> 9 2024-09-21T21:25:39.458 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=9 expected=9 2024-09-21T21:25:39.458 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:de5d7c5f:::12:head 2024-09-21T21:25:39.458 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-09-21T21:25:39.475 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:de5d7c5f:::12:head -> 12 2024-09-21T21:25:39.475 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=12 expected=12 2024-09-21T21:25:39.475 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:bd63b0f1:::8:head 2024-09-21T21:25:39.475 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-09-21T21:25:39.503 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:bd63b0f1:::8:head -> 8 2024-09-21T21:25:39.503 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=8 expected=8 2024-09-21T21:25:39.503 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:f905c69b:::2:head 2024-09-21T21:25:39.503 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-09-21T21:25:39.506 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:f905c69b:::2:head -> 2 2024-09-21T21:25:39.506 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=2 expected=2 2024-09-21T21:25:39.506 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:89d3ae78:::11:head 2024-09-21T21:25:39.506 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-09-21T21:25:39.553 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:89d3ae78:::11:head -> 11 2024-09-21T21:25:39.553 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=11 expected=11 2024-09-21T21:25:39.553 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:863748b0:::15:head 2024-09-21T21:25:39.553 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-09-21T21:25:39.603 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:863748b0:::15:head -> 15 2024-09-21T21:25:39.603 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=15 expected=15 2024-09-21T21:25:39.603 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:6cac518f:::0:head 2024-09-21T21:25:39.603 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-09-21T21:25:39.662 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:6cac518f:::0:head -> 0 2024-09-21T21:25:39.663 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=0 expected=0 2024-09-21T21:25:39.663 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:62a1935d:::14:head 2024-09-21T21:25:39.663 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-09-21T21:25:39.725 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:62a1935d:::14:head -> 14 2024-09-21T21:25:39.725 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=14 expected=14 2024-09-21T21:25:39.725 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:5c6b0b28:::7:head 2024-09-21T21:25:39.725 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-09-21T21:25:39.790 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:5c6b0b28:::7:head -> 7 2024-09-21T21:25:39.790 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=7 expected=7 2024-09-21T21:25:39.790 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:b29083e3:::5:head 2024-09-21T21:25:39.790 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-09-21T21:25:39.822 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:b29083e3:::5:head -> 5 2024-09-21T21:25:39.822 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=5 expected=5 2024-09-21T21:25:39.822 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:02547ec2:::1:head 2024-09-21T21:25:39.822 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-09-21T21:25:39.922 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:02547ec2:::1:head -> 1 2024-09-21T21:25:39.922 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=1 expected=1 2024-09-21T21:25:39.923 INFO:tasks.workunit.client.0.smithi005.stdout:: seek to 76:566253c9:::13:head 2024-09-21T21:25:39.923 INFO:tasks.workunit.client.0.smithi005.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-09-21T21:25:39.992 INFO:tasks.workunit.client.0.smithi005.stdout:> 76:566253c9:::13:head -> 13 2024-09-21T21:25:39.992 INFO:tasks.workunit.client.0.smithi005.stdout:: entry=13 expected=13 2024-09-21T21:25:40.282 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosList.ListObjectsCursor (2166 ms) 2024-09-21T21:25:40.282 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-09-21T21:25:40.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosList.EnumerateObjects (598 ms) 2024-09-21T21:25:40.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-09-21T21:25:41.085 INFO:tasks.workunit.client.0.smithi005.stdout:split 0/5 -> MIN 76:33333333::::head 2024-09-21T21:25:41.108 INFO:tasks.workunit.client.0.smithi005.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-09-21T21:25:41.131 INFO:tasks.workunit.client.0.smithi005.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-09-21T21:25:41.158 INFO:tasks.workunit.client.0.smithi005.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-09-21T21:25:41.180 INFO:tasks.workunit.client.0.smithi005.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-09-21T21:25:41.499 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (619 ms) 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from LibRadosList (5583 ms total) 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosListEC 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:70: Skipped 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:84: Skipped 2024-09-21T21:25:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:96: Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:84: Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:96: Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:84: Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:96: Skipped 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:78: Skipped 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosListNP 2024-09-21T21:25:41.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-09-21T21:25:44.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosListNP.ListObjectsError (3014 ms) 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosListNP (3014 ms total) 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 11 tests from 3 test suites ran. (10624 ms total) 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 8 tests. 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 3 tests, listed below: 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-09-21T21:25:44.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-09-21T21:25:44.945 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:25:44.945 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:25:44.945 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_lock 2024-09-21T21:25:44.970 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:25:44.971 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-21T21:25:44.971 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:25:44.971 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLock 2024-09-21T21:25:46.950 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-09-21T21:25:47.300 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.LockExclusive (350 ms) 2024-09-21T21:25:47.300 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.LockShared 2024-09-21T21:25:47.328 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.LockShared (27 ms) 2024-09-21T21:25:47.328 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-09-21T21:25:48.372 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1045 ms) 2024-09-21T21:25:48.373 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-09-21T21:25:49.419 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.LockSharedDur (1047 ms) 2024-09-21T21:25:49.420 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-09-21T21:25:49.463 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.LockMayRenew (44 ms) 2024-09-21T21:25:49.463 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.Unlock 2024-09-21T21:25:49.508 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.Unlock (45 ms) 2024-09-21T21:25:49.508 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.ListLockers 2024-09-21T21:25:49.570 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.ListLockers (62 ms) 2024-09-21T21:25:49.570 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLock.BreakLock 2024-09-21T21:25:49.606 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLock.BreakLock (36 ms) 2024-09-21T21:25:49.962 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLock (2656 ms total) 2024-09-21T21:25:49.962 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:49.962 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLockEC 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:168: Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (1 ms) 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-09-21T21:25:49.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.965 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:176: Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLockEC (1 ms total) 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:49.966 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 16 tests from 2 test suites ran. (4990 ms total) 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 8 tests. 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-09-21T21:25:49.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-09-21T21:25:49.968 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:25:49.968 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:25:49.968 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_lock_pp 2024-09-21T21:25:49.989 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:25:49.989 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-21T21:25:49.989 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:25:49.989 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLockPP 2024-09-21T21:25:49.989 INFO:tasks.workunit.client.0.smithi005.stdout:seed 31285 2024-09-21T21:25:51.971 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-09-21T21:25:52.235 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (265 ms) 2024-09-21T21:25:52.235 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-09-21T21:25:52.286 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.LockSharedPP (50 ms) 2024-09-21T21:25:52.286 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-09-21T21:25:53.333 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1048 ms) 2024-09-21T21:25:53.333 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-09-21T21:25:54.375 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1042 ms) 2024-09-21T21:25:54.375 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-09-21T21:25:54.423 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (47 ms) 2024-09-21T21:25:54.423 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-09-21T21:25:54.471 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.UnlockPP (48 ms) 2024-09-21T21:25:54.471 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-09-21T21:25:54.529 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.ListLockersPP (59 ms) 2024-09-21T21:25:54.529 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-09-21T21:25:54.569 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosLockPP.BreakLockPP (39 ms) 2024-09-21T21:25:54.986 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLockPP (2598 ms total) 2024-09-21T21:25:54.986 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:54.986 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLockECPP 2024-09-21T21:25:54.986 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-09-21T21:25:54.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.988 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (0 ms) 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.989 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.990 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:25:54.991 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosLockECPP (0 ms total) 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 16 tests from 2 test suites ran. (4997 ms total) 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 8 tests. 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-09-21T21:25:54.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-09-21T21:25:54.993 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-09-21T21:25:54.993 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:25:54.993 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:25:54.993 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_misc 2024-09-21T21:25:55.032 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:55.030+0000 7f12766f26c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:55.033 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:55.030+0000 7f12766f26c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:55.033 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:55.031+0000 7f12766f26c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:25:55.033 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 12 tests from 4 test suites. 2024-09-21T21:25:55.033 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:25:55.033 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-21T21:25:55.033 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-09-21T21:25:55.034 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-09-21T21:25:55.034 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-21T21:25:55.034 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:25:55.034 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-09-21T21:25:55.034 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-09-21T21:25:55.099 INFO:tasks.workunit.client.0.smithi005.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-09-21T21:25:55.099 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:55.097+0000 7f12766f26c0 -1 failed for service _ceph-mon._tcp 2024-09-21T21:25:55.099 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:25:55.097+0000 7f12766f26c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-09-21T21:25:55.099 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (67 ms) 2024-09-21T21:25:55.099 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-09-21T21:26:00.108 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5008 ms) 2024-09-21T21:26:00.108 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (5075 ms total) 2024-09-21T21:26:00.108 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:26:00.108 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscPool 2024-09-21T21:26:00.108 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-09-21T21:26:03.001 INFO:tasks.workunit.client.0.smithi005.stdout:started 0x7f1240005d20 2024-09-21T21:26:04.002 INFO:tasks.workunit.client.0.smithi005.stdout:started 0x7f126400a1c0 2024-09-21T21:26:04.002 INFO:tasks.workunit.client.0.smithi005.stdout: started 2 aios 2024-09-21T21:26:04.002 INFO:tasks.workunit.client.0.smithi005.stdout:waiting 0x7f1240005d20 2024-09-21T21:26:04.002 INFO:tasks.workunit.client.0.smithi005.stdout:waiting 0x7f126400a1c0 2024-09-21T21:26:04.007 INFO:tasks.workunit.client.0.smithi005.stdout:done. 2024-09-21T21:26:05.838 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5731 ms) 2024-09-21T21:26:05.839 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscPool (5731 ms total) 2024-09-21T21:26:05.839 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:26:05.839 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosMisc 2024-09-21T21:26:07.837 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-09-21T21:26:07.838 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-09-21T21:26:07.838 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.Exec 2024-09-21T21:26:08.069 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.Exec (232 ms) 2024-09-21T21:26:08.069 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-09-21T21:26:08.135 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.WriteSame (66 ms) 2024-09-21T21:26:08.136 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-09-21T21:26:08.167 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.CmpExt (32 ms) 2024-09-21T21:26:08.167 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.Applications 2024-09-21T21:26:12.860 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.Applications (4692 ms) 2024-09-21T21:26:12.861 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-09-21T21:26:12.861 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-09-21T21:26:12.861 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-09-21T21:26:12.861 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-09-21T21:26:12.861 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-09-21T21:26:41.812 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMisc.ShutdownRace (28951 ms) 2024-09-21T21:26:41.858 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 8 tests from LibRadosMisc (33974 ms total) 2024-09-21T21:26:41.858 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:26:41.858 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:26:41.858 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 12 tests from 4 test suites ran. (46825 ms total) 2024-09-21T21:26:41.858 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 12 tests. 2024-09-21T21:26:41.875 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:26:41.876 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:26:41.876 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_misc_pp 2024-09-21T21:26:41.928 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 31 tests from 7 test suites. 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscVersion 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 22 tests from LibRadosMiscPP 2024-09-21T21:26:41.929 INFO:tasks.workunit.client.0.smithi005.stdout:seed 92950 2024-09-21T21:26:41.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:26:41.926+0000 7f3d6e0e8840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:26:41.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:26:41.926+0000 7f3d6e0e8840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:26:41.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:26:41.927+0000 7f3d6e0e8840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:26:43.867 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-09-21T21:26:43.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2024-09-21T21:26:43.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-09-21T21:26:44.349 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.LongNamePP (481 ms) 2024-09-21T21:26:44.349 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-09-21T21:26:44.349 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/misc_cxx.cc:53: Skipped 2024-09-21T21:26:44.350 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:26:44.350 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-09-21T21:26:44.350 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-09-21T21:26:44.413 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (64 ms) 2024-09-21T21:26:44.413 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-09-21T21:26:44.469 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (56 ms) 2024-09-21T21:26:44.469 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-09-21T21:26:44.488 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.ExecPP (18 ms) 2024-09-21T21:26:44.488 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-09-21T21:26:44.506 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (17 ms) 2024-09-21T21:26:44.506 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-09-21T21:26:44.541 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.Operate1PP (35 ms) 2024-09-21T21:26:44.541 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-09-21T21:26:44.559 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.Operate2PP (19 ms) 2024-09-21T21:26:44.559 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-09-21T21:26:44.610 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (50 ms) 2024-09-21T21:26:44.610 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-09-21T21:26:44.628 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (18 ms) 2024-09-21T21:26:44.628 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-09-21T21:26:44.656 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (28 ms) 2024-09-21T21:26:44.657 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-09-21T21:26:44.709 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (53 ms) 2024-09-21T21:26:44.709 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-09-21T21:26:44.722 INFO:tasks.workunit.client.0.smithi005.stdout:osd_max_attr_size = 0 2024-09-21T21:26:44.722 INFO:tasks.workunit.client.0.smithi005.stdout:osd_max_attr_size == 0; skipping test 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (19331 ms) 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/misc_cxx.cc:387: Skipped 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (0 ms) 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/misc_cxx.cc:550: Skipped 2024-09-21T21:27:04.041 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:04.042 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-09-21T21:27:04.042 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-09-21T21:27:04.081 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (41 ms) 2024-09-21T21:27:04.081 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-09-21T21:27:04.106 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (25 ms) 2024-09-21T21:27:04.106 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-09-21T21:27:08.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.Applications (4744 ms) 2024-09-21T21:27:08.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-09-21T21:27:08.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-09-21T21:27:08.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-09-21T21:27:08.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-09-21T21:27:08.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-09-21T21:27:08.851 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 22 tests from LibRadosMiscPP (24983 ms total) 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/misc_cxx.cc:477: Skipped 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/misc_cxx.cc:499: Skipped 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:09.857 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/misc_cxx.cc:505: Skipped 2024-09-21T21:27:09.858 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:09.858 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-09-21T21:27:09.858 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/misc_cxx.cc:492: Skipped 2024-09-21T21:27:09.858 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:09.858 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-09-21T21:27:09.858 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:09.858 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-09-21T21:27:11.866 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-09-21T21:27:12.158 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosChecksum/0.Subset (293 ms) 2024-09-21T21:27:12.184 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-09-21T21:27:12.184 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosChecksum/0.Chunked (20 ms) 2024-09-21T21:27:12.871 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosChecksum/0 (313 ms total) 2024-09-21T21:27:12.871 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:12.871 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-09-21T21:27:14.879 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-09-21T21:27:15.178 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosChecksum/1.Subset (300 ms) 2024-09-21T21:27:15.178 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-09-21T21:27:15.202 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosChecksum/1.Chunked (24 ms) 2024-09-21T21:27:15.849 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosChecksum/1 (324 ms total) 2024-09-21T21:27:15.849 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:15.849 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-09-21T21:27:17.896 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-09-21T21:27:18.198 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosChecksum/2.Subset (302 ms) 2024-09-21T21:27:18.198 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-09-21T21:27:18.224 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosChecksum/2.Chunked (26 ms) 2024-09-21T21:27:18.897 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosChecksum/2 (328 ms total) 2024-09-21T21:27:18.897 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:18.897 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscECPP 2024-09-21T21:27:18.897 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:27:18.897 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:18.897 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 31 tests from 7 test suites ran. (36968 ms total) 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 26 tests. 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 5 tests, listed below: 2024-09-21T21:27:18.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-09-21T21:27:18.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-09-21T21:27:18.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-09-21T21:27:18.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-09-21T21:27:18.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-09-21T21:27:18.900 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:27:18.900 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:27:18.900 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_tier_pp 2024-09-21T21:27:18.940 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:27:18.937+0000 7f8d29e349c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:27:18.940 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:27:18.937+0000 7f8d29e349c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:27:18.940 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:27:18.937+0000 7f8d29e349c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:27:18.940 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 77 tests from 4 test suites. 2024-09-21T21:27:18.940 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:27:18.940 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosTierPP 2024-09-21T21:27:18.940 INFO:tasks.workunit.client.0.smithi005.stdout:seed 93039 2024-09-21T21:27:20.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-09-21T21:27:20.908 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:287: Skipped 2024-09-21T21:27:20.908 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:20.908 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:2182: Skipped 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:2561: Skipped 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:20.909 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-09-21T21:27:21.913 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-09-21T21:27:21.913 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:21.913 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-09-21T21:27:23.924 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-09-21T21:27:23.924 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.924 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.925 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.926 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-09-21T21:27:23.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-21T21:27:23.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (1 ms) 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-21T21:27:23.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-21T21:27:23.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-09-21T21:27:23.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.941 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (0 ms) 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-21T21:27:23.944 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-21T21:27:23.945 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:223: Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:233: Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:23.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosTierECPP 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-09-21T21:27:24.928 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6267: Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-09-21T21:27:24.929 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.930 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.931 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (0 ms) 2024-09-21T21:27:24.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-21T21:27:24.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.936 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-09-21T21:27:24.938 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6278: Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6288: Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/tier_cxx.cc:6272: Skipped 2024-09-21T21:27:24.939 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (0 ms total) 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 77 tests from 4 test suites ran. (5986 ms total) 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 0 tests. 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 77 tests, listed below: 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-09-21T21:27:24.940 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-09-21T21:27:24.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-09-21T21:27:24.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-09-21T21:27:24.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-09-21T21:27:24.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-09-21T21:27:24.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-09-21T21:27:24.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-09-21T21:27:24.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-09-21T21:27:24.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-09-21T21:27:24.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-09-21T21:27:24.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-09-21T21:27:24.949 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:27:24.949 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:27:24.949 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_pool 2024-09-21T21:27:24.955 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:27:24.955 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-21T21:27:24.955 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:27:24.955 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 9 tests from LibRadosPools 2024-09-21T21:27:24.955 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolList 2024-09-21T21:27:27.854 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolList (2899 ms) 2024-09-21T21:27:27.854 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-09-21T21:27:30.865 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolLookup (3011 ms) 2024-09-21T21:27:30.865 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-09-21T21:27:33.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolLookup2 (3020 ms) 2024-09-21T21:27:33.885 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-09-21T21:27:36.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (2972 ms) 2024-09-21T21:27:36.857 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-09-21T21:27:39.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3054 ms) 2024-09-21T21:27:39.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-09-21T21:27:44.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolDelete (5023 ms) 2024-09-21T21:27:44.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-09-21T21:27:49.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolCreateDelete (4935 ms) 2024-09-21T21:27:49.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (5020 ms) 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/pool.cc:139: Skipped 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 9 tests from LibRadosPools (29935 ms total) 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:27:54.890 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:27:54.891 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 9 tests from 1 test suite ran. (29935 ms total) 2024-09-21T21:27:54.891 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 8 tests. 2024-09-21T21:27:54.891 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-21T21:27:54.891 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-09-21T21:27:54.893 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:27:54.893 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:27:54.893 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_snapshots 2024-09-21T21:27:54.917 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:27:54.917 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 13 tests from 4 test suites. 2024-09-21T21:27:54.917 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:27:54.917 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosSnapshots 2024-09-21T21:27:56.862 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-09-21T21:27:58.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshots.SnapList (2040 ms) 2024-09-21T21:27:58.901 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-09-21T21:28:00.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2009 ms) 2024-09-21T21:28:00.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-09-21T21:28:02.922 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshots.Rollback (2011 ms) 2024-09-21T21:28:02.922 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-09-21T21:28:04.930 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2008 ms) 2024-09-21T21:28:05.863 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosSnapshots (8069 ms total) 2024-09-21T21:28:05.864 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:28:05.864 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-09-21T21:28:07.865 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-09-21T21:28:11.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4080 ms) 2024-09-21T21:28:11.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-09-21T21:28:15.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (3990 ms) 2024-09-21T21:28:15.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-09-21T21:28:20.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5052 ms) 2024-09-21T21:28:21.931 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13122 ms total) 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:168: Skipped 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (0 ms) 2024-09-21T21:28:21.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:176: Skipped 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosSnapshotsEC (0 ms total) 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-09-21T21:28:21.934 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:168: Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:176: Skipped 2024-09-21T21:28:21.935 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 13 tests from 4 test suites ran. (27014 ms total) 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 7 tests. 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 6 tests, listed below: 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-09-21T21:28:21.936 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-09-21T21:28:21.937 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:28:21.937 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:28:21.937 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_snapshots_pp 2024-09-21T21:28:21.955 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:28:21.955 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 21 tests from 5 test suites. 2024-09-21T21:28:21.955 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:28:21.955 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-09-21T21:28:21.955 INFO:tasks.workunit.client.0.smithi005.stdout:seed 93296 2024-09-21T21:28:23.942 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-09-21T21:28:25.868 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (1928 ms) 2024-09-21T21:28:25.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-09-21T21:28:27.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2001 ms) 2024-09-21T21:28:27.869 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-09-21T21:28:29.879 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2009 ms) 2024-09-21T21:28:29.879 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-09-21T21:28:31.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2010 ms) 2024-09-21T21:28:31.889 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-09-21T21:28:35.871 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3982 ms) 2024-09-21T21:28:36.872 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from LibRadosSnapshotsPP (11930 ms total) 2024-09-21T21:28:36.872 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:28:36.873 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-09-21T21:28:38.915 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-09-21T21:28:42.998 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4083 ms) 2024-09-21T21:28:42.998 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-09-21T21:28:46.874 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3876 ms) 2024-09-21T21:28:46.874 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-09-21T21:28:52.969 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6094 ms) 2024-09-21T21:28:52.969 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-09-21T21:28:56.876 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3907 ms) 2024-09-21T21:28:56.876 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-09-21T21:28:58.949 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2073 ms) 2024-09-21T21:28:58.950 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-21T21:28:58.950 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/snapshots_cxx.cc:460: Skipped 2024-09-21T21:28:58.950 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:28:58.950 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (1 ms) 2024-09-21T21:28:58.950 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-09-21T21:29:00.888 INFO:tasks.workunit.client.0.smithi005.stdout:deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi005-93296-7 2024-09-21T21:29:01.897 INFO:tasks.workunit.client.0.smithi005.stdout:waiting for snaps to purge 2024-09-21T21:29:16.919 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17969 ms) 2024-09-21T21:29:17.911 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38004 ms total) 2024-09-21T21:29:17.911 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:17.911 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-09-21T21:29:17.911 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-09-21T21:29:17.919 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (9 ms) 2024-09-21T21:29:17.920 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-09-21T21:29:22.981 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5060 ms) 2024-09-21T21:29:22.981 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5069 ms total) 2024-09-21T21:29:22.981 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:22.981 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-09-21T21:29:22.981 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:29:22.981 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.982 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:22.983 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-21T21:29:22.984 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.985 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 21 tests from 5 test suites ran. (61025 ms total) 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 13 tests. 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 8 tests, listed below: 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-09-21T21:29:22.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-09-21T21:29:22.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-09-21T21:29:22.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-09-21T21:29:22.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-09-21T21:29:22.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-09-21T21:29:22.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-09-21T21:29:22.987 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:29:22.987 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:29:22.988 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_stat 2024-09-21T21:29:23.011 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:29:23.012 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-21T21:29:23.012 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:29:23.012 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from LibRadosStat 2024-09-21T21:29:24.945 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStat.Stat 2024-09-21T21:29:25.241 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStat.Stat (296 ms) 2024-09-21T21:29:25.241 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStat.Stat2 2024-09-21T21:29:25.280 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStat.Stat2 (39 ms) 2024-09-21T21:29:25.280 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStat.StatNS 2024-09-21T21:29:25.351 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStat.StatNS (71 ms) 2024-09-21T21:29:25.351 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-09-21T21:29:25.351 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-09-21T21:29:25.351 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStat.PoolStat 2024-09-21T21:29:25.366 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStat.PoolStat (16 ms) 2024-09-21T21:29:25.950 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from LibRadosStat (422 ms total) 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosStatEC 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:168: Skipped 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatEC.Stat 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-09-21T21:29:25.951 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-09-21T21:29:25.952 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:176: Skipped 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 9 tests from 2 test suites ran. (2938 ms total) 2024-09-21T21:29:25.953 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 5 tests. 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:29:25.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_stat_pp 2024-09-21T21:29:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:29:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 9 tests from 2 test suites. 2024-09-21T21:29:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:29:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from LibRadosStatPP 2024-09-21T21:29:25.975 INFO:tasks.workunit.client.0.smithi005.stdout:seed 93430 2024-09-21T21:29:27.958 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-09-21T21:29:28.295 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStatPP.StatPP (337 ms) 2024-09-21T21:29:28.295 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-09-21T21:29:28.326 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (31 ms) 2024-09-21T21:29:28.326 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-09-21T21:29:28.326 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-09-21T21:29:28.326 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-09-21T21:29:28.339 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStatPP.PoolStatPP (14 ms) 2024-09-21T21:29:28.339 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-09-21T21:29:28.399 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosStatPP.StatPPNS (59 ms) 2024-09-21T21:29:28.961 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from LibRadosStatPP (441 ms total) 2024-09-21T21:29:28.961 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:28.961 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosStatECPP 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:28.962 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:28.963 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 9 tests from 2 test suites ran. (2986 ms total) 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 5 tests. 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 4 tests, listed below: 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-09-21T21:29:28.964 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-09-21T21:29:28.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:29:28.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:29:28.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_watch_notify 2024-09-21T21:29:28.987 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:29:28.988 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-21T21:29:28.988 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:29:28.988 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-09-21T21:29:30.881 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-09-21T21:29:31.219 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify_test_cb 2024-09-21T21:29:31.244 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (363 ms) 2024-09-21T21:29:31.244 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-09-21T21:29:31.291 INFO:tasks.workunit.client.0.smithi005.stdout:waiting up to 300 for disconnect notification ... 2024-09-21T21:29:34.037 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_errcb cookie 17384848 err -107 2024-09-21T21:29:34.300 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3055 ms) 2024-09-21T21:29:34.300 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-09-21T21:29:34.340 INFO:tasks.workunit.client.0.smithi005.stdout:waiting up to 300 for disconnect notification ... 2024-09-21T21:29:39.038 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_errcb cookie 17386992 err -107 2024-09-21T21:29:39.348 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5048 ms) 2024-09-21T21:29:39.348 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-09-21T21:29:39.380 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787585 cookie 17400656 2024-09-21T21:29:39.402 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (54 ms) 2024-09-21T21:29:39.402 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-09-21T21:29:39.436 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787584 cookie 17400656 2024-09-21T21:29:39.462 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (60 ms) 2024-09-21T21:29:39.462 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-09-21T21:29:39.492 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787586 cookie 17400656 2024-09-21T21:29:39.514 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.AioNotify (52 ms) 2024-09-21T21:29:39.514 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-09-21T21:29:39.558 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787587 cookie 17400656 2024-09-21T21:29:39.558 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787587 cookie 17427584 2024-09-21T21:29:39.588 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (75 ms) 2024-09-21T21:29:39.589 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-09-21T21:29:39.619 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787585 cookie 17400656 2024-09-21T21:29:42.619 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787586 cookie 17400656 2024-09-21T21:29:42.645 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3056 ms) 2024-09-21T21:29:42.645 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-09-21T21:29:42.675 INFO:tasks.workunit.client.0.smithi005.stdout:waiting up to 1024 for osd to time us out ... 2024-09-21T21:29:46.688 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_errcb cookie 17400656 err -107 2024-09-21T21:29:47.708 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_cb from 15453 notify_id 1735166787585 cookie 17400656 2024-09-21T21:29:47.726 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5082 ms) 2024-09-21T21:29:47.726 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-09-21T21:29:47.766 INFO:tasks.workunit.client.0.smithi005.stdout:waiting up to 30 for disconnect notification ... 2024-09-21T21:29:49.040 INFO:tasks.workunit.client.0.smithi005.stdout:watch_notify2_test_errcb cookie 17429888 err -107 2024-09-21T21:29:49.776 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2050 ms) 2024-09-21T21:29:49.897 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 10 tests from LibRadosWatchNotify (18895 ms total) 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:168: Skipped 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:182: Skipped 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:196: Skipped 2024-09-21T21:29:49.898 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/TestCase.cc:176: Skipped 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 11 tests from 2 test suites ran. (20910 ms total) 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 10 tests. 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 1 test, listed below: 2024-09-21T21:29:49.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-09-21T21:29:49.900 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:29:49.900 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:29:49.900 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 16 tests from 2 test suites. 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:375: Skipped 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:49.925 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:389: Skipped 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:402: Skipped 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-09-21T21:29:49.926 INFO:tasks.workunit.client.0.smithi005.stdout:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-5092-g62da54b4/rpm/el9/BUILD/ceph-19.3.0-5092-g62da54b4/src/test/librados/testcase_cxx.cc:383: Skipped 2024-09-21T21:29:49.927 INFO:tasks.workunit.client.0.smithi005.stdout:Not supported by crimson yet. Skipped 2024-09-21T21:29:49.927 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-09-21T21:29:49.927 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:29:49.927 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-09-21T21:29:51.888 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-09-21T21:29:52.143 INFO:tasks.workunit.client.0.smithi005.stdout:notify 2024-09-21T21:29:52.163 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (275 ms) 2024-09-21T21:29:52.163 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-09-21T21:29:52.252 INFO:tasks.workunit.client.0.smithi005.stdout:notify 2024-09-21T21:29:52.268 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (106 ms) 2024-09-21T21:29:52.269 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-09-21T21:29:52.308 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (39 ms) 2024-09-21T21:29:52.308 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-09-21T21:29:52.346 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (38 ms) 2024-09-21T21:29:52.346 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-09-21T21:29:52.380 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26418224 notify_id 1748051689475 notifier_gid 15456 2024-09-21T21:29:52.396 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (50 ms) 2024-09-21T21:29:52.396 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-09-21T21:29:52.430 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26416720 notify_id 1748051689477 notifier_gid 15456 2024-09-21T21:29:52.446 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (50 ms) 2024-09-21T21:29:52.446 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-09-21T21:29:52.479 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26419152 notify_id 1748051689476 notifier_gid 15456 2024-09-21T21:29:52.495 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (49 ms) 2024-09-21T21:29:52.495 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-09-21T21:29:52.530 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26419072 notify_id 1748051689478 notifier_gid 15456 2024-09-21T21:29:52.546 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (51 ms) 2024-09-21T21:29:52.546 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-09-21T21:29:52.582 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26419072 notify_id 1748051689479 notifier_gid 15456 2024-09-21T21:29:52.599 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (53 ms) 2024-09-21T21:29:52.599 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-09-21T21:29:52.632 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26419072 notify_id 1748051689480 notifier_gid 15456 2024-09-21T21:29:52.648 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (49 ms) 2024-09-21T21:29:52.648 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-09-21T21:29:52.684 INFO:tasks.workunit.client.0.smithi005.stdout: trying... 2024-09-21T21:29:52.687 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26415856 notify_id 1748051689475 notifier_gid 15456 2024-09-21T21:29:53.687 INFO:tasks.workunit.client.0.smithi005.stdout: timed out 2024-09-21T21:29:53.702 INFO:tasks.workunit.client.0.smithi005.stdout: flushing 2024-09-21T21:29:55.688 INFO:tasks.workunit.client.0.smithi005.stdout: flushed 2024-09-21T21:29:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3040 ms) 2024-09-21T21:29:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-09-21T21:29:55.731 INFO:tasks.workunit.client.0.smithi005.stdout: trying... 2024-09-21T21:29:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26436080 notify_id 1748051689477 notifier_gid 15456 2024-09-21T21:29:56.732 INFO:tasks.workunit.client.0.smithi005.stdout: timed out 2024-09-21T21:29:56.749 INFO:tasks.workunit.client.0.smithi005.stdout: flushing 2024-09-21T21:29:58.736 INFO:tasks.workunit.client.0.smithi005.stdout: flushed 2024-09-21T21:29:58.736 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3048 ms) 2024-09-21T21:29:58.736 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-09-21T21:29:58.777 INFO:tasks.workunit.client.0.smithi005.stdout:List watches 2024-09-21T21:29:58.777 INFO:tasks.workunit.client.0.smithi005.stdout:notify2 2024-09-21T21:29:58.781 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26436080 notify_id 1748051689476 notifier_gid 15456 2024-09-21T21:30:01.787 INFO:tasks.workunit.client.0.smithi005.stdout:notify2 done 2024-09-21T21:30:01.787 INFO:tasks.workunit.client.0.smithi005.stdout:watch_check 2024-09-21T21:30:01.787 INFO:tasks.workunit.client.0.smithi005.stdout:unwatch2 2024-09-21T21:30:01.803 INFO:tasks.workunit.client.0.smithi005.stdout: flushing 2024-09-21T21:30:01.804 INFO:tasks.workunit.client.0.smithi005.stdout:done 2024-09-21T21:30:01.804 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3068 ms) 2024-09-21T21:30:01.804 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-09-21T21:30:01.840 INFO:tasks.workunit.client.0.smithi005.stdout:List watches 2024-09-21T21:30:01.840 INFO:tasks.workunit.client.0.smithi005.stdout:notify2 2024-09-21T21:30:01.844 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 26436080 notify_id 1752346656774 notifier_gid 15456 2024-09-21T21:30:04.850 INFO:tasks.workunit.client.0.smithi005.stdout:notify2 done 2024-09-21T21:30:04.850 INFO:tasks.workunit.client.0.smithi005.stdout:watch_check 2024-09-21T21:30:04.851 INFO:tasks.workunit.client.0.smithi005.stdout:unwatch2 2024-09-21T21:30:04.865 INFO:tasks.workunit.client.0.smithi005.stdout: flushing 2024-09-21T21:30:04.865 INFO:tasks.workunit.client.0.smithi005.stdout:done 2024-09-21T21:30:04.865 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3061 ms) 2024-09-21T21:30:04.915 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12977 ms total) 2024-09-21T21:30:04.916 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:04.916 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:30:04.916 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 16 tests from 2 test suites ran. (14991 ms total) 2024-09-21T21:30:04.916 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 14 tests. 2024-09-21T21:30:04.916 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] 2 tests, listed below: 2024-09-21T21:30:04.916 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-09-21T21:30:04.916 INFO:tasks.workunit.client.0.smithi005.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-09-21T21:30:04.918 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:30:04.918 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:30:04.918 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_cmd 2024-09-21T21:30:04.941 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:30:04.941 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-21T21:30:04.941 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:30:04.941 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosCmd 2024-09-21T21:30:04.941 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-09-21T21:30:05.011 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCmd.MonDescribe (70 ms) 2024-09-21T21:30:05.012 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-09-21T21:30:05.097 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCmd.OSDCmd (86 ms) 2024-09-21T21:30:05.097 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-09-21T21:30:07.922 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCmd.PGCmd (2825 ms) 2024-09-21T21:30:07.922 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-09-21T21:30:07.958 INFO:tasks.workunit.client.0.smithi005.stdout:got: 2024-09-21T21:30:06.886949+0000 mon.a [INF] from='client.? 172.21.15.5:0/3965258360' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi005-93488-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-09-21T21:30:08.919 INFO:tasks.workunit.client.0.smithi005.stdout:got: 2024-09-21T21:30:07.955860+0000 client.admin [INF] onexx 2024-09-21T21:30:08.919 INFO:tasks.workunit.client.0.smithi005.stdout:got: 2024-09-21T21:30:07.956339+0000 mon.a [INF] from='client.? 172.21.15.5:0/1251791801' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2024-09-21T21:30:12.924 INFO:tasks.workunit.client.0.smithi005.stdout:got: 2024-09-21T21:30:10.922647+0000 mon.a [INF] from='client.? 172.21.15.5:0/1251791801' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-09-21T21:30:12.928 INFO:tasks.workunit.client.0.smithi005.stdout:got: 2024-09-21T21:30:12.923424+0000 client.admin [INF] threexx 2024-09-21T21:30:12.928 INFO:tasks.workunit.client.0.smithi005.stdout:got: 2024-09-21T21:30:12.923706+0000 mon.a [INF] from='client.? 172.21.15.5:0/1251791801' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2024-09-21T21:30:16.934 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCmd.WatchLog (9013 ms) 2024-09-21T21:30:16.934 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosCmd (11994 ms total) 2024-09-21T21:30:16.935 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:16.935 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:30:16.935 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 4 tests from 1 test suite ran. (11994 ms total) 2024-09-21T21:30:16.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 4 tests. 2024-09-21T21:30:16.937 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:30:16.937 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:30:16.937 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_cmd_pp 2024-09-21T21:30:16.961 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:30:16.961 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-21T21:30:16.961 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:30:16.962 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosCmd 2024-09-21T21:30:16.962 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-09-21T21:30:16.999 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCmd.MonDescribePP (37 ms) 2024-09-21T21:30:17.000 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-09-21T21:30:17.036 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCmd.OSDCmdPP (37 ms) 2024-09-21T21:30:17.036 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-09-21T21:30:19.956 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCmd.PGCmdPP (2920 ms) 2024-09-21T21:30:19.956 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from LibRadosCmd (2994 ms total) 2024-09-21T21:30:19.956 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:19.956 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:30:19.956 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 3 tests from 1 test suite ran. (2994 ms total) 2024-09-21T21:30:19.957 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 3 tests. 2024-09-21T21:30:19.959 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:30:19.959 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:30:19.959 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_service 2024-09-21T21:30:20.000 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:30:19.998+0000 7fde0562f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:30:20.000 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:30:19.998+0000 7fde0562f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:30:20.000 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:30:19.998+0000 7fde0562f840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:30:20.001 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-21T21:30:20.001 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:30:20.001 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosService 2024-09-21T21:30:20.001 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-09-21T21:30:25.056 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosService.RegisterEarly (5055 ms) 2024-09-21T21:30:25.056 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosService.RegisterLate 2024-09-21T21:30:25.087 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosService.RegisterLate (31 ms) 2024-09-21T21:30:25.087 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosService.StatusFormat 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: cluster: 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: id: ad0a953a-14f9-495f-aee8-909b91df1365 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: health: HEALTH_WARN 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: 1 pool(s) do not have an application enabled 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: services: 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: mgr: x(active, since 10m) 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-21T21:30:25.256 INFO:tasks.workunit.client.0.smithi005.stdout: laundry: 1 daemon active (1 hosts) 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: data: 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: pools: 3 pools, 41 pgs 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: objects: 5 objects, 577 KiB 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: usage: 213 MiB used, 360 GiB / 360 GiB avail 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: pgs: 41 active+clean 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:25.257 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: cluster: 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: id: ad0a953a-14f9-495f-aee8-909b91df1365 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: health: HEALTH_WARN 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: 1 pool(s) do not have an application enabled 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: services: 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: mgr: x(active, since 10m) 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: foo: 4 portals active (1 hosts, 2 zones) 2024-09-21T21:30:27.286 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:27.287 INFO:tasks.workunit.client.0.smithi005.stdout: data: 2024-09-21T21:30:27.287 INFO:tasks.workunit.client.0.smithi005.stdout: pools: 3 pools, 41 pgs 2024-09-21T21:30:27.287 INFO:tasks.workunit.client.0.smithi005.stdout: objects: 5 objects, 577 KiB 2024-09-21T21:30:27.287 INFO:tasks.workunit.client.0.smithi005.stdout: usage: 213 MiB used, 360 GiB / 360 GiB avail 2024-09-21T21:30:27.287 INFO:tasks.workunit.client.0.smithi005.stdout: pgs: 41 active+clean 2024-09-21T21:30:27.287 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:27.287 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:29.317 INFO:tasks.workunit.client.0.smithi005.stdout: cluster: 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: id: ad0a953a-14f9-495f-aee8-909b91df1365 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: health: HEALTH_WARN 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: 1 pool(s) do not have an application enabled 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: services: 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: mon: 1 daemons, quorum a (age 10m) 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: mgr: x(active, since 10m) 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: data: 2024-09-21T21:30:29.318 INFO:tasks.workunit.client.0.smithi005.stdout: pools: 3 pools, 41 pgs 2024-09-21T21:30:29.319 INFO:tasks.workunit.client.0.smithi005.stdout: objects: 5 objects, 577 KiB 2024-09-21T21:30:29.319 INFO:tasks.workunit.client.0.smithi005.stdout: usage: 213 MiB used, 360 GiB / 360 GiB avail 2024-09-21T21:30:29.319 INFO:tasks.workunit.client.0.smithi005.stdout: pgs: 41 active+clean 2024-09-21T21:30:29.319 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:29.319 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:29.345 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosService.StatusFormat (4258 ms) 2024-09-21T21:30:29.345 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosService.Status 2024-09-21T21:30:49.376 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosService.Status (20031 ms) 2024-09-21T21:30:49.376 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosService (29375 ms total) 2024-09-21T21:30:49.376 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:30:49.376 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:30:49.376 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 4 tests from 1 test suite ran. (29376 ms total) 2024-09-21T21:30:49.377 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 4 tests. 2024-09-21T21:30:49.382 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:30:49.382 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:30:49.382 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_service_pp 2024-09-21T21:30:49.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:30:49.419+0000 7f6fc8731840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:30:49.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:30:49.419+0000 7f6fc8731840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:30:49.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:30:49.419+0000 7f6fc8731840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:30:49.421 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-21T21:30:49.421 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:30:49.421 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosServicePP 2024-09-21T21:30:49.421 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-09-21T21:30:54.452 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5031 ms) 2024-09-21T21:30:54.452 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-09-21T21:30:54.499 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosServicePP.RegisterLate (47 ms) 2024-09-21T21:30:54.499 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosServicePP.Status 2024-09-21T21:31:14.530 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosServicePP.Status (20030 ms) 2024-09-21T21:31:14.530 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosServicePP.Close 2024-09-21T21:31:14.530 INFO:tasks.workunit.client.0.smithi005.stdout:attempt 0 of 20 2024-09-21T21:31:19.593 INFO:tasks.workunit.client.0.smithi005.stdout: failed to deregister: 2024-09-21T21:31:19.593 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-21T21:31:19.594 INFO:tasks.workunit.client.0.smithi005.stdout: "epoch": 9, 2024-09-21T21:31:19.594 INFO:tasks.workunit.client.0.smithi005.stdout: "modified": "2024-09-21T21:31:15.223090+0000", 2024-09-21T21:31:19.594 INFO:tasks.workunit.client.0.smithi005.stdout: "services": { 2024-09-21T21:31:19.594 INFO:tasks.workunit.client.0.smithi005.stdout: "laundry": { 2024-09-21T21:31:19.594 INFO:tasks.workunit.client.0.smithi005.stdout: "daemons": { 2024-09-21T21:31:19.595 INFO:tasks.workunit.client.0.smithi005.stdout: "summary": "", 2024-09-21T21:31:19.595 INFO:tasks.workunit.client.0.smithi005.stdout: "close-test-pid93957": { 2024-09-21T21:31:19.595 INFO:tasks.workunit.client.0.smithi005.stdout: "start_epoch": 9, 2024-09-21T21:31:19.595 INFO:tasks.workunit.client.0.smithi005.stdout: "start_stamp": "2024-09-21T21:31:14.560652+0000", 2024-09-21T21:31:19.595 INFO:tasks.workunit.client.0.smithi005.stdout: "gid": 15548, 2024-09-21T21:31:19.595 INFO:tasks.workunit.client.0.smithi005.stdout: "addr": "172.21.15.5:0/1887970423", 2024-09-21T21:31:19.596 INFO:tasks.workunit.client.0.smithi005.stdout: "metadata": { 2024-09-21T21:31:19.596 INFO:tasks.workunit.client.0.smithi005.stdout: "arch": "x86_64", 2024-09-21T21:31:19.596 INFO:tasks.workunit.client.0.smithi005.stdout: "ceph_release": "squid", 2024-09-21T21:31:19.596 INFO:tasks.workunit.client.0.smithi005.stdout: "ceph_version": "ceph version 19.3.0-5092-g62da54b4 (62da54b4b83a96ca9976b7e1d0c8272a564a2208) squid (dev)", 2024-09-21T21:31:19.596 INFO:tasks.workunit.client.0.smithi005.stdout: "ceph_version_short": "19.3.0-5092-g62da54b4", 2024-09-21T21:31:19.596 INFO:tasks.workunit.client.0.smithi005.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-09-21T21:31:19.596 INFO:tasks.workunit.client.0.smithi005.stdout: "distro": "centos", 2024-09-21T21:31:19.597 INFO:tasks.workunit.client.0.smithi005.stdout: "distro_description": "CentOS Stream 9", 2024-09-21T21:31:19.597 INFO:tasks.workunit.client.0.smithi005.stdout: "distro_version": "9", 2024-09-21T21:31:19.597 INFO:tasks.workunit.client.0.smithi005.stdout: "foo": "bar", 2024-09-21T21:31:19.598 INFO:tasks.workunit.client.0.smithi005.stdout: "hostname": "smithi005", 2024-09-21T21:31:19.598 INFO:tasks.workunit.client.0.smithi005.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Sep 12 15:49:37 UTC 2024", 2024-09-21T21:31:19.598 INFO:tasks.workunit.client.0.smithi005.stdout: "kernel_version": "5.14.0-508.el9.x86_64", 2024-09-21T21:31:19.598 INFO:tasks.workunit.client.0.smithi005.stdout: "mem_swap_kb": "0", 2024-09-21T21:31:19.599 INFO:tasks.workunit.client.0.smithi005.stdout: "mem_total_kb": "32493492", 2024-09-21T21:31:19.599 INFO:tasks.workunit.client.0.smithi005.stdout: "os": "Linux", 2024-09-21T21:31:19.599 INFO:tasks.workunit.client.0.smithi005.stdout: "this": "that" 2024-09-21T21:31:19.599 INFO:tasks.workunit.client.0.smithi005.stdout: }, 2024-09-21T21:31:19.599 INFO:tasks.workunit.client.0.smithi005.stdout: "task_status": {} 2024-09-21T21:31:19.599 INFO:tasks.workunit.client.0.smithi005.stdout: } 2024-09-21T21:31:19.599 INFO:tasks.workunit.client.0.smithi005.stdout: } 2024-09-21T21:31:19.600 INFO:tasks.workunit.client.0.smithi005.stdout: } 2024-09-21T21:31:19.600 INFO:tasks.workunit.client.0.smithi005.stdout: } 2024-09-21T21:31:19.600 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-21T21:31:19.600 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:31:19.600 INFO:tasks.workunit.client.0.smithi005.stdout:attempt 1 of 20 2024-09-21T21:31:24.655 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosServicePP.Close (10125 ms) 2024-09-21T21:31:24.655 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 4 tests from LibRadosServicePP (35234 ms total) 2024-09-21T21:31:24.655 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:31:24.655 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:31:24.655 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 4 tests from 1 test suite ran. (35234 ms total) 2024-09-21T21:31:24.655 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 4 tests. 2024-09-21T21:31:24.657 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:31:24.657 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:31:24.657 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_c_write_operations 2024-09-21T21:31:24.679 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 8 tests from 2 test suites. 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibradosCWriteOps 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-09-21T21:31:24.680 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-09-21T21:31:27.025 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCWriteOps.assertExists (2345 ms) 2024-09-21T21:31:27.025 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-09-21T21:31:30.042 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3017 ms) 2024-09-21T21:31:30.042 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-09-21T21:31:33.053 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3011 ms) 2024-09-21T21:31:33.053 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-09-21T21:31:35.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCWriteOps.Write (2857 ms) 2024-09-21T21:31:35.910 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-09-21T21:31:38.914 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCWriteOps.Exec (3004 ms) 2024-09-21T21:31:38.915 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-09-21T21:31:41.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3019 ms) 2024-09-21T21:31:41.933 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-09-21T21:31:52.954 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] LibRadosCWriteOps.CmpExt (11020 ms) 2024-09-21T21:31:52.955 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from LibRadosCWriteOps (28274 ms total) 2024-09-21T21:31:52.955 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:31:52.955 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:31:52.955 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 8 tests from 2 test suites ran. (28274 ms total) 2024-09-21T21:31:52.955 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 8 tests. 2024-09-21T21:31:52.957 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:31:52.957 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:31:52.957 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_api_c_read_operations 2024-09-21T21:31:52.979 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:31:52.980 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 17 tests from 1 test suite. 2024-09-21T21:31:52.980 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:31:52.980 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 17 tests from CReadOpsTest 2024-09-21T21:31:54.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-09-21T21:31:54.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-09-21T21:31:54.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-09-21T21:31:55.285 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.SetOpFlags (317 ms) 2024-09-21T21:31:55.285 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-09-21T21:31:55.325 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.AssertExists (41 ms) 2024-09-21T21:31:55.326 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-09-21T21:31:55.380 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.AssertVersion (54 ms) 2024-09-21T21:31:55.380 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-09-21T21:31:55.574 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.CmpXattr (195 ms) 2024-09-21T21:31:55.575 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.Read 2024-09-21T21:31:55.621 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.Read (47 ms) 2024-09-21T21:31:55.622 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.Checksum 2024-09-21T21:31:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.Checksum (44 ms) 2024-09-21T21:31:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-09-21T21:31:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.RWOrderedRead (32 ms) 2024-09-21T21:31:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-09-21T21:31:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.ShortRead (48 ms) 2024-09-21T21:31:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.Exec 2024-09-21T21:31:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.Exec (29 ms) 2024-09-21T21:31:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-09-21T21:31:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.ExecUserBuf (45 ms) 2024-09-21T21:31:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.Stat 2024-09-21T21:31:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.Stat (39 ms) 2024-09-21T21:31:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.Stat2 2024-09-21T21:31:55.899 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.Stat2 (40 ms) 2024-09-21T21:31:55.900 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.Omap 2024-09-21T21:31:56.050 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.Omap (150 ms) 2024-09-21T21:31:56.050 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-09-21T21:31:56.152 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.OmapNuls (102 ms) 2024-09-21T21:31:56.152 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-09-21T21:31:56.238 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.GetXattrs (86 ms) 2024-09-21T21:31:56.238 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-09-21T21:31:56.275 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] CReadOpsTest.CmpExt (38 ms) 2024-09-21T21:31:56.976 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 17 tests from CReadOpsTest (1309 ms total) 2024-09-21T21:31:56.976 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:31:56.977 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:31:56.977 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 17 tests from 1 test suite ran. (3997 ms total) 2024-09-21T21:31:56.977 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 17 tests. 2024-09-21T21:31:56.979 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:31:56.980 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:31:56.980 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_list_parallel 2024-09-21T21:31:59.989 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94213]: starting. 2024-09-21T21:31:59.989 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94213]: creating pool ceph_test_rados_list_parallel.smithi005-94212 2024-09-21T21:31:59.990 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94213]: created object 0... 2024-09-21T21:31:59.990 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94213]: created object 25... 2024-09-21T21:31:59.990 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94213]: created object 49... 2024-09-21T21:31:59.990 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94213]: finishing. 2024-09-21T21:31:59.990 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94213]: shutting down. 2024-09-21T21:32:00.142 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94214]: starting. 2024-09-21T21:32:00.142 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94214]: listing objects. 2024-09-21T21:32:00.142 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94214]: listed object 0... 2024-09-21T21:32:00.142 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94214]: listed object 25... 2024-09-21T21:32:00.142 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94214]: saw 50 objects 2024-09-21T21:32:00.142 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94214]: shutting down. 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94249]: starting. 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94249]: creating pool ceph_test_rados_list_parallel.smithi005-94212 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94249]: created object 0... 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94249]: created object 25... 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94249]: created object 49... 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94249]: finishing. 2024-09-21T21:32:00.825 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94249]: shutting down. 2024-09-21T21:32:01.152 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:01.152 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94250]: starting. 2024-09-21T21:32:01.152 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94250]: listing objects. 2024-09-21T21:32:01.152 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94250]: listed object 0... 2024-09-21T21:32:01.153 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94250]: listed object 25... 2024-09-21T21:32:01.153 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94250]: saw 45 objects 2024-09-21T21:32:01.153 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94250]: shutting down. 2024-09-21T21:32:01.445 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:01.445 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94251]: starting. 2024-09-21T21:32:01.445 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94251]: removed 25 objects... 2024-09-21T21:32:01.445 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94251]: removed half of the objects 2024-09-21T21:32:01.446 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94251]: removed 50 objects... 2024-09-21T21:32:01.446 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94251]: removed 50 objects 2024-09-21T21:32:01.446 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94251]: shutting down. 2024-09-21T21:32:02.135 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:process_6_[94300]: starting. 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:process_6_[94300]: creating pool ceph_test_rados_list_parallel.smithi005-94212 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:process_6_[94300]: created object 0... 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:process_6_[94300]: created object 25... 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:process_6_[94300]: created object 49... 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:process_6_[94300]: finishing. 2024-09-21T21:32:02.136 INFO:tasks.workunit.client.0.smithi005.stdout:process_6_[94300]: shutting down. 2024-09-21T21:32:02.509 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:02.509 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:02.509 INFO:tasks.workunit.client.0.smithi005.stdout:process_7_[94301]: starting. 2024-09-21T21:32:02.510 INFO:tasks.workunit.client.0.smithi005.stdout:process_7_[94301]: listing objects. 2024-09-21T21:32:02.510 INFO:tasks.workunit.client.0.smithi005.stdout:process_7_[94301]: listed object 0... 2024-09-21T21:32:02.510 INFO:tasks.workunit.client.0.smithi005.stdout:process_7_[94301]: listed object 25... 2024-09-21T21:32:02.510 INFO:tasks.workunit.client.0.smithi005.stdout:process_7_[94301]: listed object 50... 2024-09-21T21:32:02.510 INFO:tasks.workunit.client.0.smithi005.stdout:process_7_[94301]: saw 55 objects 2024-09-21T21:32:02.510 INFO:tasks.workunit.client.0.smithi005.stdout:process_7_[94301]: shutting down. 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:process_8_[94302]: starting. 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:process_8_[94302]: added 25 objects... 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:process_8_[94302]: added half of the objects 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:process_8_[94302]: added 50 objects... 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:process_8_[94302]: added 50 objects 2024-09-21T21:32:02.853 INFO:tasks.workunit.client.0.smithi005.stdout:process_8_[94302]: shutting down. 2024-09-21T21:32:03.556 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:process_9_[94351]: starting. 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:process_9_[94351]: creating pool ceph_test_rados_list_parallel.smithi005-94212 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:process_9_[94351]: created object 0... 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:process_9_[94351]: created object 25... 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:process_9_[94351]: created object 49... 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:process_9_[94351]: finishing. 2024-09-21T21:32:03.557 INFO:tasks.workunit.client.0.smithi005.stdout:process_9_[94351]: shutting down. 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: starting. 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: listing objects. 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: listed object 0... 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: listed object 25... 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: listed object 50... 2024-09-21T21:32:03.971 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: listed object 75... 2024-09-21T21:32:03.972 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: saw 97 objects 2024-09-21T21:32:03.972 INFO:tasks.workunit.client.0.smithi005.stdout:process_10_[94352]: shutting down. 2024-09-21T21:32:04.354 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:process_13_[94355]: starting. 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:process_13_[94355]: removed 25 objects... 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:process_13_[94355]: removed half of the objects 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:process_13_[94355]: removed 50 objects... 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:process_13_[94355]: removed 50 objects 2024-09-21T21:32:04.355 INFO:tasks.workunit.client.0.smithi005.stdout:process_13_[94355]: shutting down. 2024-09-21T21:32:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:process_11_[94353]: starting. 2024-09-21T21:32:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:process_11_[94353]: added 25 objects... 2024-09-21T21:32:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:process_11_[94353]: added half of the objects 2024-09-21T21:32:04.442 INFO:tasks.workunit.client.0.smithi005.stdout:process_11_[94353]: added 50 objects... 2024-09-21T21:32:04.443 INFO:tasks.workunit.client.0.smithi005.stdout:process_11_[94353]: added 50 objects 2024-09-21T21:32:04.443 INFO:tasks.workunit.client.0.smithi005.stdout:process_11_[94353]: shutting down. 2024-09-21T21:32:04.444 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.444 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.444 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:04.444 INFO:tasks.workunit.client.0.smithi005.stdout:process_12_[94354]: starting. 2024-09-21T21:32:04.444 INFO:tasks.workunit.client.0.smithi005.stdout:process_12_[94354]: added 25 objects... 2024-09-21T21:32:04.444 INFO:tasks.workunit.client.0.smithi005.stdout:process_12_[94354]: added half of the objects 2024-09-21T21:32:04.444 INFO:tasks.workunit.client.0.smithi005.stdout:process_12_[94354]: added 50 objects... 2024-09-21T21:32:04.445 INFO:tasks.workunit.client.0.smithi005.stdout:process_12_[94354]: added 50 objects 2024-09-21T21:32:04.445 INFO:tasks.workunit.client.0.smithi005.stdout:process_12_[94354]: shutting down. 2024-09-21T21:32:05.132 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.132 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.132 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.132 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.132 INFO:tasks.workunit.client.0.smithi005.stdout:process_14_[94436]: starting. 2024-09-21T21:32:05.132 INFO:tasks.workunit.client.0.smithi005.stdout:process_14_[94436]: creating pool ceph_test_rados_list_parallel.smithi005-94212 2024-09-21T21:32:05.133 INFO:tasks.workunit.client.0.smithi005.stdout:process_14_[94436]: created object 0... 2024-09-21T21:32:05.133 INFO:tasks.workunit.client.0.smithi005.stdout:process_14_[94436]: created object 25... 2024-09-21T21:32:05.133 INFO:tasks.workunit.client.0.smithi005.stdout:process_14_[94436]: created object 49... 2024-09-21T21:32:05.133 INFO:tasks.workunit.client.0.smithi005.stdout:process_14_[94436]: finishing. 2024-09-21T21:32:05.133 INFO:tasks.workunit.client.0.smithi005.stdout:process_14_[94436]: shutting down. 2024-09-21T21:32:05.480 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.480 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.480 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.480 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: starting. 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: listing objects. 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: listed object 0... 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: listed object 25... 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: listed object 50... 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: listed object 75... 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: listed object 100... 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: listed object 125... 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: saw 150 objects 2024-09-21T21:32:05.481 INFO:tasks.workunit.client.0.smithi005.stdout:process_15_[94437]: shutting down. 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:process_16_[94438]: starting. 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:process_16_[94438]: added 25 objects... 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:process_16_[94438]: added half of the objects 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:process_16_[94438]: added 50 objects... 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:process_16_[94438]: added 50 objects 2024-09-21T21:32:05.813 INFO:tasks.workunit.client.0.smithi005.stdout:process_16_[94438]: shutting down. 2024-09-21T21:32:05.994 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.994 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.994 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.994 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.995 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:05.995 INFO:tasks.workunit.client.0.smithi005.stdout:******* SUCCESS ********** 2024-09-21T21:32:05.995 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:32:05.996 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:32:05.996 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_open_pools_parallel 2024-09-21T21:32:08.959 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94504]: starting. 2024-09-21T21:32:08.959 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94504]: creating pool ceph_test_rados_open_pools_parallel.smithi005-94503 2024-09-21T21:32:08.959 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94504]: created object 0... 2024-09-21T21:32:08.959 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94504]: created object 25... 2024-09-21T21:32:08.959 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94504]: created object 49... 2024-09-21T21:32:08.959 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94504]: finishing. 2024-09-21T21:32:08.959 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94504]: shutting down. 2024-09-21T21:32:09.010 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94505]: starting. 2024-09-21T21:32:09.010 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94505]: rados_pool_create. 2024-09-21T21:32:09.010 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94505]: rados_ioctx_create. 2024-09-21T21:32:09.010 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94505]: shutting down. 2024-09-21T21:32:11.925 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:11.925 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94540]: starting. 2024-09-21T21:32:11.925 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94540]: creating pool ceph_test_rados_open_pools_parallel.smithi005-94503 2024-09-21T21:32:11.925 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94540]: created object 0... 2024-09-21T21:32:11.926 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94540]: created object 25... 2024-09-21T21:32:11.926 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94540]: created object 49... 2024-09-21T21:32:11.926 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94540]: finishing. 2024-09-21T21:32:11.926 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94540]: shutting down. 2024-09-21T21:32:12.018 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:12.019 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94541]: starting. 2024-09-21T21:32:12.019 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94541]: rados_pool_create. 2024-09-21T21:32:12.019 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94541]: rados_ioctx_create. 2024-09-21T21:32:12.019 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94541]: shutting down. 2024-09-21T21:32:12.020 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:12.020 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:12.020 INFO:tasks.workunit.client.0.smithi005.stdout:******* SUCCESS ********** 2024-09-21T21:32:12.021 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2024-09-21T21:32:12.021 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:32:12.021 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_rados_delete_pools_parallel 2024-09-21T21:32:15.037 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94577]: starting. 2024-09-21T21:32:15.037 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94577]: creating pool ceph_test_rados_delete_pools_parallel.smithi005-94576 2024-09-21T21:32:15.037 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94577]: created object 0... 2024-09-21T21:32:15.037 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94577]: created object 25... 2024-09-21T21:32:15.037 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94577]: created object 49... 2024-09-21T21:32:15.037 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94577]: finishing. 2024-09-21T21:32:15.037 INFO:tasks.workunit.client.0.smithi005.stdout:process_1_[94577]: shutting down. 2024-09-21T21:32:16.038 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94578]: starting. 2024-09-21T21:32:16.038 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94578]: deleting pool ceph_test_rados_delete_pools_parallel.smithi005-94576 2024-09-21T21:32:16.038 INFO:tasks.workunit.client.0.smithi005.stdout:process_2_[94578]: shutting down. 2024-09-21T21:32:19.038 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:19.041 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94613]: starting. 2024-09-21T21:32:19.041 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94613]: creating pool ceph_test_rados_delete_pools_parallel.smithi005-94576 2024-09-21T21:32:19.042 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94613]: created object 0... 2024-09-21T21:32:19.042 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94613]: created object 25... 2024-09-21T21:32:19.042 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94613]: created object 49... 2024-09-21T21:32:19.042 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94613]: finishing. 2024-09-21T21:32:19.042 INFO:tasks.workunit.client.0.smithi005.stdout:process_3_[94613]: shutting down. 2024-09-21T21:32:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94615]: starting. 2024-09-21T21:32:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94615]: listing objects. 2024-09-21T21:32:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94615]: listed object 0... 2024-09-21T21:32:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94615]: listed object 25... 2024-09-21T21:32:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94615]: saw 50 objects 2024-09-21T21:32:19.187 INFO:tasks.workunit.client.0.smithi005.stdout:process_5_[94615]: shutting down. 2024-09-21T21:32:20.057 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:20.057 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94614]: starting. 2024-09-21T21:32:20.057 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94614]: deleting pool ceph_test_rados_delete_pools_parallel.smithi005-94576 2024-09-21T21:32:20.057 INFO:tasks.workunit.client.0.smithi005.stdout:process_4_[94614]: shutting down. 2024-09-21T21:32:20.058 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:20.059 INFO:tasks.workunit.client.0.smithi005.stdout:******************************* 2024-09-21T21:32:20.059 INFO:tasks.workunit.client.0.smithi005.stdout:******* SUCCESS ********** 2024-09-21T21:32:20.060 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:32:20.060 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:32:20.060 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:32:20.060 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' cls = ec_io ']' 2024-09-21T21:32:20.060 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' cls = ec_list ']' 2024-09-21T21:32:20.060 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_cls 2024-09-21T21:32:20.083 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:32:20.083 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 1 test from 1 test suite. 2024-09-21T21:32:20.083 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:32:20.083 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from NeoRadosCls 2024-09-21T21:32:20.084 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosCls.DNE 2024-09-21T21:32:22.931 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosCls.DNE (2849 ms) 2024-09-21T21:32:22.932 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from NeoRadosCls (2849 ms total) 2024-09-21T21:32:22.932 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:32:22.932 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:32:22.932 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 1 test from 1 test suite ran. (2849 ms total) 2024-09-21T21:32:22.932 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 1 test. 2024-09-21T21:32:22.934 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:32:22.935 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:32:22.935 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:32:22.935 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' cmd = ec_io ']' 2024-09-21T21:32:22.935 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' cmd = ec_list ']' 2024-09-21T21:32:22.935 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_cmd 2024-09-21T21:32:22.959 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:32:22.959 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-21T21:32:22.959 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:32:22.959 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from NeoRadosCmd 2024-09-21T21:32:22.959 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-09-21T21:32:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosCmd.MonDescribe (1978 ms) 2024-09-21T21:32:24.937 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-09-21T21:32:26.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosCmd.OSDCmd (2011 ms) 2024-09-21T21:32:26.948 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-09-21T21:32:29.961 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosCmd.PGCmd (3013 ms) 2024-09-21T21:32:29.961 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from NeoRadosCmd (7002 ms total) 2024-09-21T21:32:29.961 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:32:29.961 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:32:29.961 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 3 tests from 1 test suite ran. (7002 ms total) 2024-09-21T21:32:29.961 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 3 tests. 2024-09-21T21:32:29.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:32:29.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:32:29.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:32:29.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' handler_error = ec_io ']' 2024-09-21T21:32:29.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' handler_error = ec_list ']' 2024-09-21T21:32:29.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_handler_error 2024-09-21T21:32:29.985 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:32:29.985 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 1 test from 1 test suite. 2024-09-21T21:32:29.986 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:32:29.986 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from neocls_handler_error 2024-09-21T21:32:29.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-09-21T21:32:32.961 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] neocls_handler_error.test_handler_error (2975 ms) 2024-09-21T21:32:32.961 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 1 test from neocls_handler_error (2975 ms total) 2024-09-21T21:32:32.962 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:32:32.962 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:32:32.962 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 1 test from 1 test suite ran. (2975 ms total) 2024-09-21T21:32:32.962 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 1 test. 2024-09-21T21:32:32.963 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:32:32.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:32:32.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:32:32.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' io = ec_io ']' 2024-09-21T21:32:32.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' io = ec_list ']' 2024-09-21T21:32:32.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_io 2024-09-21T21:32:32.985 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:32:32.985 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-21T21:32:32.985 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:32:32.986 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from NeoRadosIo 2024-09-21T21:32:32.986 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.Limits 2024-09-21T21:32:33.967 INFO:tasks.workunit.client.0.smithi005.stderr:Not supported by crimson yet. Skipped 2024-09-21T21:32:34.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.Limits (1982 ms) 2024-09-21T21:32:34.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-09-21T21:32:37.984 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.SimpleWrite (3016 ms) 2024-09-21T21:32:37.984 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-09-21T21:32:40.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.ReadOp (2943 ms) 2024-09-21T21:32:40.927 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-09-21T21:32:43.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.SparseRead (3016 ms) 2024-09-21T21:32:43.943 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-09-21T21:32:46.955 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.RoundTrip (3012 ms) 2024-09-21T21:32:46.955 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-09-21T21:32:49.969 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3015 ms) 2024-09-21T21:32:49.970 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-09-21T21:32:52.971 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3001 ms) 2024-09-21T21:32:52.971 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-09-21T21:32:55.984 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3014 ms) 2024-09-21T21:32:55.985 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-09-21T21:32:58.998 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3013 ms) 2024-09-21T21:32:58.998 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.Trunc 2024-09-21T21:33:02.008 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.Trunc (3010 ms) 2024-09-21T21:33:02.008 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.Remove 2024-09-21T21:33:05.026 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.Remove (3018 ms) 2024-09-21T21:33:05.026 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-09-21T21:33:08.038 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3012 ms) 2024-09-21T21:33:08.038 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-09-21T21:33:10.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.RmXattr (2897 ms) 2024-09-21T21:33:10.935 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-09-21T21:33:13.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosIo.GetXattrs (3011 ms) 2024-09-21T21:33:13.946 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from NeoRadosIo (40960 ms total) 2024-09-21T21:33:13.946 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:33:13.947 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:33:13.947 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 14 tests from 1 test suite ran. (40960 ms total) 2024-09-21T21:33:13.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 14 tests. 2024-09-21T21:33:13.952 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:33:13.952 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:33:13.953 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:33:13.953 INFO:tasks.workunit.client.0.smithi005.stdout:Skipping EC with Crimson 2024-09-21T21:33:13.953 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' ec_io = ec_io ']' 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'Skipping EC with Crimson' 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ continue 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' list = ec_io ']' 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' list = ec_list ']' 2024-09-21T21:33:13.954 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_list 2024-09-21T21:33:13.980 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:33:13.980 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 3 tests from 1 test suite. 2024-09-21T21:33:13.980 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:33:13.980 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from NeoradosList 2024-09-21T21:33:13.980 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoradosList.ListObjects 2024-09-21T21:33:16.958 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoradosList.ListObjects (2978 ms) 2024-09-21T21:33:16.958 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-09-21T21:33:19.976 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoradosList.ListObjectsNS (3019 ms) 2024-09-21T21:33:19.976 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-09-21T21:33:29.992 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoradosList.ListObjectsMany (10016 ms) 2024-09-21T21:33:29.993 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 3 tests from NeoradosList (16013 ms total) 2024-09-21T21:33:29.993 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:33:29.993 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:33:29.993 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 3 tests from 1 test suite ran. (16013 ms total) 2024-09-21T21:33:29.993 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 3 tests. 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' ec_list = ec_io ']' 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' ec_list = ec_list ']' 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo 'Skipping EC with Crimson' 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stdout:Skipping EC with Crimson 2024-09-21T21:33:29.997 INFO:tasks.workunit.client.0.smithi005.stderr:+ continue 2024-09-21T21:33:29.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:33:29.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:33:29.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:33:29.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' misc = ec_io ']' 2024-09-21T21:33:29.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' misc = ec_list ']' 2024-09-21T21:33:29.998 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_misc 2024-09-21T21:33:30.019 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:33:30.019 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 12 tests from 1 test suite. 2024-09-21T21:33:30.020 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:33:30.020 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 12 tests from NeoRadosMisc 2024-09-21T21:33:30.020 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.Version 2024-09-21T21:33:31.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.Version (1927 ms) 2024-09-21T21:33:31.947 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-09-21T21:33:33.957 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2010 ms) 2024-09-21T21:33:33.957 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.LongName 2024-09-21T21:33:36.970 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.LongName (3013 ms) 2024-09-21T21:33:36.970 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-09-21T21:33:37.974 INFO:tasks.workunit.client.0.smithi005.stderr:Not supported by crimson yet. Skipped 2024-09-21T21:33:38.979 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.LongLocator (2009 ms) 2024-09-21T21:33:38.979 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-09-21T21:33:41.989 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.LongNamespace (3010 ms) 2024-09-21T21:33:41.989 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-09-21T21:33:45.004 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.LongAttrName (3015 ms) 2024-09-21T21:33:45.005 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.Exec 2024-09-21T21:33:48.018 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.Exec (3014 ms) 2024-09-21T21:33:48.018 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-09-21T21:33:50.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.Operate1 (2928 ms) 2024-09-21T21:33:50.946 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-09-21T21:33:53.956 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.Operate2 (3010 ms) 2024-09-21T21:33:53.956 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-09-21T21:33:56.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.BigObject (3011 ms) 2024-09-21T21:33:56.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-09-21T21:33:58.977 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.BigAttr (2011 ms) 2024-09-21T21:33:58.978 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-09-21T21:33:59.987 INFO:tasks.workunit.client.0.smithi005.stderr:Not supported by crimson yet. Skipped 2024-09-21T21:34:00.949 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosMisc.WriteSame (1972 ms) 2024-09-21T21:34:00.950 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 12 tests from NeoRadosMisc (30930 ms total) 2024-09-21T21:34:00.950 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:34:00.950 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:34:00.950 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 12 tests from 1 test suite ran. (30930 ms total) 2024-09-21T21:34:00.950 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 12 tests. 2024-09-21T21:34:00.955 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:34:00.955 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:34:00.955 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:34:00.955 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' pool = ec_io ']' 2024-09-21T21:34:00.955 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' pool = ec_list ']' 2024-09-21T21:34:00.955 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_pool 2024-09-21T21:34:00.979 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:34:00.979 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-21T21:34:00.979 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:34:00.979 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 6 tests from NeoRadosPools 2024-09-21T21:34:00.979 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosPools.PoolList 2024-09-21T21:34:03.002 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosPools.PoolList (2023 ms) 2024-09-21T21:34:03.002 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-09-21T21:34:05.007 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosPools.PoolLookup (2005 ms) 2024-09-21T21:34:05.007 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-09-21T21:34:07.018 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (2011 ms) 2024-09-21T21:34:07.018 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-09-21T21:34:10.950 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosPools.PoolDelete (3933 ms) 2024-09-21T21:34:10.951 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-09-21T21:34:12.958 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2007 ms) 2024-09-21T21:34:12.958 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-09-21T21:34:14.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2010 ms) 2024-09-21T21:34:14.968 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 6 tests from NeoRadosPools (13989 ms total) 2024-09-21T21:34:14.968 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:34:14.968 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:34:14.968 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 6 tests from 1 test suite ran. (13989 ms total) 2024-09-21T21:34:14.969 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 6 tests. 2024-09-21T21:34:14.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:34:14.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:34:14.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:34:14.972 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' read_operations = ec_io ']' 2024-09-21T21:34:14.973 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' read_operations = ec_list ']' 2024-09-21T21:34:14.973 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_read_operations 2024-09-21T21:34:14.996 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:34:14.996 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 14 tests from 1 test suite. 2024-09-21T21:34:14.997 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:34:14.997 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from NeoRadosReadOps 2024-09-21T21:34:14.997 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-09-21T21:34:17.982 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2986 ms) 2024-09-21T21:34:17.982 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-09-21T21:34:20.957 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.AssertExists (2975 ms) 2024-09-21T21:34:20.957 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-09-21T21:34:23.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3011 ms) 2024-09-21T21:34:23.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-09-21T21:34:26.979 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.CmpXattr (3011 ms) 2024-09-21T21:34:26.979 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.Read 2024-09-21T21:34:29.997 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.Read (3018 ms) 2024-09-21T21:34:29.997 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-09-21T21:34:33.000 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.Checksum (3003 ms) 2024-09-21T21:34:33.000 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-09-21T21:34:36.013 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3013 ms) 2024-09-21T21:34:36.013 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-09-21T21:34:39.023 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.ShortRead (3011 ms) 2024-09-21T21:34:39.024 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-09-21T21:34:42.037 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.Exec (3013 ms) 2024-09-21T21:34:42.037 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-09-21T21:34:45.088 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.Stat (3051 ms) 2024-09-21T21:34:45.088 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-09-21T21:34:48.103 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.Omap (3015 ms) 2024-09-21T21:34:48.103 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-09-21T21:34:50.962 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.OmapNuls (2860 ms) 2024-09-21T21:34:50.963 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-09-21T21:34:53.974 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3011 ms) 2024-09-21T21:34:53.974 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-09-21T21:34:56.987 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosReadOps.CmpExt (3014 ms) 2024-09-21T21:34:56.987 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 14 tests from NeoRadosReadOps (41992 ms total) 2024-09-21T21:34:56.988 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:34:56.988 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:34:56.988 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 14 tests from 1 test suite ran. (41992 ms total) 2024-09-21T21:34:56.988 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 14 tests. 2024-09-21T21:34:56.995 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:34:56.995 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:34:56.995 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:34:56.995 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' snapshots = ec_io ']' 2024-09-21T21:34:56.995 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' snapshots = ec_list ']' 2024-09-21T21:34:56.995 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_snapshots 2024-09-21T21:34:57.016 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:34:57.016 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 11 tests from 2 test suites. 2024-09-21T21:34:57.016 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:34:57.016 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-09-21T21:34:57.016 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-09-21T21:35:01.970 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSnapshots.SnapList (4955 ms) 2024-09-21T21:35:01.971 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-09-21T21:35:07.019 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (5048 ms) 2024-09-21T21:35:07.019 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-09-21T21:35:10.967 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSnapshots.Rollback (3949 ms) 2024-09-21T21:35:10.968 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-09-21T21:35:15.990 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5022 ms) 2024-09-21T21:35:15.990 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-09-21T21:35:22.979 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (6989 ms) 2024-09-21T21:35:22.979 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 5 tests from NeoRadosSnapshots (25963 ms total) 2024-09-21T21:35:22.979 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:35:22.979 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-09-21T21:35:22.979 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-09-21T21:35:28.005 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5026 ms) 2024-09-21T21:35:28.005 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-09-21T21:35:29.011 INFO:tasks.workunit.client.0.smithi005.stderr:Not supported by crimson yet. Skipped 2024-09-21T21:35:30.016 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2011 ms) 2024-09-21T21:35:30.017 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-09-21T21:35:30.980 INFO:tasks.workunit.client.0.smithi005.stderr:Not supported by crimson yet. Skipped 2024-09-21T21:35:31.981 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (1964 ms) 2024-09-21T21:35:31.981 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-09-21T21:35:38.042 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6061 ms) 2024-09-21T21:35:38.042 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-09-21T21:35:41.980 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (3939 ms) 2024-09-21T21:35:41.981 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-09-21T21:35:44.994 INFO:tasks.workunit.client.0.smithi005.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi005-95508-11. 2024-09-21T21:35:45.998 INFO:tasks.workunit.client.0.smithi005.stdout:Waiting for snaps to purge. 2024-09-21T21:36:02.013 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20032 ms) 2024-09-21T21:36:02.013 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (39034 ms total) 2024-09-21T21:36:02.013 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:36:02.013 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:36:02.014 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 11 tests from 2 test suites ran. (64997 ms total) 2024-09-21T21:36:02.014 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 11 tests. 2024-09-21T21:36:02.018 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:36:02.019 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:36:02.019 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:36:02.019 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' watch_notify = ec_io ']' 2024-09-21T21:36:02.019 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' watch_notify = ec_list ']' 2024-09-21T21:36:02.019 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_watch_notify 2024-09-21T21:36:02.040 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:36:02.041 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 2 tests from 1 test suite. 2024-09-21T21:36:02.041 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:36:02.041 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-09-21T21:36:02.041 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-09-21T21:36:04.279 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 23476624 notify_id 2851858284544 notifier_gid 15855 2024-09-21T21:36:05.028 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (2987 ms) 2024-09-21T21:36:05.028 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-09-21T21:36:07.391 INFO:tasks.workunit.client.0.smithi005.stdout:Trying... 2024-09-21T21:36:07.394 INFO:tasks.workunit.client.0.smithi005.stdout:handle_notify cookie 36501680 notify_id 2864743186437 notifier_gid 15858 2024-09-21T21:36:07.394 INFO:tasks.workunit.client.0.smithi005.stdout:Waiting for 3.000000000s 2024-09-21T21:36:08.393 INFO:tasks.workunit.client.0.smithi005.stdout:Timed out. 2024-09-21T21:36:08.406 INFO:tasks.workunit.client.0.smithi005.stdout:Flushing... 2024-09-21T21:36:08.407 INFO:tasks.workunit.client.0.smithi005.stdout:Flushed... 2024-09-21T21:36:12.047 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7019 ms) 2024-09-21T21:36:12.047 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 2 tests from NeoRadosWatchNotify (10006 ms total) 2024-09-21T21:36:12.047 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:36:12.048 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:36:12.048 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 2 tests from 1 test suite ran. (10006 ms total) 2024-09-21T21:36:12.048 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 2 tests. 2024-09-21T21:36:12.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-09-21T21:36:12.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:36:12.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 1 -eq 1 ']' 2024-09-21T21:36:12.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' write_operations = ec_io ']' 2024-09-21T21:36:12.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' write_operations = ec_list ']' 2024-09-21T21:36:12.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph_test_neorados_write_operations 2024-09-21T21:36:12.075 INFO:tasks.workunit.client.0.smithi005.stdout:Running main() from gmock_main.cc 2024-09-21T21:36:12.076 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] Running 7 tests from 1 test suite. 2024-09-21T21:36:12.076 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment set-up. 2024-09-21T21:36:12.076 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-09-21T21:36:12.076 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-09-21T21:36:15.066 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWriteOps.AssertExists (2990 ms) 2024-09-21T21:36:15.066 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-09-21T21:36:18.083 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (3017 ms) 2024-09-21T21:36:18.083 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-09-21T21:36:20.993 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWriteOps.Xattrs (2910 ms) 2024-09-21T21:36:20.993 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-09-21T21:36:24.004 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWriteOps.Write (3012 ms) 2024-09-21T21:36:24.004 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-09-21T21:36:27.019 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWriteOps.Exec (3014 ms) 2024-09-21T21:36:27.019 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-09-21T21:36:30.033 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3014 ms) 2024-09-21T21:36:30.033 INFO:tasks.workunit.client.0.smithi005.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-09-21T21:36:41.047 INFO:tasks.workunit.client.0.smithi005.stdout:[ OK ] NeoRadosWriteOps.CmpExt (11015 ms) 2024-09-21T21:36:41.048 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] 7 tests from NeoRadosWriteOps (28972 ms total) 2024-09-21T21:36:41.048 INFO:tasks.workunit.client.0.smithi005.stdout: 2024-09-21T21:36:41.048 INFO:tasks.workunit.client.0.smithi005.stdout:[----------] Global test environment tear-down 2024-09-21T21:36:41.048 INFO:tasks.workunit.client.0.smithi005.stdout:[==========] 7 tests from 1 test suite ran. (28972 ms total) 2024-09-21T21:36:41.048 INFO:tasks.workunit.client.0.smithi005.stdout:[ PASSED ] 7 tests. 2024-09-21T21:36:41.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ ret=0 2024-09-21T21:36:41.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -eq 1 ']' 2024-09-21T21:36:41.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ exit 0 2024-09-21T21:36:41.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ cleanup 2024-09-21T21:36:41.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ pkill -P 29889 2024-09-21T21:36:41.070 INFO:tasks.workunit.client.0.smithi005.stderr:+ true 2024-09-21T21:36:41.070 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T21:36:41.070 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T21:36:41.152 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-09-21T21:36:41.153 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-09-21T21:36:41.153 DEBUG:teuthology.orchestra.run.smithi005:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=62da54b4b83a96ca9976b7e1d0c8272a564a2208 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-09-21T21:36:41.219 INFO:tasks.workunit.client.0.smithi005.stderr:++ uuidgen 2024-09-21T21:36:41.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ p=e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:36:41.224 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool create e9819043-ddba-4507-b76c-4ec545d96daf 12 2024-09-21T21:36:41.361 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.348+0000 7f09cd8f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:41.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.360+0000 7f09cd8f4640 1 Processor -- start 2024-09-21T21:36:41.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.360+0000 7f09cd8f4640 1 -- start start 2024-09-21T21:36:41.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09cd8f4640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09c806eb10 0x7f09c813b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:41.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09cd8f4640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c809dd30 con 0x7f09c806dff0 2024-09-21T21:36:41.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09cd8f4640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f09c806f3e0 con 0x7f09c806eb10 2024-09-21T21:36:41.365 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09c806eb10 0x7f09c813b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:41.365 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c67fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f09c806eb10 0x7f09c813b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34916/0 (socket says 172.21.15.5:34916) 2024-09-21T21:36:41.365 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c67fc640 1 -- 172.21.15.5:0/2322804580 learned_addr learned my addr 172.21.15.5:0/2322804580 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:41.365 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c6ffd640 1 --1- 172.21.15.5:0/2322804580 >> v1:172.21.15.5:6789/0 conn(0x7f09c806dff0 0x7f09c806e400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43184/0 (socket says 172.21.15.5:43184) 2024-09-21T21:36:41.366 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c67fc640 1 -- 172.21.15.5:0/2322804580 >> v1:172.21.15.5:6789/0 conn(0x7f09c806dff0 legacy=0x7f09c806e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:41.366 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c5ffb640 1 -- 172.21.15.5:0/2322804580 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807373939 0 0) 0x7f09c809dd30 con 0x7f09c806dff0 2024-09-21T21:36:41.366 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c67fc640 1 -- 172.21.15.5:0/2322804580 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c80a4cd0 con 0x7f09c806eb10 2024-09-21T21:36:41.366 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.362+0000 7f09c67fc640 1 --2- 172.21.15.5:0/2322804580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806eb10 0x7f09c813b300 crc :-1 s=READY pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1eb8c0c36da151 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:41.366 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.363+0000 7f09c5ffb640 1 -- 172.21.15.5:0/2322804580 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f09bc009e50 con 0x7f09c806eb10 2024-09-21T21:36:41.366 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.363+0000 7f09c5ffb640 1 -- 172.21.15.5:0/2322804580 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f09bc00e230 con 0x7f09c806eb10 2024-09-21T21:36:41.366 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.363+0000 7f09c5ffb640 1 -- 172.21.15.5:0/2322804580 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f09bc00e4d0 con 0x7f09c806eb10 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 1 -- 172.21.15.5:0/2322804580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806eb10 msgr2=0x7f09c813b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 1 --2- 172.21.15.5:0/2322804580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806eb10 0x7f09c813b300 crc :-1 s=READY pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 1 -- 172.21.15.5:0/2322804580 shutdown_connections 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 1 --2- 172.21.15.5:0/2322804580 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806eb10 0x7f09c813b300 unknown :-1 s=CLOSED pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 1 -- 172.21.15.5:0/2322804580 >> 172.21.15.5:0/2322804580 conn(0x7f09c8069120 msgr2=0x7f09c8069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 1 -- 172.21.15.5:0/2322804580 shutdown_connections 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 1 -- 172.21.15.5:0/2322804580 wait complete. 2024-09-21T21:36:41.367 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.364+0000 7f09cd8f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:41.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.366+0000 7f09cd8f4640 1 Processor -- start 2024-09-21T21:36:41.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.366+0000 7f09cd8f4640 1 -- start start 2024-09-21T21:36:41.371 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.368+0000 7f09cd8f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806dff0 0x7f09c81ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:41.371 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.368+0000 7f09cd8f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81260a0 con 0x7f09c806dff0 2024-09-21T21:36:41.371 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.368+0000 7f09c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806dff0 0x7f09c81ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:41.371 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.368+0000 7f09c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806dff0 0x7f09c81ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34928/0 (socket says 172.21.15.5:34928) 2024-09-21T21:36:41.371 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.368+0000 7f09c6ffd640 1 -- 172.21.15.5:0/3769564574 learned_addr learned my addr 172.21.15.5:0/3769564574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:41.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.369+0000 7f09c6ffd640 1 -- 172.21.15.5:0/3769564574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c809e3d0 con 0x7f09c806dff0 2024-09-21T21:36:41.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.369+0000 7f09c6ffd640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806dff0 0x7f09c81ca450 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:41.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.369+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f09b8004b80 con 0x7f09c806dff0 2024-09-21T21:36:41.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.369+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f09b8004ce0 con 0x7f09c806dff0 2024-09-21T21:36:41.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.369+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f09b8007120 con 0x7f09c806dff0 2024-09-21T21:36:41.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.369+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c8127770 con 0x7f09c806dff0 2024-09-21T21:36:41.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.369+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c8125d00 con 0x7f09c806dff0 2024-09-21T21:36:41.373 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.370+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f09b80072d0 con 0x7f09c806dff0 2024-09-21T21:36:41.373 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.370+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c80a44b0 con 0x7f09c806dff0 2024-09-21T21:36:41.373 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.371+0000 7f09affff640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f09b403eb20 0x7f09b4041030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:41.374 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.371+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(693..693 src has 1..693) ==== 3431+0+0 (crc 0 0 0) 0x7f09b804fd40 con 0x7f09c806dff0 2024-09-21T21:36:41.374 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.371+0000 7f09c67fc640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f09b403eb20 0x7f09b4041030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:41.374 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.372+0000 7f09c67fc640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f09b403eb20 0x7f09b4041030 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:41.379 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.377+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f09b800f420 con 0x7f09c806dff0 2024-09-21T21:36:41.572 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:41.570+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pg_num": 12} v 0) -- 0x7f09c8078820 con 0x7f09c806dff0 2024-09-21T21:36:42.048 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.045+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pg_num": 12}]=0 pool 'e9819043-ddba-4507-b76c-4ec545d96daf' created v694) ==== 176+0+0 (crc 0 0 0) 0x7f09b800a0c0 con 0x7f09c806dff0 2024-09-21T21:36:42.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.186+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pg_num": 12} v 0) -- 0x7f09c8129810 con 0x7f09c806dff0 2024-09-21T21:36:42.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.187+0000 7f09affff640 1 -- 172.21.15.5:0/3769564574 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pg_num": 12}]=0 pool 'e9819043-ddba-4507-b76c-4ec545d96daf' already exists v694) ==== 183+0+0 (crc 0 0 0) 0x7f09b800a7b0 con 0x7f09c806dff0 2024-09-21T21:36:42.189 INFO:tasks.workunit.client.0.smithi005.stderr:pool 'e9819043-ddba-4507-b76c-4ec545d96daf' already exists 2024-09-21T21:36:42.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f09b403eb20 msgr2=0x7f09b4041030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:42.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f09b403eb20 0x7f09b4041030 crc :-1 s=READY pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:42.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806dff0 msgr2=0x7f09c81ca450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:42.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806dff0 0x7f09c81ca450 crc :-1 s=READY pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:42.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 shutdown_connections 2024-09-21T21:36:42.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f09b403eb20 0x7f09b4041030 unknown :-1 s=CLOSED pgs=3807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:42.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 --2- 172.21.15.5:0/3769564574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f09c806dff0 0x7f09c81ca450 unknown :-1 s=CLOSED pgs=12830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:42.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 >> 172.21.15.5:0/3769564574 conn(0x7f09c8069120 msgr2=0x7f09c811ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:42.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 shutdown_connections 2024-09-21T21:36:42.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.189+0000 7f09cd8f4640 1 -- 172.21.15.5:0/3769564574 wait complete. 2024-09-21T21:36:42.202 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota e9819043-ddba-4507-b76c-4ec545d96daf max_objects 10 2024-09-21T21:36:42.298 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.287+0000 7fa337791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:42.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.297+0000 7fa337791640 1 Processor -- start 2024-09-21T21:36:42.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.297+0000 7fa337791640 1 -- start start 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.298+0000 7fa337791640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa33006ea60 0x7fa33013b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.298+0000 7fa337791640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa33006f410 con 0x7fa33006df40 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.298+0000 7fa337791640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa3300a7f90 con 0x7fa33006ea60 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa33552d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fa33006df40 0x7fa33006e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43200/0 (socket says 172.21.15.5:43200) 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa33552d640 1 -- 172.21.15.5:0/3584295034 learned_addr learned my addr 172.21.15.5:0/3584295034 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa334d2c640 1 --2- 172.21.15.5:0/3584295034 >> v2:172.21.15.5:3300/0 conn(0x7fa33006ea60 0x7fa33013b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa334d2c640 1 -- 172.21.15.5:0/3584295034 >> v1:172.21.15.5:6789/0 conn(0x7fa33006df40 legacy=0x7fa33006e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa334d2c640 1 -- 172.21.15.5:0/3584295034 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33009da20 con 0x7fa33006ea60 2024-09-21T21:36:42.302 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa334d2c640 1 --2- 172.21.15.5:0/3584295034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006ea60 0x7fa33013b300 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd95305be4e2825f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:42.303 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa327fff640 1 -- 172.21.15.5:0/3584295034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa320009d90 con 0x7fa33006ea60 2024-09-21T21:36:42.303 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa327fff640 1 -- 172.21.15.5:0/3584295034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa32000e230 con 0x7fa33006ea60 2024-09-21T21:36:42.303 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.299+0000 7fa327fff640 1 -- 172.21.15.5:0/3584295034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa32000e4d0 con 0x7fa33006ea60 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 1 -- 172.21.15.5:0/3584295034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006ea60 msgr2=0x7fa33013b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 1 --2- 172.21.15.5:0/3584295034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006ea60 0x7fa33013b300 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 1 -- 172.21.15.5:0/3584295034 shutdown_connections 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 1 --2- 172.21.15.5:0/3584295034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006ea60 0x7fa33013b300 unknown :-1 s=CLOSED pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 1 -- 172.21.15.5:0/3584295034 >> 172.21.15.5:0/3584295034 conn(0x7fa3300a5390 msgr2=0x7fa3300a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 1 -- 172.21.15.5:0/3584295034 shutdown_connections 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 1 -- 172.21.15.5:0/3584295034 wait complete. 2024-09-21T21:36:42.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.300+0000 7fa337791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:42.305 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.302+0000 7fa337791640 1 Processor -- start 2024-09-21T21:36:42.305 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.302+0000 7fa337791640 1 -- start start 2024-09-21T21:36:42.307 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa337791640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006df40 0x7fa330126e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:42.307 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa337791640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa3301256e0 con 0x7fa33006df40 2024-09-21T21:36:42.307 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa33552d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006df40 0x7fa330126e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:42.307 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa33552d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006df40 0x7fa330126e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34938/0 (socket says 172.21.15.5:34938) 2024-09-21T21:36:42.307 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa33552d640 1 -- 172.21.15.5:0/1542731472 learned_addr learned my addr 172.21.15.5:0/1542731472 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:42.307 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa33552d640 1 -- 172.21.15.5:0/1542731472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa330124e30 con 0x7fa33006df40 2024-09-21T21:36:42.307 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa33552d640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006df40 0x7fa330126e20 crc :-1 s=READY pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:42.308 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.304+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa32c005a60 con 0x7fa33006df40 2024-09-21T21:36:42.308 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.305+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa32c005bc0 con 0x7fa33006df40 2024-09-21T21:36:42.308 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.305+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa32c005e60 con 0x7fa33006df40 2024-09-21T21:36:42.308 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.305+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa330125f90 con 0x7fa33006df40 2024-09-21T21:36:42.308 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.305+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3301266a0 con 0x7fa33006df40 2024-09-21T21:36:42.309 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.306+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33006fd90 con 0x7fa33006df40 2024-09-21T21:36:42.309 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.306+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fa32c0070b0 con 0x7fa33006df40 2024-09-21T21:36:42.309 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.306+0000 7fa325ffb640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa31403eb00 0x7fa314041010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:42.309 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.306+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(694..694 src has 1..694) ==== 3806+0+0 (crc 0 0 0) 0x7fa32c04fd90 con 0x7fa33006df40 2024-09-21T21:36:42.309 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.306+0000 7fa334d2c640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa31403eb00 0x7fa314041010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:42.309 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.307+0000 7fa334d2c640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa31403eb00 0x7fa314041010 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:42.314 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.312+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fa32c00dc10 con 0x7fa33006df40 2024-09-21T21:36:42.505 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:42.502+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "10"} v 0) -- 0x7fa33006f640 con 0x7fa33006df40 2024-09-21T21:36:43.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:43.046+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e9819043-ddba-4507-b76c-4ec545d96daf v695) ==== 223+0+0 (crc 0 0 0) 0x7fa32c00d610 con 0x7fa33006df40 2024-09-21T21:36:43.220 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:43.217+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "10"} v 0) -- 0x7fa330125020 con 0x7fa33006df40 2024-09-21T21:36:44.057 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.055+0000 7fa325ffb640 1 -- 172.21.15.5:0/1542731472 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool e9819043-ddba-4507-b76c-4ec545d96daf v696) ==== 223+0+0 (crc 0 0 0) 0x7fa32c00d7f0 con 0x7fa33006df40 2024-09-21T21:36:44.057 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_objects = 10 for pool e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:36:44.062 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa31403eb00 msgr2=0x7fa314041010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:44.062 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa31403eb00 0x7fa314041010 crc :-1 s=READY pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:44.062 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006df40 msgr2=0x7fa330126e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:44.062 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006df40 0x7fa330126e20 crc :-1 s=READY pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:44.062 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 shutdown_connections 2024-09-21T21:36:44.062 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa31403eb00 0x7fa314041010 unknown :-1 s=CLOSED pgs=3808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:44.063 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 --2- 172.21.15.5:0/1542731472 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa33006df40 0x7fa330126e20 unknown :-1 s=CLOSED pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:44.063 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.060+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 >> 172.21.15.5:0/1542731472 conn(0x7fa3300a5390 msgr2=0x7fa33009fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:44.063 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.061+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 shutdown_connections 2024-09-21T21:36:44.063 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.061+0000 7fa337791640 1 -- 172.21.15.5:0/1542731472 wait complete. 2024-09-21T21:36:44.080 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool application enable e9819043-ddba-4507-b76c-4ec545d96daf rados 2024-09-21T21:36:44.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.177+0000 7f62e8751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:44.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.187+0000 7f62e8751640 1 Processor -- start 2024-09-21T21:36:44.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.187+0000 7f62e8751640 1 -- start start 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e8751640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62e006f6b0 0x7f62e00a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e8751640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e006fe80 con 0x7f62e00a2180 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e8751640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f62e00709b0 con 0x7f62e006f6b0 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e64ed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62e006f6b0 0x7f62e00a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e5cec640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f62e00a2180 0x7f62e0133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:43202/0 (socket says 172.21.15.5:43202) 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e64ed640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62e006f6b0 0x7f62e00a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34948/0 (socket says 172.21.15.5:34948) 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e5cec640 1 -- 172.21.15.5:0/2798094250 learned_addr learned my addr 172.21.15.5:0/2798094250 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e64ed640 1 -- 172.21.15.5:0/2798094250 >> v1:172.21.15.5:6789/0 conn(0x7f62e00a2180 legacy=0x7f62e0133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e64ed640 1 -- 172.21.15.5:0/2798094250 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e006fb70 con 0x7f62e006f6b0 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.189+0000 7f62e64ed640 1 --2- 172.21.15.5:0/2798094250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e006f6b0 0x7f62e00a1c40 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c2c79d1675c19a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:44.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e54eb640 1 -- 172.21.15.5:0/2798094250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62dc009d90 con 0x7f62e006f6b0 2024-09-21T21:36:44.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e54eb640 1 -- 172.21.15.5:0/2798094250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62dc00e230 con 0x7f62e006f6b0 2024-09-21T21:36:44.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e54eb640 1 -- 172.21.15.5:0/2798094250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62dc00e4d0 con 0x7f62e006f6b0 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e8751640 1 -- 172.21.15.5:0/2798094250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e006f6b0 msgr2=0x7f62e00a1c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e8751640 1 --2- 172.21.15.5:0/2798094250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e006f6b0 0x7f62e00a1c40 crc :-1 s=READY pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e8751640 1 -- 172.21.15.5:0/2798094250 shutdown_connections 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e8751640 1 --2- 172.21.15.5:0/2798094250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e006f6b0 0x7f62e00a1c40 unknown :-1 s=CLOSED pgs=12835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.190+0000 7f62e8751640 1 -- 172.21.15.5:0/2798094250 >> 172.21.15.5:0/2798094250 conn(0x7f62e00a3400 msgr2=0x7f62e00a3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.191+0000 7f62e8751640 1 -- 172.21.15.5:0/2798094250 shutdown_connections 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.191+0000 7f62e8751640 1 -- 172.21.15.5:0/2798094250 wait complete. 2024-09-21T21:36:44.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.191+0000 7f62e8751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:44.195 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.192+0000 7f62e8751640 1 Processor -- start 2024-09-21T21:36:44.195 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.193+0000 7f62e8751640 1 -- start start 2024-09-21T21:36:44.196 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.194+0000 7f62e8751640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e00a2180 0x7f62e01242b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:44.196 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.194+0000 7f62e8751640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0125110 con 0x7f62e00a2180 2024-09-21T21:36:44.196 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.194+0000 7f62e64ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e00a2180 0x7f62e01242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:44.196 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.194+0000 7f62e64ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e00a2180 0x7f62e01242b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34950/0 (socket says 172.21.15.5:34950) 2024-09-21T21:36:44.196 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.194+0000 7f62e64ed640 1 -- 172.21.15.5:0/1851141459 learned_addr learned my addr 172.21.15.5:0/1851141459 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:44.196 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.194+0000 7f62e64ed640 1 -- 172.21.15.5:0/1851141459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e0123be0 con 0x7f62e00a2180 2024-09-21T21:36:44.197 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.195+0000 7f62e64ed640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e00a2180 0x7f62e01242b0 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:44.197 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.195+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62dc014540 con 0x7f62e00a2180 2024-09-21T21:36:44.197 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.195+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62dc0146a0 con 0x7f62e00a2180 2024-09-21T21:36:44.197 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.195+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e01259c0 con 0x7f62e00a2180 2024-09-21T21:36:44.198 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.195+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62dc014940 con 0x7f62e00a2180 2024-09-21T21:36:44.198 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.195+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e01269d0 con 0x7f62e00a2180 2024-09-21T21:36:44.198 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.196+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f62dc014b40 con 0x7f62e00a2180 2024-09-21T21:36:44.199 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.196+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e0127540 con 0x7f62e00a2180 2024-09-21T21:36:44.199 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.196+0000 7f62d6ffd640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c403ea80 0x7f62c4040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:44.199 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.196+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(696..696 src has 1..696) ==== 3806+0+0 (crc 0 0 0) 0x7f62dc019040 con 0x7f62e00a2180 2024-09-21T21:36:44.200 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.196+0000 7f62e5cec640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c403ea80 0x7f62c4040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:44.200 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.197+0000 7f62e5cec640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c403ea80 0x7f62c4040f90 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:44.203 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.201+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f62dc018790 con 0x7f62e00a2180 2024-09-21T21:36:44.394 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:44.392+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "app": "rados"} v 0) -- 0x7f62e006f6b0 con 0x7f62e00a2180 2024-09-21T21:36:45.058 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.056+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "app": "rados"}]=0 enabled application 'rados' on pool 'e9819043-ddba-4507-b76c-4ec545d96daf' v697) ==== 213+0+0 (crc 0 0 0) 0x7f62dc00f2a0 con 0x7f62e00a2180 2024-09-21T21:36:45.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.181+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "app": "rados"} v 0) -- 0x7f62e00713e0 con 0x7f62e00a2180 2024-09-21T21:36:45.990 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.988+0000 7f62d6ffd640 1 -- 172.21.15.5:0/1851141459 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "app": "rados"}]=0 enabled application 'rados' on pool 'e9819043-ddba-4507-b76c-4ec545d96daf' v698) ==== 213+0+0 (crc 0 0 0) 0x7f62dc018190 con 0x7f62e00a2180 2024-09-21T21:36:45.990 INFO:tasks.workunit.client.0.smithi005.stderr:enabled application 'rados' on pool 'e9819043-ddba-4507-b76c-4ec545d96daf' 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.992+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c403ea80 msgr2=0x7f62c4040f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.992+0000 7f62e8751640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c403ea80 0x7f62c4040f90 crc :-1 s=READY pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.992+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e00a2180 msgr2=0x7f62e01242b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.992+0000 7f62e8751640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e00a2180 0x7f62e01242b0 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.993+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 shutdown_connections 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.993+0000 7f62e8751640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c403ea80 0x7f62c4040f90 unknown :-1 s=CLOSED pgs=3809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.993+0000 7f62e8751640 1 --2- 172.21.15.5:0/1851141459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62e00a2180 0x7f62e01242b0 unknown :-1 s=CLOSED pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.993+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 >> 172.21.15.5:0/1851141459 conn(0x7f62e00a3400 msgr2=0x7f62e009da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:45.995 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.993+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 shutdown_connections 2024-09-21T21:36:45.996 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:45.993+0000 7f62e8751640 1 -- 172.21.15.5:0/1851141459 wait complete. 2024-09-21T21:36:46.010 INFO:tasks.workunit.client.0.smithi005.stderr:++ seq 1 10 2024-09-21T21:36:46.024 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.024 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj1 /etc/passwd 2024-09-21T21:36:46.071 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.069+0000 7f5567743ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.077 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.075+0000 7f5567743ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.077 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.076+0000 7f5567743ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.078 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.076+0000 7f5567743ec0 1 Processor -- start 2024-09-21T21:36:46.078 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.077+0000 7f5567743ec0 1 -- start start 2024-09-21T21:36:46.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.078+0000 7f5567743ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x17b8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.078+0000 7f5567743ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1603520 con 0x169fbe0 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.078+0000 7f555affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x17b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.078+0000 7f555affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x17b8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34972/0 (socket says 172.21.15.5:34972) 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.078+0000 7f555affd640 1 -- 172.21.15.5:0/1539377175 learned_addr learned my addr 172.21.15.5:0/1539377175 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.078+0000 7f555affd640 1 -- 172.21.15.5:0/1539377175 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x159fe10 con 0x169fbe0 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.079+0000 7f555affd640 1 --2- 172.21.15.5:0/1539377175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x17b8930 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0054f1d793d829 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.079+0000 7f5559ffb640 1 -- 172.21.15.5:0/1539377175 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f554c02dc20 con 0x169fbe0 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.079+0000 7f5559ffb640 1 -- 172.21.15.5:0/1539377175 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f554c035420 con 0x169fbe0 2024-09-21T21:36:46.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.079+0000 7f5559ffb640 1 -- 172.21.15.5:0/1539377175 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f554c0356c0 con 0x169fbe0 2024-09-21T21:36:46.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.079+0000 7f5567743ec0 1 -- 172.21.15.5:0/1539377175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 msgr2=0x17b8930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.079+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1539377175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x17b8930 crc :-1 s=READY pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.080+0000 7f5567743ec0 1 -- 172.21.15.5:0/1539377175 shutdown_connections 2024-09-21T21:36:46.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.080+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1539377175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x17b8930 unknown :-1 s=CLOSED pgs=12839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.080+0000 7f5567743ec0 1 -- 172.21.15.5:0/1539377175 >> 172.21.15.5:0/1539377175 conn(0x15c3770 msgr2=0x16986d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.080+0000 7f5567743ec0 1 -- 172.21.15.5:0/1539377175 shutdown_connections 2024-09-21T21:36:46.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.080+0000 7f5567743ec0 1 -- 172.21.15.5:0/1539377175 wait complete. 2024-09-21T21:36:46.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.081+0000 7f5567743ec0 1 Processor -- start 2024-09-21T21:36:46.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.081+0000 7f5567743ec0 1 -- start start 2024-09-21T21:36:46.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.082+0000 7f5567743ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x171be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.082+0000 7f5567743ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1601280 con 0x169fbe0 2024-09-21T21:36:46.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.082+0000 7f555affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x171be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.082+0000 7f555affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x171be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34984/0 (socket says 172.21.15.5:34984) 2024-09-21T21:36:46.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.082+0000 7f555affd640 1 -- 172.21.15.5:0/1588068094 learned_addr learned my addr 172.21.15.5:0/1588068094 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.083+0000 7f555affd640 1 -- 172.21.15.5:0/1588068094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1591920 con 0x169fbe0 2024-09-21T21:36:46.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.083+0000 7f555affd640 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x171be80 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.083+0000 7f5558ff9640 1 -- 172.21.15.5:0/1588068094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f554c03b040 con 0x169fbe0 2024-09-21T21:36:46.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.083+0000 7f5558ff9640 1 -- 172.21.15.5:0/1588068094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f554c035590 con 0x169fbe0 2024-09-21T21:36:46.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.083+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1591380 con 0x169fbe0 2024-09-21T21:36:46.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.083+0000 7f5558ff9640 1 -- 172.21.15.5:0/1588068094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f554c02dc20 con 0x169fbe0 2024-09-21T21:36:46.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.083+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x171e350 con 0x169fbe0 2024-09-21T21:36:46.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.084+0000 7f5558ff9640 1 -- 172.21.15.5:0/1588068094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f554c0413e0 con 0x169fbe0 2024-09-21T21:36:46.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.084+0000 7f5558ff9640 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f553c03d360 0x7f553c03f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.084+0000 7f5558ff9640 1 -- 172.21.15.5:0/1588068094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7f554c076700 con 0x169fbe0 2024-09-21T21:36:46.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.085+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1588068094 >> v2:172.21.15.5:6801/1340303177 conn(0x16a0530 0x17c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.088 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.085+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 199.7 199:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x171f7b0 con 0x16a0530 2024-09-21T21:36:46.088 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.085+0000 7f5553fff640 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f553c03d360 0x7f553c03f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.088 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.085+0000 7f5553fff640 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f553c03d360 0x7f553c03f870 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.088 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.086+0000 7f555b7fe640 1 --2- 172.21.15.5:0/1588068094 >> v2:172.21.15.5:6801/1340303177 conn(0x16a0530 0x17c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.091 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.089+0000 7f555b7fe640 1 --2- 172.21.15.5:0/1588068094 >> v2:172.21.15.5:6801/1340303177 conn(0x16a0530 0x17c47d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.108 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.104+0000 7f555b7fe640 1 -- 172.21.15.5:0/1588068094 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f555400a430 con 0x16a0530 2024-09-21T21:36:46.108 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.104+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 >> v2:172.21.15.5:6801/1340303177 conn(0x16a0530 msgr2=0x17c47d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.108 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.104+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1588068094 >> v2:172.21.15.5:6801/1340303177 conn(0x16a0530 0x17c47d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f553c03d360 msgr2=0x7f553c03f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f553c03d360 0x7f553c03f870 crc :-1 s=READY pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 msgr2=0x171be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x171be80 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 shutdown_connections 2024-09-21T21:36:46.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1588068094 >> v2:172.21.15.5:6801/1340303177 conn(0x16a0530 0x17c47d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f553c03d360 0x7f553c03f870 unknown :-1 s=CLOSED pgs=3810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 --2- 172.21.15.5:0/1588068094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x169fbe0 0x171be80 unknown :-1 s=CLOSED pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 >> 172.21.15.5:0/1588068094 conn(0x15c3770 msgr2=0x16986d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 shutdown_connections 2024-09-21T21:36:46.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.105+0000 7f5567743ec0 1 -- 172.21.15.5:0/1588068094 wait complete. 2024-09-21T21:36:46.111 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.111 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj2 /etc/passwd 2024-09-21T21:36:46.152 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.150+0000 7f2672c31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.158 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.156+0000 7f2672c31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.158 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.156+0000 7f2672c31ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.159 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.157+0000 7f2672c31ec0 1 Processor -- start 2024-09-21T21:36:46.159 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.157+0000 7f2672c31ec0 1 -- start start 2024-09-21T21:36:46.161 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.159+0000 7f2672c31ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf146d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.161 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.159+0000 7f2672c31ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xe79520 con 0xf157e0 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.159+0000 7f266ac3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.159+0000 7f266ac3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf146d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35002/0 (socket says 172.21.15.5:35002) 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.159+0000 7f266ac3f640 1 -- 172.21.15.5:0/4216627845 learned_addr learned my addr 172.21.15.5:0/4216627845 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.159+0000 7f266ac3f640 1 -- 172.21.15.5:0/4216627845 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe15e10 con 0xf157e0 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.160+0000 7f266ac3f640 1 --2- 172.21.15.5:0/4216627845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf146d0 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77019df8ba4fd74b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.160+0000 7f266943c640 1 -- 172.21.15.5:0/4216627845 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f265402db00 con 0xf157e0 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.160+0000 7f266943c640 1 -- 172.21.15.5:0/4216627845 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f265402dc60 con 0xf157e0 2024-09-21T21:36:46.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.160+0000 7f266943c640 1 -- 172.21.15.5:0/4216627845 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f265402ddd0 con 0xf157e0 2024-09-21T21:36:46.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.161+0000 7f2672c31ec0 1 -- 172.21.15.5:0/4216627845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 msgr2=0xf146d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.161+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/4216627845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf146d0 crc :-1 s=READY pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.161+0000 7f2672c31ec0 1 -- 172.21.15.5:0/4216627845 shutdown_connections 2024-09-21T21:36:46.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.161+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/4216627845 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf146d0 unknown :-1 s=CLOSED pgs=12843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.161+0000 7f2672c31ec0 1 -- 172.21.15.5:0/4216627845 >> 172.21.15.5:0/4216627845 conn(0xe39770 msgr2=0xfa4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.161+0000 7f2672c31ec0 1 -- 172.21.15.5:0/4216627845 shutdown_connections 2024-09-21T21:36:46.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.161+0000 7f2672c31ec0 1 -- 172.21.15.5:0/4216627845 wait complete. 2024-09-21T21:36:46.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.162+0000 7f2672c31ec0 1 Processor -- start 2024-09-21T21:36:46.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.162+0000 7f2672c31ec0 1 -- start start 2024-09-21T21:36:46.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f2672c31ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf90810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f2672c31ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xe77280 con 0xf157e0 2024-09-21T21:36:46.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f266ac3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf90810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f266ac3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf90810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35018/0 (socket says 172.21.15.5:35018) 2024-09-21T21:36:46.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f266ac3f640 1 -- 172.21.15.5:0/709764315 learned_addr learned my addr 172.21.15.5:0/709764315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f266ac3f640 1 -- 172.21.15.5:0/709764315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xe07920 con 0xf157e0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f266ac3f640 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf90810 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f26637fe640 1 -- 172.21.15.5:0/709764315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2654005a80 con 0xf157e0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f26637fe640 1 -- 172.21.15.5:0/709764315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f265402d7d0 con 0xf157e0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.164+0000 7f26637fe640 1 -- 172.21.15.5:0/709764315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2654037a00 con 0xf157e0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.165+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xe07380 con 0xf157e0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.165+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xf902b0 con 0xf157e0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.166+0000 7f26637fe640 1 -- 172.21.15.5:0/709764315 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f2654003040 con 0xf157e0 2024-09-21T21:36:46.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.166+0000 7f26637fe640 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f265003d360 0x7f265003f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.166+0000 7f26637fe640 1 -- 172.21.15.5:0/709764315 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7f2654032040 con 0xf157e0 2024-09-21T21:36:46.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.166+0000 7f266a43e640 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f265003d360 0x7f265003f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.166+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/709764315 >> v2:172.21.15.148:6805/1161645252 conn(0xfa7070 0xf11a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.166+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 199.8 199:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0xf12fa0 con 0xfa7070 2024-09-21T21:36:46.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.167+0000 7f266a43e640 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f265003d360 0x7f265003f870 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.167+0000 7f266b440640 1 --2- 172.21.15.5:0/709764315 >> v2:172.21.15.148:6805/1161645252 conn(0xfa7070 0xf11a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.170+0000 7f266b440640 1 --2- 172.21.15.5:0/709764315 >> v2:172.21.15.148:6805/1161645252 conn(0xfa7070 0xf11a70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f266b440640 1 -- 172.21.15.5:0/709764315 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f265c00c430 con 0xfa7070 2024-09-21T21:36:46.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 >> v2:172.21.15.148:6805/1161645252 conn(0xfa7070 msgr2=0xf11a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/709764315 >> v2:172.21.15.148:6805/1161645252 conn(0xfa7070 0xf11a70 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f265003d360 msgr2=0x7f265003f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f265003d360 0x7f265003f870 crc :-1 s=READY pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 msgr2=0xf90810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf90810 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 shutdown_connections 2024-09-21T21:36:46.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/709764315 >> v2:172.21.15.148:6805/1161645252 conn(0xfa7070 0xf11a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.184+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f265003d360 0x7f265003f870 unknown :-1 s=CLOSED pgs=3811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.185+0000 7f2672c31ec0 1 --2- 172.21.15.5:0/709764315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xf157e0 0xf90810 unknown :-1 s=CLOSED pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.185+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 >> 172.21.15.5:0/709764315 conn(0xe39770 msgr2=0xfa4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.185+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 shutdown_connections 2024-09-21T21:36:46.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.185+0000 7f2672c31ec0 1 -- 172.21.15.5:0/709764315 wait complete. 2024-09-21T21:36:46.189 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.189 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj3 /etc/passwd 2024-09-21T21:36:46.232 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.231+0000 7f717c22bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.237+0000 7f717c22bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.237+0000 7f717c22bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.240 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.238+0000 7f717c22bec0 1 Processor -- start 2024-09-21T21:36:46.240 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.238+0000 7f717c22bec0 1 -- start start 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f717c22bec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f717c22bec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x6f2520 con 0x78ebe0 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35032/0 (socket says 172.21.15.5:35032) 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716f7fe640 1 -- 172.21.15.5:0/2111587636 learned_addr learned my addr 172.21.15.5:0/2111587636 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716f7fe640 1 -- 172.21.15.5:0/2111587636 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x68ee10 con 0x78ebe0 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716f7fe640 1 --2- 172.21.15.5:0/2111587636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80c840 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232aba9107d5dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716dffb640 1 -- 172.21.15.5:0/2111587636 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f716000b4a0 con 0x78ebe0 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716dffb640 1 -- 172.21.15.5:0/2111587636 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f716000b600 con 0x78ebe0 2024-09-21T21:36:46.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.240+0000 7f716dffb640 1 -- 172.21.15.5:0/2111587636 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f716000b8a0 con 0x78ebe0 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.241+0000 7f717c22bec0 1 -- 172.21.15.5:0/2111587636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 msgr2=0x80c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.241+0000 7f717c22bec0 1 --2- 172.21.15.5:0/2111587636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80c840 crc :-1 s=READY pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.241+0000 7f717c22bec0 1 -- 172.21.15.5:0/2111587636 shutdown_connections 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.241+0000 7f717c22bec0 1 --2- 172.21.15.5:0/2111587636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80c840 unknown :-1 s=CLOSED pgs=12847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.241+0000 7f717c22bec0 1 -- 172.21.15.5:0/2111587636 >> 172.21.15.5:0/2111587636 conn(0x6b2770 msgr2=0x788820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.241+0000 7f717c22bec0 1 -- 172.21.15.5:0/2111587636 shutdown_connections 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.241+0000 7f717c22bec0 1 -- 172.21.15.5:0/2111587636 wait complete. 2024-09-21T21:36:46.245 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.242+0000 7f717c22bec0 1 Processor -- start 2024-09-21T21:36:46.246 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.243+0000 7f717c22bec0 1 -- start start 2024-09-21T21:36:46.246 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.244+0000 7f717c22bec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.246 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.244+0000 7f717c22bec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x6f0280 con 0x78ebe0 2024-09-21T21:36:46.246 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.246 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35040/0 (socket says 172.21.15.5:35040) 2024-09-21T21:36:46.247 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716f7fe640 1 -- 172.21.15.5:0/1127372126 learned_addr learned my addr 172.21.15.5:0/1127372126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.247 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716f7fe640 1 -- 172.21.15.5:0/1127372126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x680920 con 0x78ebe0 2024-09-21T21:36:46.247 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716f7fe640 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80fae0 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.247 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716cff9640 1 -- 172.21.15.5:0/1127372126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7160012920 con 0x78ebe0 2024-09-21T21:36:46.248 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716cff9640 1 -- 172.21.15.5:0/1127372126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7160005040 con 0x78ebe0 2024-09-21T21:36:46.248 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x680380 con 0x78ebe0 2024-09-21T21:36:46.248 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f716cff9640 1 -- 172.21.15.5:0/1127372126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7160012bb0 con 0x78ebe0 2024-09-21T21:36:46.248 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.245+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x811430 con 0x78ebe0 2024-09-21T21:36:46.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.246+0000 7f716cff9640 1 -- 172.21.15.5:0/1127372126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f716000d040 con 0x78ebe0 2024-09-21T21:36:46.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.246+0000 7f716cff9640 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f715c03d360 0x7f715c03f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.247+0000 7f716cff9640 1 -- 172.21.15.5:0/1127372126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7f716000a040 con 0x78ebe0 2024-09-21T21:36:46.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.247+0000 7f717c22bec0 1 --2- 172.21.15.5:0/1127372126 >> v2:172.21.15.5:6801/1340303177 conn(0x78f700 0xcb99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.247+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 199.1 199:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x813440 con 0x78f700 2024-09-21T21:36:46.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.247+0000 7f716effd640 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f715c03d360 0x7f715c03f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.247+0000 7f716effd640 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f715c03d360 0x7f715c03f870 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.251 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.249+0000 7f716ffff640 1 --2- 172.21.15.5:0/1127372126 >> v2:172.21.15.5:6801/1340303177 conn(0x78f700 0xcb99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.257 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.255+0000 7f716ffff640 1 --2- 172.21.15.5:0/1127372126 >> v2:172.21.15.5:6801/1340303177 conn(0x78f700 0xcb99e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.274 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f716ffff640 1 -- 172.21.15.5:0/1127372126 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f716800a430 con 0x78f700 2024-09-21T21:36:46.274 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 >> v2:172.21.15.5:6801/1340303177 conn(0x78f700 msgr2=0xcb99e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.274 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 --2- 172.21.15.5:0/1127372126 >> v2:172.21.15.5:6801/1340303177 conn(0x78f700 0xcb99e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.274 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f715c03d360 msgr2=0x7f715c03f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.274 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f715c03d360 0x7f715c03f870 crc :-1 s=READY pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.274 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 msgr2=0x80fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80fae0 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 shutdown_connections 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 --2- 172.21.15.5:0/1127372126 >> v2:172.21.15.5:6801/1340303177 conn(0x78f700 0xcb99e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f715c03d360 0x7f715c03f870 unknown :-1 s=CLOSED pgs=3812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 --2- 172.21.15.5:0/1127372126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x78ebe0 0x80fae0 unknown :-1 s=CLOSED pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 >> 172.21.15.5:0/1127372126 conn(0x6b2770 msgr2=0x788820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 shutdown_connections 2024-09-21T21:36:46.275 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.272+0000 7f717c22bec0 1 -- 172.21.15.5:0/1127372126 wait complete. 2024-09-21T21:36:46.277 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.277 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj4 /etc/passwd 2024-09-21T21:36:46.316 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.314+0000 7fa3056f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.322 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.320+0000 7fa3056f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.322 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.320+0000 7fa3056f3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.323 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.321+0000 7fa3056f3ec0 1 Processor -- start 2024-09-21T21:36:46.323 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.321+0000 7fa3056f3ec0 1 -- start start 2024-09-21T21:36:46.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.323+0000 7fa3056f3ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13c75f0 0x14e8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.323+0000 7fa3056f3ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1333520 con 0x13c75f0 2024-09-21T21:36:46.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.323+0000 7fa2fda3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13c75f0 0x14e8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.323+0000 7fa2fda3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13c75f0 0x14e8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35052/0 (socket says 172.21.15.5:35052) 2024-09-21T21:36:46.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.323+0000 7fa2fda3f640 1 -- 172.21.15.5:0/4274232362 learned_addr learned my addr 172.21.15.5:0/4274232362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.326 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.323+0000 7fa2fda3f640 1 -- 172.21.15.5:0/4274232362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12cfe10 con 0x13c75f0 2024-09-21T21:36:46.326 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.323+0000 7fa2fda3f640 1 --2- 172.21.15.5:0/4274232362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13c75f0 0x14e8b80 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b879e129b193173 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.326 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa2f77fe640 1 -- 172.21.15.5:0/4274232362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2e800c5e0 con 0x13c75f0 2024-09-21T21:36:46.326 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa2f77fe640 1 -- 172.21.15.5:0/4274232362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa2e800c740 con 0x13c75f0 2024-09-21T21:36:46.326 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa2f77fe640 1 -- 172.21.15.5:0/4274232362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2e800c9e0 con 0x13c75f0 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/4274232362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13c75f0 msgr2=0x14e8b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/4274232362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13c75f0 0x14e8b80 crc :-1 s=READY pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/4274232362 shutdown_connections 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/4274232362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13c75f0 0x14e8b80 unknown :-1 s=CLOSED pgs=12851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/4274232362 >> 172.21.15.5:0/4274232362 conn(0x12f3770 msgr2=0x13cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/4274232362 shutdown_connections 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.324+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/4274232362 wait complete. 2024-09-21T21:36:46.327 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.325+0000 7fa3056f3ec0 1 Processor -- start 2024-09-21T21:36:46.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.325+0000 7fa3056f3ec0 1 -- start start 2024-09-21T21:36:46.329 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa3056f3ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13d1450 0x14ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.329 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa3056f3ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1331280 con 0x13d1450 2024-09-21T21:36:46.329 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa2fda3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13d1450 0x14ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.329 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa2fda3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13d1450 0x14ec2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35054/0 (socket says 172.21.15.5:35054) 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa2fda3f640 1 -- 172.21.15.5:0/2057684540 learned_addr learned my addr 172.21.15.5:0/2057684540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa2fda3f640 1 -- 172.21.15.5:0/2057684540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12c1920 con 0x13d1450 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa2fda3f640 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13d1450 0x14ec2e0 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa2f67fc640 1 -- 172.21.15.5:0/2057684540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2e8013aa0 con 0x13d1450 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa2f67fc640 1 -- 172.21.15.5:0/2057684540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa2e8013c00 con 0x13d1450 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.327+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x12c1380 con 0x13d1450 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.328+0000 7fa2f67fc640 1 -- 172.21.15.5:0/2057684540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2e8013ea0 con 0x13d1450 2024-09-21T21:36:46.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.328+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x14ed230 con 0x13d1450 2024-09-21T21:36:46.331 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.328+0000 7fa2f67fc640 1 -- 172.21.15.5:0/2057684540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fa2e8010400 con 0x13d1450 2024-09-21T21:36:46.331 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.329+0000 7fa2f67fc640 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e403d360 0x7fa2e403f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.331 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.329+0000 7fa2f67fc640 1 -- 172.21.15.5:0/2057684540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7fa2e8008040 con 0x13d1450 2024-09-21T21:36:46.331 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.329+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/2057684540 >> v2:172.21.15.5:6804/1102615197 conn(0x14f4910 0x14f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.329+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:1 199.0 199:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x14eccd0 con 0x14f4910 2024-09-21T21:36:46.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.329+0000 7fa2fd23e640 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e403d360 0x7fa2e403f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.330+0000 7fa2fd23e640 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e403d360 0x7fa2e403f870 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.330+0000 7fa2fe240640 1 --2- 172.21.15.5:0/2057684540 >> v2:172.21.15.5:6804/1102615197 conn(0x14f4910 0x14f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.334 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.332+0000 7fa2fe240640 1 --2- 172.21.15.5:0/2057684540 >> v2:172.21.15.5:6804/1102615197 conn(0x14f4910 0x14f4d20 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa2fe240640 1 -- 172.21.15.5:0/2057684540 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa2f000a430 con 0x14f4910 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 >> v2:172.21.15.5:6804/1102615197 conn(0x14f4910 msgr2=0x14f4d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/2057684540 >> v2:172.21.15.5:6804/1102615197 conn(0x14f4910 0x14f4d20 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e403d360 msgr2=0x7fa2e403f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e403d360 0x7fa2e403f870 crc :-1 s=READY pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13d1450 msgr2=0x14ec2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13d1450 0x14ec2e0 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 shutdown_connections 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/2057684540 >> v2:172.21.15.5:6804/1102615197 conn(0x14f4910 0x14f4d20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e403d360 0x7fa2e403f870 unknown :-1 s=CLOSED pgs=3813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.360 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 --2- 172.21.15.5:0/2057684540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13d1450 0x14ec2e0 unknown :-1 s=CLOSED pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.360 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 >> 172.21.15.5:0/2057684540 conn(0x12f3770 msgr2=0x13cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.360 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 shutdown_connections 2024-09-21T21:36:46.360 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.356+0000 7fa3056f3ec0 1 -- 172.21.15.5:0/2057684540 wait complete. 2024-09-21T21:36:46.361 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.361 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj5 /etc/passwd 2024-09-21T21:36:46.399 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.398+0000 7f39712e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.405 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.404+0000 7f39712e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.405 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.404+0000 7f39712e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.406 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.405+0000 7f39712e4ec0 1 Processor -- start 2024-09-21T21:36:46.406 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.405+0000 7f39712e4ec0 1 -- start start 2024-09-21T21:36:46.408 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.406+0000 7f39712e4ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23df840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.408 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.406+0000 7f39712e4ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x22c5520 con 0x2361be0 2024-09-21T21:36:46.408 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.406+0000 7f396963f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.408 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.406+0000 7f396963f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23df840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35072/0 (socket says 172.21.15.5:35072) 2024-09-21T21:36:46.409 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.406+0000 7f396963f640 1 -- 172.21.15.5:0/1763033824 learned_addr learned my addr 172.21.15.5:0/1763033824 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.409 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.406+0000 7f396963f640 1 -- 172.21.15.5:0/1763033824 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2261e10 con 0x2361be0 2024-09-21T21:36:46.409 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f396963f640 1 --2- 172.21.15.5:0/1763033824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23df840 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52ee697bf91eb83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.409 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f3962ffd640 1 -- 172.21.15.5:0/1763033824 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f395400c490 con 0x2361be0 2024-09-21T21:36:46.409 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f3962ffd640 1 -- 172.21.15.5:0/1763033824 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f395400c5f0 con 0x2361be0 2024-09-21T21:36:46.409 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f3962ffd640 1 -- 172.21.15.5:0/1763033824 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f395400c890 con 0x2361be0 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f39712e4ec0 1 -- 172.21.15.5:0/1763033824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 msgr2=0x23df840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/1763033824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23df840 crc :-1 s=READY pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f39712e4ec0 1 -- 172.21.15.5:0/1763033824 shutdown_connections 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/1763033824 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23df840 unknown :-1 s=CLOSED pgs=12855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f39712e4ec0 1 -- 172.21.15.5:0/1763033824 >> 172.21.15.5:0/1763033824 conn(0x2285770 msgr2=0x235b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f39712e4ec0 1 -- 172.21.15.5:0/1763033824 shutdown_connections 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.407+0000 7f39712e4ec0 1 -- 172.21.15.5:0/1763033824 wait complete. 2024-09-21T21:36:46.410 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.408+0000 7f39712e4ec0 1 Processor -- start 2024-09-21T21:36:46.411 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.408+0000 7f39712e4ec0 1 -- start start 2024-09-21T21:36:46.412 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.410+0000 7f39712e4ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.412 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.410+0000 7f39712e4ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x22c3280 con 0x2361be0 2024-09-21T21:36:46.412 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.410+0000 7f396963f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.410+0000 7f396963f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23e2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35076/0 (socket says 172.21.15.5:35076) 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.410+0000 7f396963f640 1 -- 172.21.15.5:0/2182386606 learned_addr learned my addr 172.21.15.5:0/2182386606 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.410+0000 7f396963f640 1 -- 172.21.15.5:0/2182386606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2253920 con 0x2361be0 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.410+0000 7f396963f640 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23e2b40 crc :-1 s=READY pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.411+0000 7f3961ffb640 1 -- 172.21.15.5:0/2182386606 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3954016040 con 0x2361be0 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.411+0000 7f3961ffb640 1 -- 172.21.15.5:0/2182386606 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3954011b00 con 0x2361be0 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.411+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2253380 con 0x2361be0 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.411+0000 7f3961ffb640 1 -- 172.21.15.5:0/2182386606 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3954011da0 con 0x2361be0 2024-09-21T21:36:46.413 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.411+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x23e5ce0 con 0x2361be0 2024-09-21T21:36:46.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.412+0000 7f3961ffb640 1 -- 172.21.15.5:0/2182386606 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f395400e440 con 0x2361be0 2024-09-21T21:36:46.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.412+0000 7f3961ffb640 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f395003d360 0x7f395003f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.412+0000 7f3961ffb640 1 -- 172.21.15.5:0/2182386606 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7f3954050650 con 0x2361be0 2024-09-21T21:36:46.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.412+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/2182386606 >> v2:172.21.15.148:6805/1161645252 conn(0x2362700 0x23e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.412+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 199.3 199:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x23f3110 con 0x2362700 2024-09-21T21:36:46.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.412+0000 7f3968e3e640 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f395003d360 0x7f395003f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.415 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.413+0000 7f3968e3e640 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f395003d360 0x7f395003f870 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.415 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.413+0000 7f3969e40640 1 --2- 172.21.15.5:0/2182386606 >> v2:172.21.15.148:6805/1161645252 conn(0x2362700 0x23e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.418 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.417+0000 7f3969e40640 1 --2- 172.21.15.5:0/2182386606 >> v2:172.21.15.148:6805/1161645252 conn(0x2362700 0x23e3590 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.433 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f3969e40640 1 -- 172.21.15.5:0/2182386606 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f395c00a430 con 0x2362700 2024-09-21T21:36:46.433 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 >> v2:172.21.15.148:6805/1161645252 conn(0x2362700 msgr2=0x23e3590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.433 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/2182386606 >> v2:172.21.15.148:6805/1161645252 conn(0x2362700 0x23e3590 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f395003d360 msgr2=0x7f395003f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f395003d360 0x7f395003f870 crc :-1 s=READY pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 msgr2=0x23e2b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23e2b40 crc :-1 s=READY pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 shutdown_connections 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/2182386606 >> v2:172.21.15.148:6805/1161645252 conn(0x2362700 0x23e3590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f395003d360 0x7f395003f870 unknown :-1 s=CLOSED pgs=3814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 --2- 172.21.15.5:0/2182386606 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x2361be0 0x23e2b40 unknown :-1 s=CLOSED pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 >> 172.21.15.5:0/2182386606 conn(0x2285770 msgr2=0x2364ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 shutdown_connections 2024-09-21T21:36:46.434 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.431+0000 7f39712e4ec0 1 -- 172.21.15.5:0/2182386606 wait complete. 2024-09-21T21:36:46.435 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.435 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj6 /etc/passwd 2024-09-21T21:36:46.472 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.470+0000 7f76f828eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.478 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.476+0000 7f76f828eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.478 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.476+0000 7f76f828eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.479 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.477+0000 7f76f828eec0 1 Processor -- start 2024-09-21T21:36:46.479 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.477+0000 7f76f828eec0 1 -- start start 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76f828eec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xe43720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76f828eec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xdac520 con 0xed99b0 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xe43720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xe43720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35096/0 (socket says 172.21.15.5:35096) 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76eb7fe640 1 -- 172.21.15.5:0/615545148 learned_addr learned my addr 172.21.15.5:0/615545148 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76eb7fe640 1 -- 172.21.15.5:0/615545148 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd48e10 con 0xed99b0 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76eb7fe640 1 --2- 172.21.15.5:0/615545148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xe43720 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a25d032e87ab167 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76e9ffb640 1 -- 172.21.15.5:0/615545148 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f76dc0061f0 con 0xed99b0 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76e9ffb640 1 -- 172.21.15.5:0/615545148 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f76dc0018f0 con 0xed99b0 2024-09-21T21:36:46.481 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.479+0000 7f76e9ffb640 1 -- 172.21.15.5:0/615545148 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f76dc001a60 con 0xed99b0 2024-09-21T21:36:46.482 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.480+0000 7f76f828eec0 1 -- 172.21.15.5:0/615545148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 msgr2=0xe43720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.480+0000 7f76f828eec0 1 --2- 172.21.15.5:0/615545148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xe43720 crc :-1 s=READY pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.480+0000 7f76f828eec0 1 -- 172.21.15.5:0/615545148 shutdown_connections 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.480+0000 7f76f828eec0 1 --2- 172.21.15.5:0/615545148 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xe43720 unknown :-1 s=CLOSED pgs=12859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.480+0000 7f76f828eec0 1 -- 172.21.15.5:0/615545148 >> 172.21.15.5:0/615545148 conn(0xd6c770 msgr2=0xe47b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.480+0000 7f76f828eec0 1 -- 172.21.15.5:0/615545148 shutdown_connections 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.480+0000 7f76f828eec0 1 -- 172.21.15.5:0/615545148 wait complete. 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.481+0000 7f76f828eec0 1 Processor -- start 2024-09-21T21:36:46.483 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.481+0000 7f76f828eec0 1 -- start start 2024-09-21T21:36:46.485 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.482+0000 7f76f828eec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xec4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.485 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.482+0000 7f76f828eec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xdaa280 con 0xed99b0 2024-09-21T21:36:46.485 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xec4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.485 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xec4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35106/0 (socket says 172.21.15.5:35106) 2024-09-21T21:36:46.485 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76eb7fe640 1 -- 172.21.15.5:0/267413457 learned_addr learned my addr 172.21.15.5:0/267413457 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.485 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76eb7fe640 1 -- 172.21.15.5:0/267413457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd3a920 con 0xed99b0 2024-09-21T21:36:46.486 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76eb7fe640 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xec4200 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.486 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76e8ff9640 1 -- 172.21.15.5:0/267413457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f76dc011d40 con 0xed99b0 2024-09-21T21:36:46.486 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76e8ff9640 1 -- 172.21.15.5:0/267413457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f76dc012330 con 0xed99b0 2024-09-21T21:36:46.486 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd3a380 con 0xed99b0 2024-09-21T21:36:46.486 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76e8ff9640 1 -- 172.21.15.5:0/267413457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f76dc011ea0 con 0xed99b0 2024-09-21T21:36:46.486 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.483+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xec5660 con 0xed99b0 2024-09-21T21:36:46.487 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.484+0000 7f76e8ff9640 1 -- 172.21.15.5:0/267413457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f76dc012620 con 0xed99b0 2024-09-21T21:36:46.487 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.484+0000 7f76e8ff9640 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f76cc03d360 0x7f76cc03f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.487 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.484+0000 7f76e8ff9640 1 -- 172.21.15.5:0/267413457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7f76dc04fbf0 con 0xed99b0 2024-09-21T21:36:46.487 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.485+0000 7f76eaffd640 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f76cc03d360 0x7f76cc03f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.487 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.485+0000 7f76f828eec0 1 --2- 172.21.15.5:0/267413457 >> v2:172.21.15.5:6801/1340303177 conn(0xedc700 0x1372920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.487 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.485+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 199.4 199:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0xec7a70 con 0xedc700 2024-09-21T21:36:46.487 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.485+0000 7f76eaffd640 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f76cc03d360 0x7f76cc03f870 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.488 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.486+0000 7f76f0b9c640 1 --2- 172.21.15.5:0/267413457 >> v2:172.21.15.5:6801/1340303177 conn(0xedc700 0x1372920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.491 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.489+0000 7f76f0b9c640 1 --2- 172.21.15.5:0/267413457 >> v2:172.21.15.5:6801/1340303177 conn(0xedc700 0x1372920 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.503+0000 7f76f0b9c640 1 -- 172.21.15.5:0/267413457 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f76e400c430 con 0xedc700 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.503+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 >> v2:172.21.15.5:6801/1340303177 conn(0xedc700 msgr2=0x1372920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.503+0000 7f76f828eec0 1 --2- 172.21.15.5:0/267413457 >> v2:172.21.15.5:6801/1340303177 conn(0xedc700 0x1372920 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f76cc03d360 msgr2=0x7f76cc03f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f76cc03d360 0x7f76cc03f870 crc :-1 s=READY pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 msgr2=0xec4200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xec4200 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 shutdown_connections 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 --2- 172.21.15.5:0/267413457 >> v2:172.21.15.5:6801/1340303177 conn(0xedc700 0x1372920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f76cc03d360 0x7f76cc03f870 unknown :-1 s=CLOSED pgs=3815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.506 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 --2- 172.21.15.5:0/267413457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xed99b0 0xec4200 unknown :-1 s=CLOSED pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.507 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 >> 172.21.15.5:0/267413457 conn(0xd6c770 msgr2=0xe45200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.507 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 shutdown_connections 2024-09-21T21:36:46.507 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.504+0000 7f76f828eec0 1 -- 172.21.15.5:0/267413457 wait complete. 2024-09-21T21:36:46.508 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.508 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj7 /etc/passwd 2024-09-21T21:36:46.545 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.544+0000 7f441df0dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.551 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.550+0000 7f441df0dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.551 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.550+0000 7f441df0dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.552 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.551+0000 7f441df0dec0 1 Processor -- start 2024-09-21T21:36:46.553 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.551+0000 7f441df0dec0 1 -- start start 2024-09-21T21:36:46.554 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.552+0000 7f441df0dec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x112a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.554 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.552+0000 7f441df0dec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xf6f520 con 0x109bcd0 2024-09-21T21:36:46.554 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.552+0000 7f441683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x112a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.555 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.552+0000 7f441683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x112a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35130/0 (socket says 172.21.15.5:35130) 2024-09-21T21:36:46.555 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.552+0000 7f441683f640 1 -- 172.21.15.5:0/472177842 learned_addr learned my addr 172.21.15.5:0/472177842 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.555 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.553+0000 7f441683f640 1 -- 172.21.15.5:0/472177842 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xf0be10 con 0x109bcd0 2024-09-21T21:36:46.555 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.553+0000 7f441683f640 1 --2- 172.21.15.5:0/472177842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x112a150 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f181320ced9f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.555 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.553+0000 7f441503c640 1 -- 172.21.15.5:0/472177842 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4400036040 con 0x109bcd0 2024-09-21T21:36:46.555 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.553+0000 7f441503c640 1 -- 172.21.15.5:0/472177842 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f44000310b0 con 0x109bcd0 2024-09-21T21:36:46.555 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.553+0000 7f441503c640 1 -- 172.21.15.5:0/472177842 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f440002d9a0 con 0x109bcd0 2024-09-21T21:36:46.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.554+0000 7f441df0dec0 1 -- 172.21.15.5:0/472177842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 msgr2=0x112a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.554+0000 7f441df0dec0 1 --2- 172.21.15.5:0/472177842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x112a150 crc :-1 s=READY pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.554+0000 7f441df0dec0 1 -- 172.21.15.5:0/472177842 shutdown_connections 2024-09-21T21:36:46.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.554+0000 7f441df0dec0 1 --2- 172.21.15.5:0/472177842 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x112a150 unknown :-1 s=CLOSED pgs=12863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.554+0000 7f441df0dec0 1 -- 172.21.15.5:0/472177842 >> 172.21.15.5:0/472177842 conn(0xf2f770 msgr2=0x100dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.554+0000 7f441df0dec0 1 -- 172.21.15.5:0/472177842 shutdown_connections 2024-09-21T21:36:46.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.554+0000 7f441df0dec0 1 -- 172.21.15.5:0/472177842 wait complete. 2024-09-21T21:36:46.557 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.555+0000 7f441df0dec0 1 Processor -- start 2024-09-21T21:36:46.557 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.555+0000 7f441df0dec0 1 -- start start 2024-09-21T21:36:46.558 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.556+0000 7f441df0dec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x109abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.556+0000 7f441df0dec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xf6d280 con 0x109bcd0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.556+0000 7f441683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x109abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.556+0000 7f441683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x109abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35138/0 (socket says 172.21.15.5:35138) 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.556+0000 7f441683f640 1 -- 172.21.15.5:0/983700343 learned_addr learned my addr 172.21.15.5:0/983700343 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.557+0000 7f441683f640 1 -- 172.21.15.5:0/983700343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xefd920 con 0x109bcd0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.557+0000 7f441683f640 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x109abe0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.557+0000 7f440ffff640 1 -- 172.21.15.5:0/983700343 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4400036040 con 0x109bcd0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.557+0000 7f440ffff640 1 -- 172.21.15.5:0/983700343 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4400037040 con 0x109bcd0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.557+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xefd380 con 0x109bcd0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.557+0000 7f440ffff640 1 -- 172.21.15.5:0/983700343 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4400031a80 con 0x109bcd0 2024-09-21T21:36:46.559 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.557+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x10057e0 con 0x109bcd0 2024-09-21T21:36:46.560 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.558+0000 7f440ffff640 1 -- 172.21.15.5:0/983700343 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f440003d3f0 con 0x109bcd0 2024-09-21T21:36:46.560 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.558+0000 7f440ffff640 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f43fc03d3b0 0x7f43fc03f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.560 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.558+0000 7f440ffff640 1 -- 172.21.15.5:0/983700343 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7f4400075880 con 0x109bcd0 2024-09-21T21:36:46.560 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.558+0000 7f441df0dec0 1 --2- 172.21.15.5:0/983700343 >> v2:172.21.15.5:6804/1102615197 conn(0x109c620 0x1004740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.561 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.558+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:1 199.9 199:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x10087c0 con 0x109c620 2024-09-21T21:36:46.561 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.558+0000 7f441603e640 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f43fc03d3b0 0x7f43fc03f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.561 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.559+0000 7f441603e640 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f43fc03d3b0 0x7f43fc03f8c0 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.561 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.559+0000 7f4417040640 1 --2- 172.21.15.5:0/983700343 >> v2:172.21.15.5:6804/1102615197 conn(0x109c620 0x1004740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.564 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.563+0000 7f4417040640 1 --2- 172.21.15.5:0/983700343 >> v2:172.21.15.5:6804/1102615197 conn(0x109c620 0x1004740 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.580 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.577+0000 7f4417040640 1 -- 172.21.15.5:0/983700343 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f440800c430 con 0x109c620 2024-09-21T21:36:46.580 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.577+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 >> v2:172.21.15.5:6804/1102615197 conn(0x109c620 msgr2=0x1004740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.580 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.577+0000 7f441df0dec0 1 --2- 172.21.15.5:0/983700343 >> v2:172.21.15.5:6804/1102615197 conn(0x109c620 0x1004740 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.580 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f43fc03d3b0 msgr2=0x7f43fc03f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.580 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f43fc03d3b0 0x7f43fc03f8c0 crc :-1 s=READY pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 msgr2=0x109abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x109abe0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 shutdown_connections 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 --2- 172.21.15.5:0/983700343 >> v2:172.21.15.5:6804/1102615197 conn(0x109c620 0x1004740 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f43fc03d3b0 0x7f43fc03f8c0 unknown :-1 s=CLOSED pgs=3816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 --2- 172.21.15.5:0/983700343 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x109bcd0 0x109abe0 unknown :-1 s=CLOSED pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 >> 172.21.15.5:0/983700343 conn(0xf2f770 msgr2=0x10a1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 shutdown_connections 2024-09-21T21:36:46.581 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.578+0000 7f441df0dec0 1 -- 172.21.15.5:0/983700343 wait complete. 2024-09-21T21:36:46.582 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.582 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj8 /etc/passwd 2024-09-21T21:36:46.621 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.619+0000 7f8d0cf1aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.626 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.625+0000 7f8d0cf1aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.627 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.625+0000 7f8d0cf1aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.627 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.626+0000 7f8d0cf1aec0 1 Processor -- start 2024-09-21T21:36:46.627 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.626+0000 7f8d0cf1aec0 1 -- start start 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.627+0000 7f8d0cf1aec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1cfa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.627+0000 7f8d0cf1aec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1bcd520 con 0x1c62650 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.627+0000 7f8d0523f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1cfa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.628+0000 7f8d0523f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1cfa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35156/0 (socket says 172.21.15.5:35156) 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.628+0000 7f8d0523f640 1 -- 172.21.15.5:0/3289524725 learned_addr learned my addr 172.21.15.5:0/3289524725 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.628+0000 7f8d0523f640 1 -- 172.21.15.5:0/3289524725 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b69e10 con 0x1c62650 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.628+0000 7f8d0523f640 1 --2- 172.21.15.5:0/3289524725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1cfa4a0 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54507dea8fb4c25e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.628+0000 7f8cfeffd640 1 -- 172.21.15.5:0/3289524725 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf002dcc0 con 0x1c62650 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.628+0000 7f8cfeffd640 1 -- 172.21.15.5:0/3289524725 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8cf0037370 con 0x1c62650 2024-09-21T21:36:46.630 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.628+0000 7f8cfeffd640 1 -- 172.21.15.5:0/3289524725 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf0037610 con 0x1c62650 2024-09-21T21:36:46.631 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.629+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/3289524725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 msgr2=0x1cfa4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.631 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.629+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/3289524725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1cfa4a0 crc :-1 s=READY pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.631 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.629+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/3289524725 shutdown_connections 2024-09-21T21:36:46.631 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.629+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/3289524725 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1cfa4a0 unknown :-1 s=CLOSED pgs=12867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.632 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.629+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/3289524725 >> 172.21.15.5:0/3289524725 conn(0x1b8d770 msgr2=0x1cf92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.632 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.629+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/3289524725 shutdown_connections 2024-09-21T21:36:46.632 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.629+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/3289524725 wait complete. 2024-09-21T21:36:46.632 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.630+0000 7f8d0cf1aec0 1 Processor -- start 2024-09-21T21:36:46.632 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.630+0000 7f8d0cf1aec0 1 -- start start 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.631+0000 7f8d0cf1aec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1d92cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.631+0000 7f8d0cf1aec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1bcb280 con 0x1c62650 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.631+0000 7f8d0523f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1d92cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.631+0000 7f8d0523f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1d92cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35166/0 (socket says 172.21.15.5:35166) 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.631+0000 7f8d0523f640 1 -- 172.21.15.5:0/1316407206 learned_addr learned my addr 172.21.15.5:0/1316407206 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.632+0000 7f8d0523f640 1 -- 172.21.15.5:0/1316407206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b5b920 con 0x1c62650 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.632+0000 7f8d0523f640 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1d92cd0 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.632+0000 7f8cfdffb640 1 -- 172.21.15.5:0/1316407206 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf003f040 con 0x1c62650 2024-09-21T21:36:46.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.632+0000 7f8cfdffb640 1 -- 172.21.15.5:0/1316407206 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8cf0037c50 con 0x1c62650 2024-09-21T21:36:46.635 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.632+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b5b380 con 0x1c62650 2024-09-21T21:36:46.635 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.632+0000 7f8cfdffb640 1 -- 172.21.15.5:0/1316407206 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8cf002dcc0 con 0x1c62650 2024-09-21T21:36:46.635 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.632+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1c51010 con 0x1c62650 2024-09-21T21:36:46.635 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.633+0000 7f8cfdffb640 1 -- 172.21.15.5:0/1316407206 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f8cf0039450 con 0x1c62650 2024-09-21T21:36:46.635 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.633+0000 7f8cfdffb640 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8cec03d310 0x7f8cec03f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.636 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.634+0000 7f8cfdffb640 1 -- 172.21.15.5:0/1316407206 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7f8cf0032040 con 0x1c62650 2024-09-21T21:36:46.636 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.634+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/1316407206 >> v2:172.21.15.148:6803/877610312 conn(0x1cf8a80 0x1c4fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.636 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.634+0000 7f8d04a3e640 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8cec03d310 0x7f8cec03f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.636 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.634+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 --> v2:172.21.15.148:6803/877610312 -- osd_op(unknown.0.0:1 199.5 199:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x1c502a0 con 0x1cf8a80 2024-09-21T21:36:46.636 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.634+0000 7f8d04a3e640 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8cec03d310 0x7f8cec03f820 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.636 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.635+0000 7f8d05a40640 1 --2- 172.21.15.5:0/1316407206 >> v2:172.21.15.148:6803/877610312 conn(0x1cf8a80 0x1c4fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.640 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.638+0000 7f8d05a40640 1 --2- 172.21.15.5:0/1316407206 >> v2:172.21.15.148:6803/877610312 conn(0x1cf8a80 0x1c4fd60 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.654 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d05a40640 1 -- 172.21.15.5:0/1316407206 <== osd.2 v2:172.21.15.148:6803/877610312 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8cf800a430 con 0x1cf8a80 2024-09-21T21:36:46.654 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 >> v2:172.21.15.148:6803/877610312 conn(0x1cf8a80 msgr2=0x1c4fd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.654 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/1316407206 >> v2:172.21.15.148:6803/877610312 conn(0x1cf8a80 0x1c4fd60 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.654 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8cec03d310 msgr2=0x7f8cec03f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.654 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8cec03d310 0x7f8cec03f820 crc :-1 s=READY pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.654 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 msgr2=0x1d92cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1d92cd0 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 shutdown_connections 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/1316407206 >> v2:172.21.15.148:6803/877610312 conn(0x1cf8a80 0x1c4fd60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8cec03d310 0x7f8cec03f820 unknown :-1 s=CLOSED pgs=3817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 --2- 172.21.15.5:0/1316407206 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c62650 0x1d92cd0 unknown :-1 s=CLOSED pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 >> 172.21.15.5:0/1316407206 conn(0x1b8d770 msgr2=0x1cf92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 shutdown_connections 2024-09-21T21:36:46.655 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.652+0000 7f8d0cf1aec0 1 -- 172.21.15.5:0/1316407206 wait complete. 2024-09-21T21:36:46.657 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.657 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj9 /etc/passwd 2024-09-21T21:36:46.694 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.693+0000 7fa5152faec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.700 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.698+0000 7fa5152faec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.700 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.698+0000 7fa5152faec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.701 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.699+0000 7fa5152faec0 1 Processor -- start 2024-09-21T21:36:46.701 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.699+0000 7fa5152faec0 1 -- start start 2024-09-21T21:36:46.703 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa5152faec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1518380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.703 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa5152faec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1362520 con 0x13fe240 2024-09-21T21:36:46.703 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa50d79b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1518380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.703 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa50d79b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1518380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35190/0 (socket says 172.21.15.5:35190) 2024-09-21T21:36:46.703 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa50d79b640 1 -- 172.21.15.5:0/1850866290 learned_addr learned my addr 172.21.15.5:0/1850866290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.703 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa50d79b640 1 -- 172.21.15.5:0/1850866290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12fee10 con 0x13fe240 2024-09-21T21:36:46.703 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa50d79b640 1 --2- 172.21.15.5:0/1850866290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1518380 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be0e22c82bf7acb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.704 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa506ffd640 1 -- 172.21.15.5:0/1850866290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa50002d840 con 0x13fe240 2024-09-21T21:36:46.704 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa506ffd640 1 -- 172.21.15.5:0/1850866290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa500037370 con 0x13fe240 2024-09-21T21:36:46.704 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.701+0000 7fa506ffd640 1 -- 172.21.15.5:0/1850866290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa500037610 con 0x13fe240 2024-09-21T21:36:46.704 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.702+0000 7fa5152faec0 1 -- 172.21.15.5:0/1850866290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 msgr2=0x1518380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.702+0000 7fa5152faec0 1 --2- 172.21.15.5:0/1850866290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1518380 crc :-1 s=READY pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.702+0000 7fa5152faec0 1 -- 172.21.15.5:0/1850866290 shutdown_connections 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.702+0000 7fa5152faec0 1 --2- 172.21.15.5:0/1850866290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1518380 unknown :-1 s=CLOSED pgs=12871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.702+0000 7fa5152faec0 1 -- 172.21.15.5:0/1850866290 >> 172.21.15.5:0/1850866290 conn(0x1322770 msgr2=0x1517410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.702+0000 7fa5152faec0 1 -- 172.21.15.5:0/1850866290 shutdown_connections 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.702+0000 7fa5152faec0 1 -- 172.21.15.5:0/1850866290 wait complete. 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.703+0000 7fa5152faec0 1 Processor -- start 2024-09-21T21:36:46.705 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.703+0000 7fa5152faec0 1 -- start start 2024-09-21T21:36:46.706 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa5152faec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1478e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa5152faec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1360280 con 0x13fe240 2024-09-21T21:36:46.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa50d79b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1478e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa50d79b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1478e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35194/0 (socket says 172.21.15.5:35194) 2024-09-21T21:36:46.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa50d79b640 1 -- 172.21.15.5:0/2423563813 learned_addr learned my addr 172.21.15.5:0/2423563813 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa50d79b640 1 -- 172.21.15.5:0/2423563813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12f0920 con 0x13fe240 2024-09-21T21:36:46.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa50d79b640 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1478e80 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa505ffb640 1 -- 172.21.15.5:0/2423563813 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa500037610 con 0x13fe240 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa505ffb640 1 -- 172.21.15.5:0/2423563813 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa50002d710 con 0x13fe240 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x12f0380 con 0x13fe240 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa505ffb640 1 -- 172.21.15.5:0/2423563813 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa500039580 con 0x13fe240 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.705+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x148c9b0 con 0x13fe240 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.706+0000 7fa505ffb640 1 -- 172.21.15.5:0/2423563813 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fa500039730 con 0x13fe240 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.707+0000 7fa505ffb640 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa4e803d360 0x7fa4e803f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.707+0000 7fa505ffb640 1 -- 172.21.15.5:0/2423563813 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7fa500032040 con 0x13fe240 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.707+0000 7fa5152faec0 1 --2- 172.21.15.5:0/2423563813 >> v2:172.21.15.5:6801/1340303177 conn(0x148f9b0 0x1524590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.707+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 199.7 199:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x147b640 con 0x148f9b0 2024-09-21T21:36:46.709 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.707+0000 7fa50cf9a640 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa4e803d360 0x7fa4e803f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.707+0000 7fa50cf9a640 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa4e803d360 0x7fa4e803f870 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.708+0000 7fa50df9c640 1 --2- 172.21.15.5:0/2423563813 >> v2:172.21.15.5:6801/1340303177 conn(0x148f9b0 0x1524590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.710+0000 7fa50df9c640 1 --2- 172.21.15.5:0/2423563813 >> v2:172.21.15.5:6801/1340303177 conn(0x148f9b0 0x1524590 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.724+0000 7fa50df9c640 1 -- 172.21.15.5:0/2423563813 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v698'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa4f800a430 con 0x148f9b0 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.724+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 >> v2:172.21.15.5:6801/1340303177 conn(0x148f9b0 msgr2=0x1524590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.724+0000 7fa5152faec0 1 --2- 172.21.15.5:0/2423563813 >> v2:172.21.15.5:6801/1340303177 conn(0x148f9b0 0x1524590 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.724+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa4e803d360 msgr2=0x7fa4e803f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa4e803d360 0x7fa4e803f870 crc :-1 s=READY pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 msgr2=0x1478e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1478e80 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 shutdown_connections 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 --2- 172.21.15.5:0/2423563813 >> v2:172.21.15.5:6801/1340303177 conn(0x148f9b0 0x1524590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa4e803d360 0x7fa4e803f870 unknown :-1 s=CLOSED pgs=3818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.727 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 --2- 172.21.15.5:0/2423563813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x13fe240 0x1478e80 unknown :-1 s=CLOSED pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.728 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 >> 172.21.15.5:0/2423563813 conn(0x1322770 msgr2=0x1517410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.728 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 shutdown_connections 2024-09-21T21:36:46.728 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.725+0000 7fa5152faec0 1 -- 172.21.15.5:0/2423563813 wait complete. 2024-09-21T21:36:46.729 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:36:46.729 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put obj10 /etc/passwd 2024-09-21T21:36:46.767 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.765+0000 7fdce1060ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.772 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.771+0000 7fdce1060ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.773 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.771+0000 7fdce1060ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:36:46.773 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.772+0000 7fdce1060ec0 1 Processor -- start 2024-09-21T21:36:46.773 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.772+0000 7fdce1060ec0 1 -- start start 2024-09-21T21:36:46.775 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.773+0000 7fdce1060ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x150e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.775 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.773+0000 7fdce1060ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x13f4520 con 0x1490be0 2024-09-21T21:36:46.775 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.773+0000 7fdcd919b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x150e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.775 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.773+0000 7fdcd919b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x150e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35218/0 (socket says 172.21.15.5:35218) 2024-09-21T21:36:46.775 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.773+0000 7fdcd919b640 1 -- 172.21.15.5:0/4067640137 learned_addr learned my addr 172.21.15.5:0/4067640137 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.775 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.774+0000 7fdcd919b640 1 -- 172.21.15.5:0/4067640137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1390e10 con 0x1490be0 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.774+0000 7fdcd919b640 1 --2- 172.21.15.5:0/4067640137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x150e840 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7433340fcaa70ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.774+0000 7fdcd2ffd640 1 -- 172.21.15.5:0/4067640137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcc4032040 con 0x1490be0 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.774+0000 7fdcd2ffd640 1 -- 172.21.15.5:0/4067640137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdcc4033040 con 0x1490be0 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.774+0000 7fdcd2ffd640 1 -- 172.21.15.5:0/4067640137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcc4034350 con 0x1490be0 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.775+0000 7fdce1060ec0 1 -- 172.21.15.5:0/4067640137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 msgr2=0x150e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.775+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/4067640137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x150e840 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.775+0000 7fdce1060ec0 1 -- 172.21.15.5:0/4067640137 shutdown_connections 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.775+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/4067640137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x150e840 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.775+0000 7fdce1060ec0 1 -- 172.21.15.5:0/4067640137 >> 172.21.15.5:0/4067640137 conn(0x13b4770 msgr2=0x148a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.775+0000 7fdce1060ec0 1 -- 172.21.15.5:0/4067640137 shutdown_connections 2024-09-21T21:36:46.777 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.775+0000 7fdce1060ec0 1 -- 172.21.15.5:0/4067640137 wait complete. 2024-09-21T21:36:46.778 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.776+0000 7fdce1060ec0 1 Processor -- start 2024-09-21T21:36:46.778 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.776+0000 7fdce1060ec0 1 -- start start 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.777+0000 7fdce1060ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x1511ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.777+0000 7fdce1060ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x13f2280 con 0x1490be0 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.777+0000 7fdcd919b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x1511ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.777+0000 7fdcd919b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x1511ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35220/0 (socket says 172.21.15.5:35220) 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.777+0000 7fdcd919b640 1 -- 172.21.15.5:0/2724969515 learned_addr learned my addr 172.21.15.5:0/2724969515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.778+0000 7fdcd919b640 1 -- 172.21.15.5:0/2724969515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1382920 con 0x1490be0 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.778+0000 7fdcd919b640 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x1511ab0 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.778+0000 7fdcd1ffb640 1 -- 172.21.15.5:0/2724969515 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcc4032040 con 0x1490be0 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.778+0000 7fdcd1ffb640 1 -- 172.21.15.5:0/2724969515 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdcc4034220 con 0x1490be0 2024-09-21T21:36:46.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.778+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1382380 con 0x1490be0 2024-09-21T21:36:46.781 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.778+0000 7fdcd1ffb640 1 -- 172.21.15.5:0/2724969515 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdcc4034ce0 con 0x1490be0 2024-09-21T21:36:46.781 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.778+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1515950 con 0x1490be0 2024-09-21T21:36:46.781 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.779+0000 7fdcd1ffb640 1 -- 172.21.15.5:0/2724969515 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fdcc403a400 con 0x1490be0 2024-09-21T21:36:46.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.779+0000 7fdcd1ffb640 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdcc003d360 0x7fdcc003f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.779+0000 7fdcd1ffb640 1 -- 172.21.15.5:0/2724969515 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(698..698 src has 1..698) ==== 3819+0+0 (crc 0 0 0) 0x7fdcc4073bf0 con 0x1490be0 2024-09-21T21:36:46.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.779+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/2724969515 >> v2:172.21.15.5:6801/1340303177 conn(0x1491530 0x19bb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:36:46.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.779+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 199.b 199:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e698) -- 0x1514cc0 con 0x1491530 2024-09-21T21:36:46.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.780+0000 7fdcd899a640 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdcc003d360 0x7fdcc003f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:36:46.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.780+0000 7fdcd899a640 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdcc003d360 0x7fdcc003f870 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.780+0000 7fdcd999c640 1 --2- 172.21.15.5:0/2724969515 >> v2:172.21.15.5:6801/1340303177 conn(0x1491530 0x19bb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:36:46.785 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.784+0000 7fdcd999c640 1 --2- 172.21.15.5:0/2724969515 >> v2:172.21.15.5:6801/1340303177 conn(0x1491530 0x19bb9e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.799+0000 7fdcd999c640 1 -- 172.21.15.5:0/2724969515 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v698'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fdccc00c430 con 0x1491530 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 >> v2:172.21.15.5:6801/1340303177 conn(0x1491530 msgr2=0x19bb9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/2724969515 >> v2:172.21.15.5:6801/1340303177 conn(0x1491530 0x19bb9e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdcc003d360 msgr2=0x7fdcc003f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdcc003d360 0x7fdcc003f870 crc :-1 s=READY pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 msgr2=0x1511ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x1511ab0 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.802 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 shutdown_connections 2024-09-21T21:36:46.803 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/2724969515 >> v2:172.21.15.5:6801/1340303177 conn(0x1491530 0x19bb9e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.803 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdcc003d360 0x7fdcc003f870 unknown :-1 s=CLOSED pgs=3819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.803 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 --2- 172.21.15.5:0/2724969515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1490be0 0x1511ab0 unknown :-1 s=CLOSED pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:36:46.803 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 >> 172.21.15.5:0/2724969515 conn(0x13b4770 msgr2=0x148a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:36:46.803 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 shutdown_connections 2024-09-21T21:36:46.803 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:36:46.800+0000 7fdce1060ec0 1 -- 172.21.15.5:0/2724969515 wait complete. 2024-09-21T21:36:46.804 INFO:tasks.workunit.client.0.smithi005.stderr:+ sleep 30 2024-09-21T21:37:16.807 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=96144 2024-09-21T21:37:16.807 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota e9819043-ddba-4507-b76c-4ec545d96daf max_objects 100 2024-09-21T21:37:16.807 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put onemore /etc/passwd 2024-09-21T21:37:16.852 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.851+0000 7fa851cf3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:16.859 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.857+0000 7fa851cf3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:16.859 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.858+0000 7fa851cf3ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:16.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.859+0000 7fa851cf3ec0 1 Processor -- start 2024-09-21T21:37:16.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.859+0000 7fa851cf3ec0 1 -- start start 2024-09-21T21:37:16.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.860+0000 7fa851cf3ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa364a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:16.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.860+0000 7fa851cf3ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x90a520 con 0x99fe20 2024-09-21T21:37:16.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.860+0000 7fa84a03f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:16.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.860+0000 7fa84a03f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa364a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45594/0 (socket says 172.21.15.5:45594) 2024-09-21T21:37:16.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.860+0000 7fa84a03f640 1 -- 172.21.15.5:0/4144318160 learned_addr learned my addr 172.21.15.5:0/4144318160 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:16.863 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.861+0000 7fa84a03f640 1 -- 172.21.15.5:0/4144318160 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8a6e10 con 0x99fe20 2024-09-21T21:37:16.863 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.861+0000 7fa84a03f640 1 --2- 172.21.15.5:0/4144318160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa364a0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc45e4aad06c390 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:16.863 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.861+0000 7fa84883c640 1 -- 172.21.15.5:0/4144318160 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa83400c5e0 con 0x99fe20 2024-09-21T21:37:16.863 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.861+0000 7fa84883c640 1 -- 172.21.15.5:0/4144318160 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa83400c740 con 0x99fe20 2024-09-21T21:37:16.863 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.861+0000 7fa84883c640 1 -- 172.21.15.5:0/4144318160 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa83400c9e0 con 0x99fe20 2024-09-21T21:37:16.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.862+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/4144318160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 msgr2=0xa364a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:16.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.862+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/4144318160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa364a0 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:16.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.862+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/4144318160 shutdown_connections 2024-09-21T21:37:16.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.862+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/4144318160 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa364a0 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:16.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.862+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/4144318160 >> 172.21.15.5:0/4144318160 conn(0x8ca770 msgr2=0x9a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:16.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.862+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/4144318160 shutdown_connections 2024-09-21T21:37:16.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.862+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/4144318160 wait complete. 2024-09-21T21:37:16.865 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.864+0000 7fa851cf3ec0 1 Processor -- start 2024-09-21T21:37:16.865 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.864+0000 7fa851cf3ec0 1 -- start start 2024-09-21T21:37:16.867 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.865+0000 7fa851cf3ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa237a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:16.867 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.865+0000 7fa851cf3ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x908280 con 0x99fe20 2024-09-21T21:37:16.867 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.866+0000 7fa84a03f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:16.867 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.866+0000 7fa84a03f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa237a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45606/0 (socket says 172.21.15.5:45606) 2024-09-21T21:37:16.867 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.866+0000 7fa84a03f640 1 -- 172.21.15.5:0/3217496155 learned_addr learned my addr 172.21.15.5:0/3217496155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:16.868 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.866+0000 7fa84a03f640 1 -- 172.21.15.5:0/3217496155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x898920 con 0x99fe20 2024-09-21T21:37:16.868 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.866+0000 7fa84a03f640 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa237a0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:16.869 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.866+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa834013aa0 con 0x99fe20 2024-09-21T21:37:16.869 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.867+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x898380 con 0x99fe20 2024-09-21T21:37:16.869 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.867+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa834013c00 con 0x99fe20 2024-09-21T21:37:16.869 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.867+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa834013ea0 con 0x99fe20 2024-09-21T21:37:16.869 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.867+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa32910 con 0x99fe20 2024-09-21T21:37:16.869 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.868+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fa834010400 con 0x99fe20 2024-09-21T21:37:16.870 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.868+0000 7fa842ffd640 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa83003d310 0x7fa83003f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:16.870 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.868+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(700..700 src has 1..700) ==== 3819+0+0 (crc 0 0 0) 0x7fa834008040 con 0x99fe20 2024-09-21T21:37:16.870 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.868+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7fa8300435a0 con 0x99fe20 2024-09-21T21:37:16.870 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.869+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/3217496155 >> v2:172.21.15.148:6803/877610312 conn(0xa3ba10 0xa21450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:16.870 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.869+0000 7fa84983e640 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa83003d310 0x7fa83003f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:16.871 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.869+0000 7fa84983e640 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa83003d310 0x7fa83003f820 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:16.871 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.870+0000 7fa84a840640 1 --2- 172.21.15.5:0/3217496155 >> v2:172.21.15.148:6803/877610312 conn(0xa3ba10 0xa21450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:37:16.876 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.874+0000 7fa84a840640 1 --2- 172.21.15.5:0/3217496155 >> v2:172.21.15.148:6803/877610312 conn(0xa3ba10 0xa21450 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:16.919 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.908+0000 7f18330ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:16.920 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.918+0000 7f18330ec640 1 Processor -- start 2024-09-21T21:37:16.920 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.919+0000 7f18330ec640 1 -- start start 2024-09-21T21:37:16.922 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.920+0000 7f18330ec640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f182c06ea60 0x7f182c13b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:16.922 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.920+0000 7f18330ec640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f182c06f410 con 0x7f182c06df40 2024-09-21T21:37:16.922 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.920+0000 7f18330ec640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f182c0a7f90 con 0x7f182c06ea60 2024-09-21T21:37:16.922 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.920+0000 7f182bfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f182c06ea60 0x7f182c13b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:16.922 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.920+0000 7f1830e88640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f182c06df40 0x7f182c06e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:57770/0 (socket says 172.21.15.5:57770) 2024-09-21T21:37:16.922 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.920+0000 7f1830e88640 1 -- 172.21.15.5:0/228974348 learned_addr learned my addr 172.21.15.5:0/228974348 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.921+0000 7f182bfff640 1 -- 172.21.15.5:0/228974348 >> v1:172.21.15.5:6789/0 conn(0x7f182c06df40 legacy=0x7f182c06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.921+0000 7f182bfff640 1 -- 172.21.15.5:0/228974348 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c09da20 con 0x7f182c06ea60 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.921+0000 7f182bfff640 1 --2- 172.21.15.5:0/228974348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06ea60 0x7f182c13b300 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e647bce147d151 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.921+0000 7f182b7fe640 1 -- 172.21.15.5:0/228974348 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1820009d90 con 0x7f182c06ea60 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.921+0000 7f182b7fe640 1 -- 172.21.15.5:0/228974348 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f182000e230 con 0x7f182c06ea60 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.921+0000 7f182b7fe640 1 -- 172.21.15.5:0/228974348 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f182000e4d0 con 0x7f182c06ea60 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 1 -- 172.21.15.5:0/228974348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06ea60 msgr2=0x7f182c13b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 1 --2- 172.21.15.5:0/228974348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06ea60 0x7f182c13b300 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 1 -- 172.21.15.5:0/228974348 shutdown_connections 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 1 --2- 172.21.15.5:0/228974348 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06ea60 0x7f182c13b300 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 1 -- 172.21.15.5:0/228974348 >> 172.21.15.5:0/228974348 conn(0x7f182c0a5390 msgr2=0x7f182c0a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:16.924 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 1 -- 172.21.15.5:0/228974348 shutdown_connections 2024-09-21T21:37:16.925 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 1 -- 172.21.15.5:0/228974348 wait complete. 2024-09-21T21:37:16.925 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.922+0000 7f18330ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:16.925 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.924+0000 7f18330ec640 1 Processor -- start 2024-09-21T21:37:16.926 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.924+0000 7f18330ec640 1 -- start start 2024-09-21T21:37:16.928 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f18330ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06df40 0x7f182c126e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:16.928 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f18330ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f182c1256e0 con 0x7f182c06df40 2024-09-21T21:37:16.928 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f1830e88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06df40 0x7f182c126e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:16.928 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f1830e88640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06df40 0x7f182c126e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45620/0 (socket says 172.21.15.5:45620) 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f1830e88640 1 -- 172.21.15.5:0/3186279514 learned_addr learned my addr 172.21.15.5:0/3186279514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f1830e88640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c124e30 con 0x7f182c06df40 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f1830e88640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06df40 0x7f182c126e20 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f181c005a60 con 0x7f182c06df40 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f181c005bc0 con 0x7f182c06df40 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182c125f90 con 0x7f182c06df40 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f181c005e60 con 0x7f182c06df40 2024-09-21T21:37:16.929 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.926+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182c1266a0 con 0x7f182c06df40 2024-09-21T21:37:16.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.927+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182c06fd90 con 0x7f182c06df40 2024-09-21T21:37:16.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.927+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f181c00c7f0 con 0x7f182c06df40 2024-09-21T21:37:16.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.928+0000 7f18297fa640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f181803eb00 0x7f1818041010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:16.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.928+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(700..700 src has 1..700) ==== 3819+0+0 (crc 0 0 0) 0x7f181c04fce0 con 0x7f182c06df40 2024-09-21T21:37:16.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.928+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=701}) -- 0x7f1818044d90 con 0x7f182c06df40 2024-09-21T21:37:16.930 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.928+0000 7f182bfff640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f181803eb00 0x7f1818041010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:16.931 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.929+0000 7f182bfff640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f181803eb00 0x7f1818041010 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:16.935 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:16.933+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f181c00f230 con 0x7f182c06df40 2024-09-21T21:37:17.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:17.123+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "100"} v 0) -- 0x7f182c06f640 con 0x7f182c06df40 2024-09-21T21:37:18.013 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:18.011+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool e9819043-ddba-4507-b76c-4ec545d96daf v701) ==== 225+0+0 (crc 0 0 0) 0x7f181c00d610 con 0x7f182c06df40 2024-09-21T21:37:18.013 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:18.011+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(701..701 src has 1..701) ==== 628+0+0 (crc 0 0 0) 0x7f181c00d9b0 con 0x7f182c06df40 2024-09-21T21:37:18.013 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:18.011+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 6 ==== osd_map(701..701 src has 1..701) ==== 628+0+0 (crc 0 0 0) 0x7fa834009610 con 0x99fe20 2024-09-21T21:37:18.013 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:18.011+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7f1818045ca0 con 0x7f182c06df40 2024-09-21T21:37:18.014 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:18.011+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=702}) -- 0x7fa830043ce0 con 0x99fe20 2024-09-21T21:37:18.146 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:18.144+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "100"} v 0) -- 0x7f182c06f640 con 0x7f182c06df40 2024-09-21T21:37:19.017 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.015+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool e9819043-ddba-4507-b76c-4ec545d96daf v702) ==== 225+0+0 (crc 0 0 0) 0x7f181c00d7f0 con 0x7f182c06df40 2024-09-21T21:37:19.017 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_objects = 100 for pool e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:37:19.017 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.016+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 <== mon.0 v2:172.21.15.5:3300/0 10 ==== osd_map(702..702 src has 1..702) ==== 628+0+0 (crc 0 0 0) 0x7f181c00de40 con 0x7f182c06df40 2024-09-21T21:37:19.018 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.016+0000 7f18297fa640 1 -- 172.21.15.5:0/3186279514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7f1818045ef0 con 0x7f182c06df40 2024-09-21T21:37:19.018 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.016+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 7 ==== osd_map(702..702 src has 1..702) ==== 628+0+0 (crc 0 0 0) 0x7fa834011040 con 0x99fe20 2024-09-21T21:37:19.018 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.016+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=703}) -- 0x7fa830043f00 con 0x99fe20 2024-09-21T21:37:19.020 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f181803eb00 msgr2=0x7f1818041010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:19.020 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f181803eb00 0x7f1818041010 crc :-1 s=READY pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06df40 msgr2=0x7f182c126e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06df40 0x7f182c126e20 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 shutdown_connections 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f181803eb00 0x7f1818041010 unknown :-1 s=CLOSED pgs=3821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 --2- 172.21.15.5:0/3186279514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f182c06df40 0x7f182c126e20 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 >> 172.21.15.5:0/3186279514 conn(0x7f182c0a5390 msgr2=0x7f182c09fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 shutdown_connections 2024-09-21T21:37:19.021 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:19.019+0000 7f18330ec640 1 -- 172.21.15.5:0/3186279514 wait complete. 2024-09-21T21:37:19.037 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 96144 2024-09-21T21:37:21.000 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:20.997+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(703..703 src has 1..703) ==== 628+0+0 (crc 0 0 0) 0x7fa8340030d0 con 0x99fe20 2024-09-21T21:37:21.000 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:20.997+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=704}) -- 0x7fa830043f00 con 0x99fe20 2024-09-21T21:37:21.000 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:20.997+0000 7fa842ffd640 1 -- 172.21.15.5:0/3217496155 --> v2:172.21.15.148:6803/877610312 -- osd_op(unknown.0.0:1 199.5 199:b9ff7440:::onemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x7fa830044150 con 0xa3ba10 2024-09-21T21:37:21.048 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa84a840640 1 -- 172.21.15.5:0/3217496155 <== osd.2 v2:172.21.15.148:6803/877610312 1 ==== osd_op_reply(1 onemore [writefull 0~12875] v703'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7fa83c00a430 con 0xa3ba10 2024-09-21T21:37:21.048 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 >> v2:172.21.15.148:6803/877610312 conn(0xa3ba10 msgr2=0xa21450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.048 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/3217496155 >> v2:172.21.15.148:6803/877610312 conn(0xa3ba10 0xa21450 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.048 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa83003d310 msgr2=0x7fa83003f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.048 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa83003d310 0x7fa83003f820 crc :-1 s=READY pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 msgr2=0xa237a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa237a0 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 shutdown_connections 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/3217496155 >> v2:172.21.15.148:6803/877610312 conn(0xa3ba10 0xa21450 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa83003d310 0x7fa83003f820 unknown :-1 s=CLOSED pgs=3820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 --2- 172.21.15.5:0/3217496155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x99fe20 0xa237a0 unknown :-1 s=CLOSED pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 >> 172.21.15.5:0/3217496155 conn(0x8ca770 msgr2=0x9a8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 shutdown_connections 2024-09-21T21:37:21.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.046+0000 7fa851cf3ec0 1 -- 172.21.15.5:0/3217496155 wait complete. 2024-09-21T21:37:21.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T21:37:21.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ true 2024-09-21T21:37:21.051 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put twomore /etc/passwd 2024-09-21T21:37:21.092 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.090+0000 7fc58db2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:21.097 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.096+0000 7fc58db2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:21.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.096+0000 7fc58db2eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:21.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.097+0000 7fc58db2eec0 1 Processor -- start 2024-09-21T21:37:21.099 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.097+0000 7fc58db2eec0 1 -- start start 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.098+0000 7fc58db2eec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x7c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.098+0000 7fc58db2eec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x72b520 con 0x7c77c0 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.098+0000 7fc585e3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x7c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.099+0000 7fc585e3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x7c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51526/0 (socket says 172.21.15.5:51526) 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.099+0000 7fc585e3f640 1 -- 172.21.15.5:0/1208643370 learned_addr learned my addr 172.21.15.5:0/1208643370 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.099+0000 7fc585e3f640 1 -- 172.21.15.5:0/1208643370 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6c7e10 con 0x7c77c0 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.099+0000 7fc585e3f640 1 --2- 172.21.15.5:0/1208643370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x7c1ee0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8eb3ba9b3c7c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.099+0000 7fc57f7fe640 1 -- 172.21.15.5:0/1208643370 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc5700061e0 con 0x7c77c0 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.099+0000 7fc57f7fe640 1 -- 172.21.15.5:0/1208643370 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc570006340 con 0x7c77c0 2024-09-21T21:37:21.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.099+0000 7fc57f7fe640 1 -- 172.21.15.5:0/1208643370 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc570004880 con 0x7c77c0 2024-09-21T21:37:21.102 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.100+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1208643370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 msgr2=0x7c1ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.102 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.100+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1208643370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x7c1ee0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.102 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.100+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1208643370 shutdown_connections 2024-09-21T21:37:21.102 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.100+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1208643370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x7c1ee0 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.102 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.100+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1208643370 >> 172.21.15.5:0/1208643370 conn(0x6eb770 msgr2=0x858110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:21.102 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.100+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1208643370 shutdown_connections 2024-09-21T21:37:21.103 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.100+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1208643370 wait complete. 2024-09-21T21:37:21.103 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.101+0000 7fc58db2eec0 1 Processor -- start 2024-09-21T21:37:21.103 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.101+0000 7fc58db2eec0 1 -- start start 2024-09-21T21:37:21.104 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.102+0000 7fc58db2eec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x844320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:21.104 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.102+0000 7fc58db2eec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x729280 con 0x7c77c0 2024-09-21T21:37:21.105 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.102+0000 7fc585e3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x844320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:21.105 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc585e3f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x844320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51530/0 (socket says 172.21.15.5:51530) 2024-09-21T21:37:21.105 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc585e3f640 1 -- 172.21.15.5:0/1494825183 learned_addr learned my addr 172.21.15.5:0/1494825183 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:21.105 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc585e3f640 1 -- 172.21.15.5:0/1494825183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x6b9920 con 0x7c77c0 2024-09-21T21:37:21.105 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc585e3f640 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x844320 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:21.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc57e7fc640 1 -- 172.21.15.5:0/1494825183 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc570001aa0 con 0x7c77c0 2024-09-21T21:37:21.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc57e7fc640 1 -- 172.21.15.5:0/1494825183 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc570001c00 con 0x7c77c0 2024-09-21T21:37:21.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc57e7fc640 1 -- 172.21.15.5:0/1494825183 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc570001ea0 con 0x7c77c0 2024-09-21T21:37:21.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x6b9380 con 0x7c77c0 2024-09-21T21:37:21.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.103+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x8465d0 con 0x7c77c0 2024-09-21T21:37:21.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.104+0000 7fc57e7fc640 1 -- 172.21.15.5:0/1494825183 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fc570013340 con 0x7c77c0 2024-09-21T21:37:21.107 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.104+0000 7fc57e7fc640 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc56c03d360 0x7fc56c03f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:21.107 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.105+0000 7fc57e7fc640 1 -- 172.21.15.5:0/1494825183 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(703..703 src has 1..703) ==== 3819+0+0 (crc 0 0 0) 0x7fc57004f950 con 0x7c77c0 2024-09-21T21:37:21.107 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.105+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1494825183 >> v2:172.21.15.148:6805/1161645252 conn(0x85c890 0xcf2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:21.107 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.105+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 199.6 199:7019d845:::twomore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e703) -- 0x8472d0 con 0x85c890 2024-09-21T21:37:21.107 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.105+0000 7fc58563e640 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc56c03d360 0x7fc56c03f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:21.107 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.105+0000 7fc58563e640 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc56c03d360 0x7fc56c03f870 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:21.108 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.106+0000 7fc586640640 1 --2- 172.21.15.5:0/1494825183 >> v2:172.21.15.148:6805/1161645252 conn(0x85c890 0xcf2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:37:21.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.108+0000 7fc586640640 1 --2- 172.21.15.5:0/1494825183 >> v2:172.21.15.148:6805/1161645252 conn(0x85c890 0xcf2ab0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:21.124 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc586640640 1 -- 172.21.15.5:0/1494825183 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 twomore [writefull 0~12875] v703'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7fc57800c430 con 0x85c890 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 >> v2:172.21.15.148:6805/1161645252 conn(0x85c890 msgr2=0xcf2ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1494825183 >> v2:172.21.15.148:6805/1161645252 conn(0x85c890 0xcf2ab0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc56c03d360 msgr2=0x7fc56c03f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc56c03d360 0x7fc56c03f870 crc :-1 s=READY pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 msgr2=0x844320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x844320 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 shutdown_connections 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1494825183 >> v2:172.21.15.148:6805/1161645252 conn(0x85c890 0xcf2ab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc56c03d360 0x7fc56c03f870 unknown :-1 s=CLOSED pgs=3822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 --2- 172.21.15.5:0/1494825183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7c77c0 0x844320 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 >> 172.21.15.5:0/1494825183 conn(0x6eb770 msgr2=0x85b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 shutdown_connections 2024-09-21T21:37:21.125 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.122+0000 7fc58db2eec0 1 -- 172.21.15.5:0/1494825183 wait complete. 2024-09-21T21:37:21.127 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota e9819043-ddba-4507-b76c-4ec545d96daf max_bytes 100 2024-09-21T21:37:21.224 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.213+0000 7f5e3a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:21.225 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.224+0000 7f5e3a791640 1 Processor -- start 2024-09-21T21:37:21.225 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.224+0000 7f5e3a791640 1 -- start start 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.225+0000 7f5e3a791640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e340724f0 0x7f5e34139270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.225+0000 7f5e3a791640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e34073430 con 0x7f5e34074630 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.225+0000 7f5e3a791640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3409df40 con 0x7f5e340724f0 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.225+0000 7f5e337fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e340724f0 0x7f5e34139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e337fe640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e340724f0 0x7f5e34139270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51540/0 (socket says 172.21.15.5:51540) 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e33fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e34074630 0x7f5e34071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:36936/0 (socket says 172.21.15.5:36936) 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e337fe640 1 -- 172.21.15.5:0/1303572568 learned_addr learned my addr 172.21.15.5:0/1303572568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e337fe640 1 -- 172.21.15.5:0/1303572568 >> v1:172.21.15.5:6789/0 conn(0x7f5e34074630 legacy=0x7f5e34071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.228 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e337fe640 1 -- 172.21.15.5:0/1303572568 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e34073a40 con 0x7f5e340724f0 2024-09-21T21:37:21.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e32ffd640 1 -- 172.21.15.5:0/1303572568 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735829221 0 0) 0x7f5e34073430 con 0x7f5e34074630 2024-09-21T21:37:21.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e337fe640 1 --2- 172.21.15.5:0/1303572568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34139270 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f639dc05c8547a70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:21.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e32ffd640 1 -- 172.21.15.5:0/1303572568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e28009e50 con 0x7f5e340724f0 2024-09-21T21:37:21.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e32ffd640 1 -- 172.21.15.5:0/1303572568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5e2800e230 con 0x7f5e340724f0 2024-09-21T21:37:21.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.226+0000 7f5e32ffd640 1 -- 172.21.15.5:0/1303572568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e2800e4d0 con 0x7f5e340724f0 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 1 -- 172.21.15.5:0/1303572568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 msgr2=0x7f5e34139270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 1 --2- 172.21.15.5:0/1303572568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34139270 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 1 -- 172.21.15.5:0/1303572568 shutdown_connections 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 1 --2- 172.21.15.5:0/1303572568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34139270 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 1 -- 172.21.15.5:0/1303572568 >> 172.21.15.5:0/1303572568 conn(0x7f5e340a3160 msgr2=0x7f5e340a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 1 -- 172.21.15.5:0/1303572568 shutdown_connections 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 1 -- 172.21.15.5:0/1303572568 wait complete. 2024-09-21T21:37:21.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.227+0000 7f5e3a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:21.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.229+0000 7f5e3a791640 1 Processor -- start 2024-09-21T21:37:21.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.229+0000 7f5e3a791640 1 -- start start 2024-09-21T21:37:21.233 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e3a791640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34121dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:21.233 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e3a791640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5e34123fa0 con 0x7f5e340724f0 2024-09-21T21:37:21.233 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34121dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:21.233 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e33fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34121dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51542/0 (socket says 172.21.15.5:51542) 2024-09-21T21:37:21.233 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e33fff640 1 -- 172.21.15.5:0/3060975248 learned_addr learned my addr 172.21.15.5:0/3060975248 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:21.233 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e33fff640 1 -- 172.21.15.5:0/3060975248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e34072df0 con 0x7f5e340724f0 2024-09-21T21:37:21.233 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e33fff640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34121dc0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:21.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e240059a0 con 0x7f5e340724f0 2024-09-21T21:37:21.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5e24005b00 con 0x7f5e340724f0 2024-09-21T21:37:21.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.231+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e34121ab0 con 0x7f5e340724f0 2024-09-21T21:37:21.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.232+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e24005da0 con 0x7f5e340724f0 2024-09-21T21:37:21.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.232+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e34121860 con 0x7f5e340724f0 2024-09-21T21:37:21.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.233+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f5e240070b0 con 0x7f5e340724f0 2024-09-21T21:37:21.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.233+0000 7f5e30ff9640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e2003ead0 0x7f5e20040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:21.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.233+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(703..703 src has 1..703) ==== 3819+0+0 (crc 0 0 0) 0x7f5e2404fce0 con 0x7f5e340724f0 2024-09-21T21:37:21.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.233+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e34072990 con 0x7f5e340724f0 2024-09-21T21:37:21.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.233+0000 7f5e337fe640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e2003ead0 0x7f5e20040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:21.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.234+0000 7f5e337fe640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e2003ead0 0x7f5e20040fe0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:21.240 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.239+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f5e2400f230 con 0x7f5e340724f0 2024-09-21T21:37:21.430 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:21.428+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "100"} v 0) -- 0x7f5e341256e0 con 0x7f5e340724f0 2024-09-21T21:37:22.025 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:22.023+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool e9819043-ddba-4507-b76c-4ec545d96daf v704) ==== 221+0+0 (crc 0 0 0) 0x7f5e2400d660 con 0x7f5e340724f0 2024-09-21T21:37:22.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:22.163+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "100"} v 0) -- 0x7f5e340008d0 con 0x7f5e340724f0 2024-09-21T21:37:23.026 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.025+0000 7f5e30ff9640 1 -- 172.21.15.5:0/3060975248 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool e9819043-ddba-4507-b76c-4ec545d96daf v705) ==== 221+0+0 (crc 0 0 0) 0x7f5e2400d840 con 0x7f5e340724f0 2024-09-21T21:37:23.027 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_bytes = 100 for pool e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:37:23.031 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e2003ead0 msgr2=0x7f5e20040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:23.031 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e2003ead0 0x7f5e20040fe0 crc :-1 s=READY pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:23.031 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 msgr2=0x7f5e34121dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:23.031 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34121dc0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:23.032 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 shutdown_connections 2024-09-21T21:37:23.032 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e2003ead0 0x7f5e20040fe0 unknown :-1 s=CLOSED pgs=3823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:23.032 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 --2- 172.21.15.5:0/3060975248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e340724f0 0x7f5e34121dc0 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:23.032 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.029+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 >> 172.21.15.5:0/3060975248 conn(0x7f5e340a3160 msgr2=0x7f5e340a4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:23.032 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.030+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 shutdown_connections 2024-09-21T21:37:23.032 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:23.030+0000 7f5e3a791640 1 -- 172.21.15.5:0/3060975248 wait complete. 2024-09-21T21:37:23.047 INFO:tasks.workunit.client.0.smithi005.stderr:+ sleep 30 2024-09-21T21:37:53.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ pid=96235 2024-09-21T21:37:53.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota e9819043-ddba-4507-b76c-4ec545d96daf max_bytes 0 2024-09-21T21:37:53.050 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put two /etc/passwd 2024-09-21T21:37:53.097 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.095+0000 7f8de6a2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:53.104 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.102+0000 7f8de6a2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:53.104 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.102+0000 7f8de6a2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:53.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.104+0000 7f8de6a2dec0 1 Processor -- start 2024-09-21T21:37:53.106 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.104+0000 7f8de6a2dec0 1 -- start start 2024-09-21T21:37:53.108 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.107+0000 7f8de6a2dec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x20a6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:53.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.107+0000 7f8de6a2dec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1ef1520 con 0x1f86650 2024-09-21T21:37:53.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.107+0000 7f8ddeb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x20a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:53.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.107+0000 7f8ddeb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x20a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48192/0 (socket says 172.21.15.5:48192) 2024-09-21T21:37:53.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.107+0000 7f8ddeb9b640 1 -- 172.21.15.5:0/2525317669 learned_addr learned my addr 172.21.15.5:0/2525317669 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:53.109 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.108+0000 7f8ddeb9b640 1 -- 172.21.15.5:0/2525317669 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e8de10 con 0x1f86650 2024-09-21T21:37:53.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.108+0000 7f8ddeb9b640 1 --2- 172.21.15.5:0/2525317669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x20a6520 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110a9db8dbc7959c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:53.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.108+0000 7f8ddd398640 1 -- 172.21.15.5:0/2525317669 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8dc802db90 con 0x1f86650 2024-09-21T21:37:53.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.108+0000 7f8ddd398640 1 -- 172.21.15.5:0/2525317669 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8dc802dcf0 con 0x1f86650 2024-09-21T21:37:53.110 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.108+0000 7f8ddd398640 1 -- 172.21.15.5:0/2525317669 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8dc80374a0 con 0x1f86650 2024-09-21T21:37:53.111 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.109+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/2525317669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 msgr2=0x20a6520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:53.111 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.109+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/2525317669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x20a6520 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:53.111 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.109+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/2525317669 shutdown_connections 2024-09-21T21:37:53.111 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.109+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/2525317669 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x20a6520 unknown :-1 s=CLOSED pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:53.111 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.109+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/2525317669 >> 172.21.15.5:0/2525317669 conn(0x1eb1770 msgr2=0x1f910c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:53.111 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.109+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/2525317669 shutdown_connections 2024-09-21T21:37:53.111 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.109+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/2525317669 wait complete. 2024-09-21T21:37:53.112 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.110+0000 7f8de6a2dec0 1 Processor -- start 2024-09-21T21:37:53.112 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.111+0000 7f8de6a2dec0 1 -- start start 2024-09-21T21:37:53.114 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.112+0000 7f8de6a2dec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x2018d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:53.114 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.112+0000 7f8de6a2dec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1eef280 con 0x1f86650 2024-09-21T21:37:53.114 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.112+0000 7f8ddeb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x2018d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:53.114 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.112+0000 7f8ddeb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x2018d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48194/0 (socket says 172.21.15.5:48194) 2024-09-21T21:37:53.114 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.112+0000 7f8ddeb9b640 1 -- 172.21.15.5:0/1278773774 learned_addr learned my addr 172.21.15.5:0/1278773774 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:53.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.113+0000 7f8ddeb9b640 1 -- 172.21.15.5:0/1278773774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e7f920 con 0x1f86650 2024-09-21T21:37:53.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.113+0000 7f8ddeb9b640 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x2018d50 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:53.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.113+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8dc802db90 con 0x1f86650 2024-09-21T21:37:53.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.113+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8dc80057c0 con 0x1f86650 2024-09-21T21:37:53.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.113+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8dc80374a0 con 0x1f86650 2024-09-21T21:37:53.115 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.113+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e7f380 con 0x1f86650 2024-09-21T21:37:53.116 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.113+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x201b140 con 0x1f86650 2024-09-21T21:37:53.116 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.114+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f8dc8039450 con 0x1f86650 2024-09-21T21:37:53.116 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.115+0000 7f8dd77fe640 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8db803d360 0x7f8db803f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:53.116 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.115+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(706..706 src has 1..706) ==== 3819+0+0 (crc 0 0 0) 0x7f8dc8032040 con 0x1f86650 2024-09-21T21:37:53.117 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.115+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f8db8043650 con 0x1f86650 2024-09-21T21:37:53.117 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.115+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/1278773774 >> v2:172.21.15.148:6805/1161645252 conn(0x201ca80 0x1f89570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:53.117 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.115+0000 7f8dde39a640 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8db803d360 0x7f8db803f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:53.117 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.116+0000 7f8dde39a640 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8db803d360 0x7f8db803f870 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:53.117 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.116+0000 7f8ddf39c640 1 --2- 172.21.15.5:0/1278773774 >> v2:172.21.15.148:6805/1161645252 conn(0x201ca80 0x1f89570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:37:53.123 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.121+0000 7f8ddf39c640 1 --2- 172.21.15.5:0/1278773774 >> v2:172.21.15.148:6805/1161645252 conn(0x201ca80 0x1f89570 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:53.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.151+0000 7f4a6cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:53.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.161+0000 7f4a6cb51640 1 Processor -- start 2024-09-21T21:37:53.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.161+0000 7f4a6cb51640 1 -- start start 2024-09-21T21:37:53.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.163+0000 7f4a6cb51640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6806df40 0x7f4a6806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:53.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.163+0000 7f4a6cb51640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6806f410 con 0x7f4a6806e890 2024-09-21T21:37:53.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.163+0000 7f4a6cb51640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4a680a7f90 con 0x7f4a6806df40 2024-09-21T21:37:53.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.163+0000 7f4a6659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6806df40 0x7f4a6806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:53.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.163+0000 7f4a65d9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f4a6806e890 0x7f4a68136050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45078/0 (socket says 172.21.15.5:45078) 2024-09-21T21:37:53.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.163+0000 7f4a65d9b640 1 -- 172.21.15.5:0/3004625061 learned_addr learned my addr 172.21.15.5:0/3004625061 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:37:53.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.163+0000 7f4a6659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4a6806df40 0x7f4a6806e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48210/0 (socket says 172.21.15.5:48210) 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.164+0000 7f4a6659c640 1 -- 172.21.15.5:0/3004625061 >> v1:172.21.15.5:6789/0 conn(0x7f4a6806e890 legacy=0x7f4a68136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.164+0000 7f4a6659c640 1 -- 172.21.15.5:0/3004625061 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6809da20 con 0x7f4a6806df40 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.164+0000 7f4a6559a640 1 -- 172.21.15.5:0/3004625061 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027461995 0 0) 0x7f4a6806f410 con 0x7f4a6806e890 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.164+0000 7f4a6659c640 1 --2- 172.21.15.5:0/3004625061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a6806e350 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0eb00afe55ec48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.164+0000 7f4a6559a640 1 -- 172.21.15.5:0/3004625061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a58009d90 con 0x7f4a6806df40 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.164+0000 7f4a6559a640 1 -- 172.21.15.5:0/3004625061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a5800e230 con 0x7f4a6806df40 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.164+0000 7f4a6559a640 1 -- 172.21.15.5:0/3004625061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a5800e4d0 con 0x7f4a6806df40 2024-09-21T21:37:53.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3004625061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 msgr2=0x7f4a6806e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:53.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 1 --2- 172.21.15.5:0/3004625061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a6806e350 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:53.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3004625061 shutdown_connections 2024-09-21T21:37:53.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 1 --2- 172.21.15.5:0/3004625061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a6806e350 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:53.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3004625061 >> 172.21.15.5:0/3004625061 conn(0x7f4a680a5390 msgr2=0x7f4a680a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:53.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3004625061 shutdown_connections 2024-09-21T21:37:53.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3004625061 wait complete. 2024-09-21T21:37:53.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.165+0000 7f4a6cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:53.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.167+0000 7f4a6cb51640 1 Processor -- start 2024-09-21T21:37:53.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.167+0000 7f4a6cb51640 1 -- start start 2024-09-21T21:37:53.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6cb51640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a68124260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:53.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6cb51640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4a681278d0 con 0x7f4a6806df40 2024-09-21T21:37:53.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a68124260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:53.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a68124260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48212/0 (socket says 172.21.15.5:48212) 2024-09-21T21:37:53.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6659c640 1 -- 172.21.15.5:0/3457531820 learned_addr learned my addr 172.21.15.5:0/3457531820 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:53.171 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6659c640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a68123f60 con 0x7f4a6806df40 2024-09-21T21:37:53.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6659c640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a68124260 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:53.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a58014620 con 0x7f4a6806df40 2024-09-21T21:37:53.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4a58014780 con 0x7f4a6806df40 2024-09-21T21:37:53.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a68125350 con 0x7f4a6806df40 2024-09-21T21:37:53.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4a58014a20 con 0x7f4a6806df40 2024-09-21T21:37:53.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.169+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a68123c50 con 0x7f4a6806df40 2024-09-21T21:37:53.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.170+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f4a58014bd0 con 0x7f4a6806df40 2024-09-21T21:37:53.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.171+0000 7f4a56ffd640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4a4803eb20 0x7f4a48041030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:53.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.171+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6806fd90 con 0x7f4a6806df40 2024-09-21T21:37:53.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.171+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(706..706 src has 1..706) ==== 3819+0+0 (crc 0 0 0) 0x7f4a58019040 con 0x7f4a6806df40 2024-09-21T21:37:53.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.171+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=707}) -- 0x7f4a48044db0 con 0x7f4a6806df40 2024-09-21T21:37:53.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.171+0000 7f4a65d9b640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4a4803eb20 0x7f4a48041030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:53.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.171+0000 7f4a65d9b640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4a4803eb20 0x7f4a48041030 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:53.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.176+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f4a58011570 con 0x7f4a6806df40 2024-09-21T21:37:53.372 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:53.370+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"} v 0) -- 0x7f4a6806d3f0 con 0x7f4a6806df40 2024-09-21T21:37:54.065 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:54.063+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v707) ==== 217+0+0 (crc 0 0 0) 0x7f4a58008f20 con 0x7f4a6806df40 2024-09-21T21:37:54.066 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:54.064+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 6 ==== osd_map(707..707 src has 1..707) ==== 628+0+0 (crc 0 0 0) 0x7f8dc8033210 con 0x1f86650 2024-09-21T21:37:54.066 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:54.064+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(707..707 src has 1..707) ==== 628+0+0 (crc 0 0 0) 0x7f4a58018710 con 0x7f4a6806df40 2024-09-21T21:37:54.066 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:54.064+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f4a48045c80 con 0x7f4a6806df40 2024-09-21T21:37:54.066 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:54.064+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=708}) -- 0x7f8db8043d90 con 0x1f86650 2024-09-21T21:37:54.199 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:54.197+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"} v 0) -- 0x7f4a68126cf0 con 0x7f4a6806df40 2024-09-21T21:37:55.067 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.065+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v708) ==== 217+0+0 (crc 0 0 0) 0x7f4a58018190 con 0x7f4a6806df40 2024-09-21T21:37:55.067 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_bytes = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:37:55.067 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.065+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 <== mon.0 v2:172.21.15.5:3300/0 10 ==== osd_map(708..708 src has 1..708) ==== 628+0+0 (crc 0 0 0) 0x7f4a5804d750 con 0x7f4a6806df40 2024-09-21T21:37:55.067 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.065+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 7 ==== osd_map(708..708 src has 1..708) ==== 628+0+0 (crc 0 0 0) 0x7f8dc802fde0 con 0x1f86650 2024-09-21T21:37:55.067 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.065+0000 7f4a56ffd640 1 -- 172.21.15.5:0/3457531820 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f4a48045e70 con 0x7f4a6806df40 2024-09-21T21:37:55.067 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.065+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f8db8044070 con 0x1f86650 2024-09-21T21:37:55.070 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4a4803eb20 msgr2=0x7f4a48041030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:55.070 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4a4803eb20 0x7f4a48041030 crc :-1 s=READY pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:55.070 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 msgr2=0x7f4a68124260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:55.070 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a68124260 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:55.071 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 shutdown_connections 2024-09-21T21:37:55.071 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4a4803eb20 0x7f4a48041030 unknown :-1 s=CLOSED pgs=3825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:55.071 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 --2- 172.21.15.5:0/3457531820 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4a6806df40 0x7f4a68124260 unknown :-1 s=CLOSED pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:55.071 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.068+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 >> 172.21.15.5:0/3457531820 conn(0x7f4a680a5390 msgr2=0x7f4a6809f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:55.071 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.069+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 shutdown_connections 2024-09-21T21:37:55.071 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.069+0000 7f4a6cb51640 1 -- 172.21.15.5:0/3457531820 wait complete. 2024-09-21T21:37:55.090 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota e9819043-ddba-4507-b76c-4ec545d96daf max_objects 0 2024-09-21T21:37:55.206 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.195+0000 7fa30ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:55.207 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.206+0000 7fa30ef91640 1 Processor -- start 2024-09-21T21:37:55.207 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.206+0000 7fa30ef91640 1 -- start start 2024-09-21T21:37:55.210 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.207+0000 7fa30ef91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa30806df40 0x7fa30806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:55.210 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.207+0000 7fa30ef91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa30806f410 con 0x7fa30806e890 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.207+0000 7fa30ef91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fa3080a7f90 con 0x7fa30806df40 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa30cd2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa30806df40 0x7fa30806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa30cd2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fa30806df40 0x7fa30806e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48220/0 (socket says 172.21.15.5:48220) 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa30cd2d640 1 -- 172.21.15.5:0/2615185722 learned_addr learned my addr 172.21.15.5:0/2615185722 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa307fff640 1 --1- 172.21.15.5:0/2615185722 >> v1:172.21.15.5:6789/0 conn(0x7fa30806e890 0x7fa308136050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45088/0 (socket says 172.21.15.5:45088) 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa30cd2d640 1 -- 172.21.15.5:0/2615185722 >> v1:172.21.15.5:6789/0 conn(0x7fa30806e890 legacy=0x7fa308136050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa30cd2d640 1 -- 172.21.15.5:0/2615185722 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30809da20 con 0x7fa30806df40 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa3077fe640 1 -- 172.21.15.5:0/2615185722 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1664699020 0 0) 0x7fa30806f410 con 0x7fa30806e890 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa30cd2d640 1 --2- 172.21.15.5:0/2615185722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa30806e350 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f858037b533d0513 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa3077fe640 1 -- 172.21.15.5:0/2615185722 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2f8009e50 con 0x7fa30806df40 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa3077fe640 1 -- 172.21.15.5:0/2615185722 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa2f800e230 con 0x7fa30806df40 2024-09-21T21:37:55.211 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.208+0000 7fa3077fe640 1 -- 172.21.15.5:0/2615185722 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2f800e4d0 con 0x7fa30806df40 2024-09-21T21:37:55.212 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.209+0000 7fa30ef91640 1 -- 172.21.15.5:0/2615185722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 msgr2=0x7fa30806e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:55.212 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.209+0000 7fa30ef91640 1 --2- 172.21.15.5:0/2615185722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa30806e350 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:55.212 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.209+0000 7fa30ef91640 1 -- 172.21.15.5:0/2615185722 shutdown_connections 2024-09-21T21:37:55.212 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.209+0000 7fa30ef91640 1 --2- 172.21.15.5:0/2615185722 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa30806e350 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:55.213 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.209+0000 7fa30ef91640 1 -- 172.21.15.5:0/2615185722 >> 172.21.15.5:0/2615185722 conn(0x7fa3080a5390 msgr2=0x7fa3080a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:55.213 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.210+0000 7fa30ef91640 1 -- 172.21.15.5:0/2615185722 shutdown_connections 2024-09-21T21:37:55.213 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.210+0000 7fa30ef91640 1 -- 172.21.15.5:0/2615185722 wait complete. 2024-09-21T21:37:55.213 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.210+0000 7fa30ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:55.213 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.212+0000 7fa30ef91640 1 Processor -- start 2024-09-21T21:37:55.213 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.212+0000 7fa30ef91640 1 -- start start 2024-09-21T21:37:55.215 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.213+0000 7fa30ef91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa308126ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:55.216 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.213+0000 7fa30ef91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa308125560 con 0x7fa30806df40 2024-09-21T21:37:55.216 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa30cd2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa308126ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:55.216 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa30cd2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa308126ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48226/0 (socket says 172.21.15.5:48226) 2024-09-21T21:37:55.216 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa30cd2d640 1 -- 172.21.15.5:0/1059109061 learned_addr learned my addr 172.21.15.5:0/1059109061 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:55.216 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa30cd2d640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa308124cb0 con 0x7fa30806df40 2024-09-21T21:37:55.216 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa30cd2d640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa308126ca0 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:55.217 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2f800edc0 con 0x7fa30806df40 2024-09-21T21:37:55.217 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fa2f8015420 con 0x7fa30806df40 2024-09-21T21:37:55.217 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fa2f80156c0 con 0x7fa30806df40 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa308136e30 con 0x7fa30806df40 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.214+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa308126380 con 0x7fa30806df40 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.215+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fa2f8015870 con 0x7fa30806df40 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.215+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa308070290 con 0x7fa30806df40 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.216+0000 7fa3057fa640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e803ead0 0x7fa2e8040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.216+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(708..708 src has 1..708) ==== 3819+0+0 (crc 0 0 0) 0x7fa2f8051360 con 0x7fa30806df40 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.216+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7fa2e8044d60 con 0x7fa30806df40 2024-09-21T21:37:55.218 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.216+0000 7fa307fff640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e803ead0 0x7fa2e8040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:55.219 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.217+0000 7fa307fff640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e803ead0 0x7fa2e8040fe0 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:55.222 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.221+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fa308070290 con 0x7fa30806df40 2024-09-21T21:37:55.420 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:55.418+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"} v 0) -- 0x7fa308070290 con 0x7fa30806df40 2024-09-21T21:37:56.007 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.004+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v709) ==== 221+0+0 (crc 0 0 0) 0x7fa308070290 con 0x7fa30806df40 2024-09-21T21:37:56.007 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.005+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(709..709 src has 1..709) ==== 628+0+0 (crc 0 0 0) 0x7f8dc803cd70 con 0x1f86650 2024-09-21T21:37:56.007 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.005+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7f8db8044260 con 0x1f86650 2024-09-21T21:37:56.007 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.005+0000 7f8dd77fe640 1 -- 172.21.15.5:0/1278773774 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 199.6 199:6b5d76a5:::two:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e709) -- 0x7f8db8044450 con 0x201ca80 2024-09-21T21:37:56.007 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.005+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(709..709 src has 1..709) ==== 628+0+0 (crc 0 0 0) 0x7fa2f800fb60 con 0x7fa30806df40 2024-09-21T21:37:56.007 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.005+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7fa2e8045d10 con 0x7fa30806df40 2024-09-21T21:37:56.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8ddf39c640 1 -- 172.21.15.5:0/1278773774 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 two [writefull 0~12875] v709'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f8dd000a430 con 0x201ca80 2024-09-21T21:37:56.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 >> v2:172.21.15.148:6805/1161645252 conn(0x201ca80 msgr2=0x1f89570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/1278773774 >> v2:172.21.15.148:6805/1161645252 conn(0x201ca80 0x1f89570 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8db803d360 msgr2=0x7f8db803f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8db803d360 0x7f8db803f870 crc :-1 s=READY pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 msgr2=0x2018d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x2018d50 crc :-1 s=READY pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 shutdown_connections 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/1278773774 >> v2:172.21.15.148:6805/1161645252 conn(0x201ca80 0x1f89570 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f8db803d360 0x7f8db803f870 unknown :-1 s=CLOSED pgs=3824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 --2- 172.21.15.5:0/1278773774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f86650 0x2018d50 unknown :-1 s=CLOSED pgs=12894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 >> 172.21.15.5:0/1278773774 conn(0x1eb1770 msgr2=0x20a78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 shutdown_connections 2024-09-21T21:37:56.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.083+0000 7f8de6a2dec0 1 -- 172.21.15.5:0/1278773774 wait complete. 2024-09-21T21:37:56.153 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:56.151+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"} v 0) -- 0x7fa308070290 con 0x7fa30806df40 2024-09-21T21:37:57.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.078+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v710) ==== 221+0+0 (crc 0 0 0) 0x7fa308070290 con 0x7fa30806df40 2024-09-21T21:37:57.080 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_objects = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:37:57.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.078+0000 7fa3057fa640 1 -- 172.21.15.5:0/1059109061 <== mon.0 v2:172.21.15.5:3300/0 10 ==== osd_map(710..710 src has 1..710) ==== 628+0+0 (crc 0 0 0) 0x7fa2f8011e00 con 0x7fa30806df40 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e803ead0 msgr2=0x7fa2e8040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e803ead0 0x7fa2e8040fe0 crc :-1 s=READY pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 msgr2=0x7fa308126ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa308126ca0 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 shutdown_connections 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fa2e803ead0 0x7fa2e8040fe0 unknown :-1 s=CLOSED pgs=3826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 --2- 172.21.15.5:0/1059109061 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa30806df40 0x7fa308126ca0 unknown :-1 s=CLOSED pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 >> 172.21.15.5:0/1059109061 conn(0x7fa3080a5390 msgr2=0x7fa30809f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:57.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 shutdown_connections 2024-09-21T21:37:57.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.083+0000 7fa30ef91640 1 -- 172.21.15.5:0/1059109061 wait complete. 2024-09-21T21:37:57.104 INFO:tasks.workunit.client.0.smithi005.stderr:+ wait 96235 2024-09-21T21:37:57.104 INFO:tasks.workunit.client.0.smithi005.stderr:+ '[' 0 -ne 0 ']' 2024-09-21T21:37:57.104 INFO:tasks.workunit.client.0.smithi005.stderr:+ true 2024-09-21T21:37:57.104 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put three /etc/passwd 2024-09-21T21:37:57.153 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.151+0000 7f0c266edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:57.159 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.157+0000 7f0c266edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:57.159 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.157+0000 7f0c266edec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:57.160 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.158+0000 7f0c266edec0 1 Processor -- start 2024-09-21T21:37:57.160 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.158+0000 7f0c266edec0 1 -- start start 2024-09-21T21:37:57.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.160+0000 7f0c266edec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa09840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:57.162 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.160+0000 7f0c266edec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x8ef520 con 0x98bbe0 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.160+0000 7f0c1eb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa09840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.160+0000 7f0c1eb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa09840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48246/0 (socket says 172.21.15.5:48246) 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.160+0000 7f0c1eb9b640 1 -- 172.21.15.5:0/1549096070 learned_addr learned my addr 172.21.15.5:0/1549096070 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.160+0000 7f0c1eb9b640 1 -- 172.21.15.5:0/1549096070 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x88be10 con 0x98bbe0 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.160+0000 7f0c1eb9b640 1 --2- 172.21.15.5:0/1549096070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa09840 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cabf9a88a7825bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c1d398640 1 -- 172.21.15.5:0/1549096070 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c0802db80 con 0x98bbe0 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c1d398640 1 -- 172.21.15.5:0/1549096070 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0c0802dce0 con 0x98bbe0 2024-09-21T21:37:57.163 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c1d398640 1 -- 172.21.15.5:0/1549096070 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c08034280 con 0x98bbe0 2024-09-21T21:37:57.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c266edec0 1 -- 172.21.15.5:0/1549096070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 msgr2=0xa09840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1549096070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa09840 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c266edec0 1 -- 172.21.15.5:0/1549096070 shutdown_connections 2024-09-21T21:37:57.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1549096070 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa09840 unknown :-1 s=CLOSED pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c266edec0 1 -- 172.21.15.5:0/1549096070 >> 172.21.15.5:0/1549096070 conn(0x8af770 msgr2=0x985820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:57.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c266edec0 1 -- 172.21.15.5:0/1549096070 shutdown_connections 2024-09-21T21:37:57.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.161+0000 7f0c266edec0 1 -- 172.21.15.5:0/1549096070 wait complete. 2024-09-21T21:37:57.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.162+0000 7f0c266edec0 1 Processor -- start 2024-09-21T21:37:57.165 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.162+0000 7f0c266edec0 1 -- start start 2024-09-21T21:37:57.166 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.164+0000 7f0c266edec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa0cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.164+0000 7f0c266edec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x8ed280 con 0x98bbe0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.164+0000 7f0c1eb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa0cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.164+0000 7f0c1eb9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa0cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48252/0 (socket says 172.21.15.5:48252) 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.164+0000 7f0c1eb9b640 1 -- 172.21.15.5:0/1657323094 learned_addr learned my addr 172.21.15.5:0/1657323094 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.164+0000 7f0c1eb9b640 1 -- 172.21.15.5:0/1657323094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x87d920 con 0x98bbe0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.164+0000 7f0c1eb9b640 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa0cc50 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.165+0000 7f0c177fe640 1 -- 172.21.15.5:0/1657323094 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c080347b0 con 0x98bbe0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.165+0000 7f0c177fe640 1 -- 172.21.15.5:0/1657323094 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0c08034910 con 0x98bbe0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.165+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x87d380 con 0x98bbe0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.165+0000 7f0c177fe640 1 -- 172.21.15.5:0/1657323094 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0c08034bb0 con 0x98bbe0 2024-09-21T21:37:57.167 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.165+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa10ad0 con 0x98bbe0 2024-09-21T21:37:57.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.166+0000 7f0c177fe640 1 -- 172.21.15.5:0/1657323094 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f0c08003040 con 0x98bbe0 2024-09-21T21:37:57.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.166+0000 7f0c177fe640 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0c0403d310 0x7f0c0403f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:57.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.166+0000 7f0c177fe640 1 -- 172.21.15.5:0/1657323094 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(710..710 src has 1..710) ==== 3819+0+0 (crc 0 0 0) 0x7f0c08032040 con 0x98bbe0 2024-09-21T21:37:57.168 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.166+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1657323094 >> v2:172.21.15.148:6805/1161645252 conn(0x98c530 0xeb69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:57.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.166+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 199.3 199:c57798d7:::three:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e710) -- 0xa10660 con 0x98c530 2024-09-21T21:37:57.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.167+0000 7f0c1e39a640 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0c0403d310 0x7f0c0403f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:57.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.167+0000 7f0c1e39a640 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0c0403d310 0x7f0c0403f820 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:57.169 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.167+0000 7f0c1f39c640 1 --2- 172.21.15.5:0/1657323094 >> v2:172.21.15.148:6805/1161645252 conn(0x98c530 0xeb69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:37:57.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.171+0000 7f0c1f39c640 1 --2- 172.21.15.5:0/1657323094 >> v2:172.21.15.148:6805/1161645252 conn(0x98c530 0xeb69e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:57.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c1f39c640 1 -- 172.21.15.5:0/1657323094 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 three [writefull 0~12875] v710'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0c1000c430 con 0x98c530 2024-09-21T21:37:57.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 >> v2:172.21.15.148:6805/1161645252 conn(0x98c530 msgr2=0xeb69e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1657323094 >> v2:172.21.15.148:6805/1161645252 conn(0x98c530 0xeb69e0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0c0403d310 msgr2=0x7f0c0403f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0c0403d310 0x7f0c0403f820 crc :-1 s=READY pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 msgr2=0xa0cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa0cc50 crc :-1 s=READY pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 shutdown_connections 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1657323094 >> v2:172.21.15.148:6805/1161645252 conn(0x98c530 0xeb69e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f0c0403d310 0x7f0c0403f820 unknown :-1 s=CLOSED pgs=3827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 --2- 172.21.15.5:0/1657323094 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x98bbe0 0xa0cc50 unknown :-1 s=CLOSED pgs=12904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 >> 172.21.15.5:0/1657323094 conn(0x8af770 msgr2=0x985820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 shutdown_connections 2024-09-21T21:37:57.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.186+0000 7f0c266edec0 1 -- 172.21.15.5:0/1657323094 wait complete. 2024-09-21T21:37:57.190 INFO:tasks.workunit.client.0.smithi005.stderr:++ uuidgen 2024-09-21T21:37:57.191 INFO:tasks.workunit.client.0.smithi005.stderr:+ pp=4715da7e-e73f-4c7f-b923-6e65b1dabe1a 2024-09-21T21:37:57.191 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool create 4715da7e-e73f-4c7f-b923-6e65b1dabe1a 12 2024-09-21T21:37:57.288 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.279+0000 7f4cc5846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:57.289 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.288+0000 7f4cc5846640 1 Processor -- start 2024-09-21T21:37:57.289 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.288+0000 7f4cc5846640 1 -- start start 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.289+0000 7f4cc5846640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cc006dff0 0x7f4cc006e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.289+0000 7f4cc5846640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc009dd30 con 0x7f4cc006e940 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.289+0000 7f4cc5846640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc006f3e0 con 0x7f4cc006dff0 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.289+0000 7f4cbeffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cc006dff0 0x7f4cc006e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.289+0000 7f4cbeffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f4cc006dff0 0x7f4cc006e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48268/0 (socket says 172.21.15.5:48268) 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.289+0000 7f4cbeffd640 1 -- 172.21.15.5:0/545706966 learned_addr learned my addr 172.21.15.5:0/545706966 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.289+0000 7f4cbe7fc640 1 --1- 172.21.15.5:0/545706966 >> v1:172.21.15.5:6789/0 conn(0x7f4cc006e940 0x7f4cc01360c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45114/0 (socket says 172.21.15.5:45114) 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.290+0000 7f4cbeffd640 1 -- 172.21.15.5:0/545706966 >> v1:172.21.15.5:6789/0 conn(0x7f4cc006e940 legacy=0x7f4cc01360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.290+0000 7f4cbeffd640 1 -- 172.21.15.5:0/545706966 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc00a4cd0 con 0x7f4cc006dff0 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.290+0000 7f4cbeffd640 1 --2- 172.21.15.5:0/545706966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc006e400 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db305b911aea8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:57.292 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.290+0000 7f4cbdffb640 1 -- 172.21.15.5:0/545706966 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cb0009e50 con 0x7f4cc006dff0 2024-09-21T21:37:57.293 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.290+0000 7f4cbdffb640 1 -- 172.21.15.5:0/545706966 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4cb000e230 con 0x7f4cc006dff0 2024-09-21T21:37:57.293 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.290+0000 7f4cbdffb640 1 -- 172.21.15.5:0/545706966 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cb000e4d0 con 0x7f4cc006dff0 2024-09-21T21:37:57.293 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 1 -- 172.21.15.5:0/545706966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 msgr2=0x7f4cc006e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:57.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 1 --2- 172.21.15.5:0/545706966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc006e400 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 1 -- 172.21.15.5:0/545706966 shutdown_connections 2024-09-21T21:37:57.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 1 --2- 172.21.15.5:0/545706966 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc006e400 unknown :-1 s=CLOSED pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:57.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 1 -- 172.21.15.5:0/545706966 >> 172.21.15.5:0/545706966 conn(0x7f4cc0069120 msgr2=0x7f4cc0069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:57.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 1 -- 172.21.15.5:0/545706966 shutdown_connections 2024-09-21T21:37:57.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 1 -- 172.21.15.5:0/545706966 wait complete. 2024-09-21T21:37:57.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.291+0000 7f4cc5846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:57.295 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.293+0000 7f4cc5846640 1 Processor -- start 2024-09-21T21:37:57.295 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.293+0000 7f4cc5846640 1 -- start start 2024-09-21T21:37:57.297 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cc5846640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc0124320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:57.297 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cc5846640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc0125750 con 0x7f4cc006dff0 2024-09-21T21:37:57.297 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cbeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc0124320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:57.297 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cbeffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc0124320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48282/0 (socket says 172.21.15.5:48282) 2024-09-21T21:37:57.297 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cbeffd640 1 -- 172.21.15.5:0/194298815 learned_addr learned my addr 172.21.15.5:0/194298815 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:57.297 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cbeffd640 1 -- 172.21.15.5:0/194298815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc0123d20 con 0x7f4cc006dff0 2024-09-21T21:37:57.298 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cbeffd640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc0124320 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:57.298 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cb000ee20 con 0x7f4cc006dff0 2024-09-21T21:37:57.298 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4cb0015420 con 0x7f4cc006dff0 2024-09-21T21:37:57.298 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc0123f80 con 0x7f4cc006dff0 2024-09-21T21:37:57.298 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4cb00156c0 con 0x7f4cc006dff0 2024-09-21T21:37:57.298 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.295+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc0126ff0 con 0x7f4cc006dff0 2024-09-21T21:37:57.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.296+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc0127ac0 con 0x7f4cc006dff0 2024-09-21T21:37:57.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.296+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f4cb0015870 con 0x7f4cc006dff0 2024-09-21T21:37:57.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.297+0000 7f4ca7fff640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4cac03ead0 0x7f4cac040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:57.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.297+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(710..710 src has 1..710) ==== 3819+0+0 (crc 0 0 0) 0x7f4cb0051330 con 0x7f4cc006dff0 2024-09-21T21:37:57.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.297+0000 7f4cbe7fc640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4cac03ead0 0x7f4cac040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:57.299 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.298+0000 7f4cbe7fc640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4cac03ead0 0x7f4cac040fe0 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:57.304 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.302+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f4cb0010a00 con 0x7f4cc006dff0 2024-09-21T21:37:57.498 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:57.496+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pg_num": 12} v 0) -- 0x7f4cc006fdb0 con 0x7f4cc006dff0 2024-09-21T21:37:58.084 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.082+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pg_num": 12}]=0 pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' created v711) ==== 176+0+0 (crc 0 0 0) 0x7f4cb0010310 con 0x7f4cc006dff0 2024-09-21T21:37:58.240 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.238+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pg_num": 12} v 0) -- 0x7f4cc00008d0 con 0x7f4cc006dff0 2024-09-21T21:37:58.241 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.239+0000 7f4ca7fff640 1 -- 172.21.15.5:0/194298815 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pg_num": 12}]=0 pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' already exists v711) ==== 183+0+0 (crc 0 0 0) 0x7f4cb0010310 con 0x7f4cc006dff0 2024-09-21T21:37:58.241 INFO:tasks.workunit.client.0.smithi005.stderr:pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' already exists 2024-09-21T21:37:58.243 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4cac03ead0 msgr2=0x7f4cac040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4cac03ead0 0x7f4cac040fe0 crc :-1 s=READY pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 msgr2=0x7f4cc0124320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc0124320 crc :-1 s=READY pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 shutdown_connections 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4cac03ead0 0x7f4cac040fe0 unknown :-1 s=CLOSED pgs=3828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 --2- 172.21.15.5:0/194298815 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4cc006dff0 0x7f4cc0124320 unknown :-1 s=CLOSED pgs=12907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 >> 172.21.15.5:0/194298815 conn(0x7f4cc0069120 msgr2=0x7f4cc009f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 shutdown_connections 2024-09-21T21:37:58.244 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.242+0000 7f4cc5846640 1 -- 172.21.15.5:0/194298815 wait complete. 2024-09-21T21:37:58.254 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool application enable 4715da7e-e73f-4c7f-b923-6e65b1dabe1a rados 2024-09-21T21:37:58.353 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.342+0000 7f5a2829c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:58.353 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.352+0000 7f5a2829c640 1 Processor -- start 2024-09-21T21:37:58.354 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.352+0000 7f5a2829c640 1 -- start start 2024-09-21T21:37:58.356 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.353+0000 7f5a2829c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a2006ea60 0x7f5a2013b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:58.356 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.353+0000 7f5a2829c640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2006f410 con 0x7f5a2006df40 2024-09-21T21:37:58.356 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.353+0000 7f5a2829c640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5a200a7f90 con 0x7f5a2006ea60 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25837640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a2006ea60 0x7f5a2013b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a26038640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5a2006df40 0x7f5a2006e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45124/0 (socket says 172.21.15.5:45124) 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25837640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5a2006ea60 0x7f5a2013b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48284/0 (socket says 172.21.15.5:48284) 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a26038640 1 -- 172.21.15.5:0/2712471215 learned_addr learned my addr 172.21.15.5:0/2712471215 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25837640 1 -- 172.21.15.5:0/2712471215 >> v1:172.21.15.5:6789/0 conn(0x7f5a2006df40 legacy=0x7f5a2006e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25036640 1 -- 172.21.15.5:0/2712471215 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050408217 0 0) 0x7f5a2006f410 con 0x7f5a2006df40 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25837640 1 -- 172.21.15.5:0/2712471215 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2009da20 con 0x7f5a2006ea60 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25837640 1 --2- 172.21.15.5:0/2712471215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006ea60 0x7f5a2013b300 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58080e149189f052 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:58.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25036640 1 -- 172.21.15.5:0/2712471215 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a10009d90 con 0x7f5a2006ea60 2024-09-21T21:37:58.358 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25036640 1 -- 172.21.15.5:0/2712471215 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a1000e230 con 0x7f5a2006ea60 2024-09-21T21:37:58.358 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.354+0000 7f5a25036640 1 -- 172.21.15.5:0/2712471215 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a1000e4d0 con 0x7f5a2006ea60 2024-09-21T21:37:58.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.355+0000 7f5a2829c640 1 -- 172.21.15.5:0/2712471215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006ea60 msgr2=0x7f5a2013b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:37:58.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.355+0000 7f5a2829c640 1 --2- 172.21.15.5:0/2712471215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006ea60 0x7f5a2013b300 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:58.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.355+0000 7f5a2829c640 1 -- 172.21.15.5:0/2712471215 shutdown_connections 2024-09-21T21:37:58.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.355+0000 7f5a2829c640 1 --2- 172.21.15.5:0/2712471215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006ea60 0x7f5a2013b300 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:37:58.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.355+0000 7f5a2829c640 1 -- 172.21.15.5:0/2712471215 >> 172.21.15.5:0/2712471215 conn(0x7f5a200a5390 msgr2=0x7f5a200a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:37:58.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.355+0000 7f5a2829c640 1 -- 172.21.15.5:0/2712471215 shutdown_connections 2024-09-21T21:37:58.359 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.355+0000 7f5a2829c640 1 -- 172.21.15.5:0/2712471215 wait complete. 2024-09-21T21:37:58.360 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.356+0000 7f5a2829c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:37:58.360 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.357+0000 7f5a2829c640 1 Processor -- start 2024-09-21T21:37:58.360 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.357+0000 7f5a2829c640 1 -- start start 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.359+0000 7f5a2829c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006df40 0x7f5a20124430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.359+0000 7f5a2829c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5a20126480 con 0x7f5a2006df40 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.359+0000 7f5a26038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006df40 0x7f5a20124430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.359+0000 7f5a26038640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006df40 0x7f5a20124430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48294/0 (socket says 172.21.15.5:48294) 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.359+0000 7f5a26038640 1 -- 172.21.15.5:0/2813172800 learned_addr learned my addr 172.21.15.5:0/2813172800 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.360+0000 7f5a26038640 1 -- 172.21.15.5:0/2813172800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a201254b0 con 0x7f5a2006df40 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.360+0000 7f5a26038640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006df40 0x7f5a20124430 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:58.362 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.360+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a1c004b80 con 0x7f5a2006df40 2024-09-21T21:37:58.363 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.360+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5a1c004ce0 con 0x7f5a2006df40 2024-09-21T21:37:58.363 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.360+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a20123a00 con 0x7f5a2006df40 2024-09-21T21:37:58.363 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.360+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5a1c007120 con 0x7f5a2006df40 2024-09-21T21:37:58.363 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.360+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a20123c60 con 0x7f5a2006df40 2024-09-21T21:37:58.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.361+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a201278d0 con 0x7f5a2006df40 2024-09-21T21:37:58.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.361+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f5a1c0072d0 con 0x7f5a2006df40 2024-09-21T21:37:58.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.361+0000 7f5a16ffd640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5a0403ead0 0x7f5a04040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:37:58.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.361+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(711..711 src has 1..711) ==== 4194+0+0 (crc 0 0 0) 0x7f5a1c050020 con 0x7f5a2006df40 2024-09-21T21:37:58.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.362+0000 7f5a25837640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5a0403ead0 0x7f5a04040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:37:58.364 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.362+0000 7f5a25837640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5a0403ead0 0x7f5a04040fe0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:37:58.368 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.367+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f5a1c00f230 con 0x7f5a2006df40 2024-09-21T21:37:58.557 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:58.556+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "app": "rados"} v 0) -- 0x7f5a2006fd90 con 0x7f5a2006df40 2024-09-21T21:37:59.088 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:59.086+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "app": "rados"}]=0 enabled application 'rados' on pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' v712) ==== 213+0+0 (crc 0 0 0) 0x7f5a1c00a0c0 con 0x7f5a2006df40 2024-09-21T21:37:59.261 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:37:59.259+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "app": "rados"} v 0) -- 0x7f5a200008d0 con 0x7f5a2006df40 2024-09-21T21:38:00.092 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.090+0000 7f5a16ffd640 1 -- 172.21.15.5:0/2813172800 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "app": "rados"}]=0 enabled application 'rados' on pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' v713) ==== 213+0+0 (crc 0 0 0) 0x7f5a1c00a7b0 con 0x7f5a2006df40 2024-09-21T21:38:00.093 INFO:tasks.workunit.client.0.smithi005.stderr:enabled application 'rados' on pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' 2024-09-21T21:38:00.097 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5a0403ead0 msgr2=0x7f5a04040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5a0403ead0 0x7f5a04040fe0 crc :-1 s=READY pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006df40 msgr2=0x7f5a20124430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006df40 0x7f5a20124430 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 shutdown_connections 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5a0403ead0 0x7f5a04040fe0 unknown :-1 s=CLOSED pgs=3829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 --2- 172.21.15.5:0/2813172800 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5a2006df40 0x7f5a20124430 unknown :-1 s=CLOSED pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.095+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 >> 172.21.15.5:0/2813172800 conn(0x7f5a200a5390 msgr2=0x7f5a2009f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.096+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 shutdown_connections 2024-09-21T21:38:00.098 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.096+0000 7f5a2829c640 1 -- 172.21.15.5:0/2813172800 wait complete. 2024-09-21T21:38:00.119 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota 4715da7e-e73f-4c7f-b923-6e65b1dabe1a max_objects 10 2024-09-21T21:38:00.226 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.215+0000 7f7509948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:00.227 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.225+0000 7f7509948640 1 Processor -- start 2024-09-21T21:38:00.227 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.225+0000 7f7509948640 1 -- start start 2024-09-21T21:38:00.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f7509948640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7504132eb0 0x7f75041375d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:00.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f7509948640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750409b440 con 0x7f7504132390 2024-09-21T21:38:00.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f7509948640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f7504098240 con 0x7f7504132eb0 2024-09-21T21:38:00.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f75027fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7504132eb0 0x7f75041375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:00.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f75027fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f7504132eb0 0x7f75041375d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48296/0 (socket says 172.21.15.5:48296) 2024-09-21T21:38:00.229 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f75027fc640 1 -- 172.21.15.5:0/3186919730 learned_addr learned my addr 172.21.15.5:0/3186919730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:00.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f7502ffd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f7504132390 0x7f75041327a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:45130/0 (socket says 172.21.15.5:45130) 2024-09-21T21:38:00.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f75027fc640 1 -- 172.21.15.5:0/3186919730 >> v1:172.21.15.5:6789/0 conn(0x7f7504132390 legacy=0x7f75041327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:00.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f75027fc640 1 -- 172.21.15.5:0/3186919730 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750409ca60 con 0x7f7504132eb0 2024-09-21T21:38:00.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f75027fc640 1 --2- 172.21.15.5:0/3186919730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132eb0 0x7f75041375d0 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d021b8a76b407ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:00.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f7501ffb640 1 -- 172.21.15.5:0/3186919730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74f8009840 con 0x7f7504132eb0 2024-09-21T21:38:00.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f7501ffb640 1 -- 172.21.15.5:0/3186919730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f74f800f340 con 0x7f7504132eb0 2024-09-21T21:38:00.230 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.227+0000 7f7501ffb640 1 -- 172.21.15.5:0/3186919730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74f800f5e0 con 0x7f7504132eb0 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.228+0000 7f7509948640 1 -- 172.21.15.5:0/3186919730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132eb0 msgr2=0x7f75041375d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.228+0000 7f7509948640 1 --2- 172.21.15.5:0/3186919730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132eb0 0x7f75041375d0 crc :-1 s=READY pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.228+0000 7f7509948640 1 -- 172.21.15.5:0/3186919730 shutdown_connections 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.228+0000 7f7509948640 1 --2- 172.21.15.5:0/3186919730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132eb0 0x7f75041375d0 unknown :-1 s=CLOSED pgs=12912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.228+0000 7f7509948640 1 -- 172.21.15.5:0/3186919730 >> 172.21.15.5:0/3186919730 conn(0x7f75040a0d40 msgr2=0x7f75040a1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.228+0000 7f7509948640 1 -- 172.21.15.5:0/3186919730 shutdown_connections 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.228+0000 7f7509948640 1 -- 172.21.15.5:0/3186919730 wait complete. 2024-09-21T21:38:00.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.229+0000 7f7509948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:00.232 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.230+0000 7f7509948640 1 Processor -- start 2024-09-21T21:38:00.232 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.231+0000 7f7509948640 1 -- start start 2024-09-21T21:38:00.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.232+0000 7f7509948640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132390 0x7f750412a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:00.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.232+0000 7f7509948640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f750412c980 con 0x7f7504132390 2024-09-21T21:38:00.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.232+0000 7f7502ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132390 0x7f750412a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:00.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.232+0000 7f7502ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132390 0x7f750412a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48298/0 (socket says 172.21.15.5:48298) 2024-09-21T21:38:00.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.232+0000 7f7502ffd640 1 -- 172.21.15.5:0/2377524353 learned_addr learned my addr 172.21.15.5:0/2377524353 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:00.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.232+0000 7f7502ffd640 1 -- 172.21.15.5:0/2377524353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7504099ca0 con 0x7f7504132390 2024-09-21T21:38:00.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.233+0000 7f7502ffd640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132390 0x7f750412a350 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.233+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74f40059a0 con 0x7f7504132390 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.233+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f74f4005b00 con 0x7f7504132390 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.233+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f74f4005da0 con 0x7f7504132390 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.233+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750412bb20 con 0x7f7504132390 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.233+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750412d980 con 0x7f7504132390 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.234+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f750406da70 con 0x7f7504132390 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.234+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f74f40070b0 con 0x7f7504132390 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.234+0000 7f74ebfff640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f74f003ead0 0x7f74f0040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:00.236 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.234+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(713..713 src has 1..713) ==== 4207+0+0 (crc 0 0 0) 0x7f74f404fed0 con 0x7f7504132390 2024-09-21T21:38:00.237 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.235+0000 7f75027fc640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f74f003ead0 0x7f74f0040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:00.237 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.235+0000 7f75027fc640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f74f003ead0 0x7f74f0040fe0 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:00.241 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.239+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f74f400f230 con 0x7f7504132390 2024-09-21T21:38:00.432 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:00.431+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "field": "max_objects", "val": "10"} v 0) -- 0x7f7504078820 con 0x7f7504132390 2024-09-21T21:38:01.008 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:01.006+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 4715da7e-e73f-4c7f-b923-6e65b1dabe1a v714) ==== 223+0+0 (crc 0 0 0) 0x7f74f400d150 con 0x7f7504132390 2024-09-21T21:38:01.143 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:01.142+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "field": "max_objects", "val": "10"} v 0) -- 0x7f750412c390 con 0x7f7504132390 2024-09-21T21:38:02.097 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.095+0000 7f74ebfff640 1 -- 172.21.15.5:0/2377524353 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 4715da7e-e73f-4c7f-b923-6e65b1dabe1a v715) ==== 223+0+0 (crc 0 0 0) 0x7f74f400d840 con 0x7f7504132390 2024-09-21T21:38:02.097 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_objects = 10 for pool 4715da7e-e73f-4c7f-b923-6e65b1dabe1a 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f74f003ead0 msgr2=0x7f74f0040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f74f003ead0 0x7f74f0040fe0 crc :-1 s=READY pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132390 msgr2=0x7f750412a350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132390 0x7f750412a350 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 shutdown_connections 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f74f003ead0 0x7f74f0040fe0 unknown :-1 s=CLOSED pgs=3830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 --2- 172.21.15.5:0/2377524353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7504132390 0x7f750412a350 unknown :-1 s=CLOSED pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 >> 172.21.15.5:0/2377524353 conn(0x7f75040a0d40 msgr2=0x7f750409f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:02.101 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 shutdown_connections 2024-09-21T21:38:02.102 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:02.099+0000 7f7509948640 1 -- 172.21.15.5:0/2377524353 wait complete. 2024-09-21T21:38:02.116 INFO:tasks.workunit.client.0.smithi005.stderr:+ sleep 30 2024-09-21T21:38:32.118 INFO:tasks.workunit.client.0.smithi005.stderr:++ seq 1 10 2024-09-21T21:38:32.118 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.118 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj1 /etc/passwd 2024-09-21T21:38:32.164 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.162+0000 7f276b232ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.168+0000 7f276b232ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.168+0000 7f276b232ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.169+0000 7f276b232ec0 1 Processor -- start 2024-09-21T21:38:32.170 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.169+0000 7f276b232ec0 1 -- start start 2024-09-21T21:38:32.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.170+0000 7f276b232ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1e51f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.170+0000 7f276b232ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1dbb520 con 0x1e57be0 2024-09-21T21:38:32.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.170+0000 7f276339b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1e51f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.170+0000 7f276339b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1e51f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51114/0 (socket says 172.21.15.5:51114) 2024-09-21T21:38:32.172 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.170+0000 7f276339b640 1 -- 172.21.15.5:0/1713520707 learned_addr learned my addr 172.21.15.5:0/1713520707 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.171+0000 7f276339b640 1 -- 172.21.15.5:0/1713520707 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d57e10 con 0x1e57be0 2024-09-21T21:38:32.173 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.171+0000 7f276339b640 1 --2- 172.21.15.5:0/1713520707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1e51f30 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7638224865c6c3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.171+0000 7f2761b98640 1 -- 172.21.15.5:0/1713520707 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f274c0061f0 con 0x1e57be0 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.171+0000 7f2761b98640 1 -- 172.21.15.5:0/1713520707 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f274c001980 con 0x1e57be0 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.171+0000 7f2761b98640 1 -- 172.21.15.5:0/1713520707 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f274c001af0 con 0x1e57be0 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.172+0000 7f276b232ec0 1 -- 172.21.15.5:0/1713520707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 msgr2=0x1e51f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.172+0000 7f276b232ec0 1 --2- 172.21.15.5:0/1713520707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1e51f30 crc :-1 s=READY pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.172+0000 7f276b232ec0 1 -- 172.21.15.5:0/1713520707 shutdown_connections 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.172+0000 7f276b232ec0 1 --2- 172.21.15.5:0/1713520707 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1e51f30 unknown :-1 s=CLOSED pgs=12916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.172+0000 7f276b232ec0 1 -- 172.21.15.5:0/1713520707 >> 172.21.15.5:0/1713520707 conn(0x1d7b770 msgr2=0x1e5a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.172+0000 7f276b232ec0 1 -- 172.21.15.5:0/1713520707 shutdown_connections 2024-09-21T21:38:32.174 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.172+0000 7f276b232ec0 1 -- 172.21.15.5:0/1713520707 wait complete. 2024-09-21T21:38:32.175 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.173+0000 7f276b232ec0 1 Processor -- start 2024-09-21T21:38:32.175 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.173+0000 7f276b232ec0 1 -- start start 2024-09-21T21:38:32.176 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.174+0000 7f276b232ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1ed6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.176 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.174+0000 7f276b232ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1db9280 con 0x1e57be0 2024-09-21T21:38:32.176 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.174+0000 7f276339b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1ed6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.176 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f276339b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1ed6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51120/0 (socket says 172.21.15.5:51120) 2024-09-21T21:38:32.176 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f276339b640 1 -- 172.21.15.5:0/2887383905 learned_addr learned my addr 172.21.15.5:0/2887383905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.177 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f276339b640 1 -- 172.21.15.5:0/2887383905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d49920 con 0x1e57be0 2024-09-21T21:38:32.177 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f276339b640 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1ed6d60 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.177 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f2760b96640 1 -- 172.21.15.5:0/2887383905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f274c011c10 con 0x1e57be0 2024-09-21T21:38:32.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f2760b96640 1 -- 172.21.15.5:0/2887383905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f274c011d70 con 0x1e57be0 2024-09-21T21:38:32.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1d49380 con 0x1e57be0 2024-09-21T21:38:32.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f2760b96640 1 -- 172.21.15.5:0/2887383905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f274c012460 con 0x1e57be0 2024-09-21T21:38:32.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.175+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1ed9ce0 con 0x1e57be0 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.176+0000 7f2760b96640 1 -- 172.21.15.5:0/2887383905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f274c012610 con 0x1e57be0 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.177+0000 7f2760b96640 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f274803d360 0x7f274803f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.177+0000 7f2760b96640 1 -- 172.21.15.5:0/2887383905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f274c04fda0 con 0x1e57be0 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.177+0000 7f276b232ec0 1 --2- 172.21.15.5:0/2887383905 >> v2:172.21.15.148:6805/1161645252 conn(0x1e58700 0x2380a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.177+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x1eda560 con 0x1e58700 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.177+0000 7f2762b9a640 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f274803d360 0x7f274803f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.178+0000 7f2762b9a640 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f274803d360 0x7f274803f870 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.178+0000 7f2763b9c640 1 --2- 172.21.15.5:0/2887383905 >> v2:172.21.15.148:6805/1161645252 conn(0x1e58700 0x2380a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.181+0000 7f2763b9c640 1 --2- 172.21.15.5:0/2887383905 >> v2:172.21.15.148:6805/1161645252 conn(0x1e58700 0x2380a30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f2763b9c640 1 -- 172.21.15.5:0/2887383905 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 obj1 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f275400c430 con 0x1e58700 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 >> v2:172.21.15.148:6805/1161645252 conn(0x1e58700 msgr2=0x2380a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 --2- 172.21.15.5:0/2887383905 >> v2:172.21.15.148:6805/1161645252 conn(0x1e58700 0x2380a30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f274803d360 msgr2=0x7f274803f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f274803d360 0x7f274803f870 crc :-1 s=READY pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 msgr2=0x1ed6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1ed6d60 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 shutdown_connections 2024-09-21T21:38:32.202 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 --2- 172.21.15.5:0/2887383905 >> v2:172.21.15.148:6805/1161645252 conn(0x1e58700 0x2380a30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.203 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f274803d360 0x7f274803f870 unknown :-1 s=CLOSED pgs=3831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.203 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 --2- 172.21.15.5:0/2887383905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1e57be0 0x1ed6d60 unknown :-1 s=CLOSED pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.203 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 >> 172.21.15.5:0/2887383905 conn(0x1d7b770 msgr2=0x1e513d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.203 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 shutdown_connections 2024-09-21T21:38:32.203 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.200+0000 7f276b232ec0 1 -- 172.21.15.5:0/2887383905 wait complete. 2024-09-21T21:38:32.204 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.204 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj2 /etc/passwd 2024-09-21T21:38:32.243 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.241+0000 7f5f71b74ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.247+0000 7f5f71b74ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.249 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.247+0000 7f5f71b74ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.250 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.248+0000 7f5f71b74ec0 1 Processor -- start 2024-09-21T21:38:32.250 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.248+0000 7f5f71b74ec0 1 -- start start 2024-09-21T21:38:32.252 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.249+0000 7f5f71b74ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1c56c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.252 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.249+0000 7f5f71b74ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1bd5520 con 0x1c695f0 2024-09-21T21:38:32.252 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f6a59b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1c56c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.252 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f6a59b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1c56c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51148/0 (socket says 172.21.15.5:51148) 2024-09-21T21:38:32.252 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f6a59b640 1 -- 172.21.15.5:0/2406882207 learned_addr learned my addr 172.21.15.5:0/2406882207 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.252 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f6a59b640 1 -- 172.21.15.5:0/2406882207 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b71e10 con 0x1c695f0 2024-09-21T21:38:32.252 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f6a59b640 1 --2- 172.21.15.5:0/2406882207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1c56c50 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ebd714473e1c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.253 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f68d98640 1 -- 172.21.15.5:0/2406882207 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f54037370 con 0x1c695f0 2024-09-21T21:38:32.253 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f68d98640 1 -- 172.21.15.5:0/2406882207 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5f540374d0 con 0x1c695f0 2024-09-21T21:38:32.253 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.250+0000 7f5f68d98640 1 -- 172.21.15.5:0/2406882207 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f54037770 con 0x1c695f0 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.251+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/2406882207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 msgr2=0x1c56c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.251+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/2406882207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1c56c50 crc :-1 s=READY pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.251+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/2406882207 shutdown_connections 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.251+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/2406882207 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1c56c50 unknown :-1 s=CLOSED pgs=12920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.251+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/2406882207 >> 172.21.15.5:0/2406882207 conn(0x1b95770 msgr2=0x1c6ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.251+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/2406882207 shutdown_connections 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.251+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/2406882207 wait complete. 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.252+0000 7f5f71b74ec0 1 Processor -- start 2024-09-21T21:38:32.254 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.252+0000 7f5f71b74ec0 1 -- start start 2024-09-21T21:38:32.256 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f71b74ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1d8cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.256 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f71b74ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1bd3280 con 0x1c695f0 2024-09-21T21:38:32.256 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f6a59b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1d8cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.256 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f6a59b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1d8cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51150/0 (socket says 172.21.15.5:51150) 2024-09-21T21:38:32.256 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f6a59b640 1 -- 172.21.15.5:0/513058965 learned_addr learned my addr 172.21.15.5:0/513058965 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.256 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f6a59b640 1 -- 172.21.15.5:0/513058965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1b63920 con 0x1c695f0 2024-09-21T21:38:32.256 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f6a59b640 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1d8cd40 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.257 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f637fe640 1 -- 172.21.15.5:0/513058965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f5402dbe0 con 0x1c695f0 2024-09-21T21:38:32.257 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f637fe640 1 -- 172.21.15.5:0/513058965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5f54037920 con 0x1c695f0 2024-09-21T21:38:32.257 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1b63380 con 0x1c695f0 2024-09-21T21:38:32.257 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f637fe640 1 -- 172.21.15.5:0/513058965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5f54037bc0 con 0x1c695f0 2024-09-21T21:38:32.257 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.254+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1d8e680 con 0x1c695f0 2024-09-21T21:38:32.257 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.255+0000 7f5f637fe640 1 -- 172.21.15.5:0/513058965 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f5f54037d70 con 0x1c695f0 2024-09-21T21:38:32.258 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.256+0000 7f5f637fe640 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5f4403d360 0x7f5f4403f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.258 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.256+0000 7f5f637fe640 1 -- 172.21.15.5:0/513058965 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f5f54032040 con 0x1c695f0 2024-09-21T21:38:32.258 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.256+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/513058965 >> v2:172.21.15.148:6805/1161645252 conn(0x1c73450 0x1d9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.258 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.256+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x1d90670 con 0x1c73450 2024-09-21T21:38:32.258 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.256+0000 7f5f69d9a640 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5f4403d360 0x7f5f4403f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.259 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.257+0000 7f5f69d9a640 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5f4403d360 0x7f5f4403f870 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.259 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.257+0000 7f5f6ad9c640 1 --2- 172.21.15.5:0/513058965 >> v2:172.21.15.148:6805/1161645252 conn(0x1c73450 0x1d9abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.263 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.261+0000 7f5f6ad9c640 1 --2- 172.21.15.5:0/513058965 >> v2:172.21.15.148:6805/1161645252 conn(0x1c73450 0x1d9abe0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.279 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f6ad9c640 1 -- 172.21.15.5:0/513058965 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 obj2 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5f5c00a430 con 0x1c73450 2024-09-21T21:38:32.279 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 >> v2:172.21.15.148:6805/1161645252 conn(0x1c73450 msgr2=0x1d9abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.279 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/513058965 >> v2:172.21.15.148:6805/1161645252 conn(0x1c73450 0x1d9abe0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.279 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5f4403d360 msgr2=0x7f5f4403f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.279 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5f4403d360 0x7f5f4403f870 crc :-1 s=READY pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.279 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 msgr2=0x1d8cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1d8cd40 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 shutdown_connections 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/513058965 >> v2:172.21.15.148:6805/1161645252 conn(0x1c73450 0x1d9abe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5f4403d360 0x7f5f4403f870 unknown :-1 s=CLOSED pgs=3832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 --2- 172.21.15.5:0/513058965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1c695f0 0x1d8cd40 unknown :-1 s=CLOSED pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 >> 172.21.15.5:0/513058965 conn(0x1b95770 msgr2=0x1c56c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 shutdown_connections 2024-09-21T21:38:32.280 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.277+0000 7f5f71b74ec0 1 -- 172.21.15.5:0/513058965 wait complete. 2024-09-21T21:38:32.282 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.282 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj3 /etc/passwd 2024-09-21T21:38:32.319 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.317+0000 7f3180322ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.323+0000 7f3180322ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.323+0000 7f3180322ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.325 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.324+0000 7f3180322ec0 1 Processor -- start 2024-09-21T21:38:32.326 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.324+0000 7f3180322ec0 1 -- start start 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.325+0000 7f3180322ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xafb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.325+0000 7f3180322ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xa64520 con 0xb919b0 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.325+0000 7f31737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xafb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.325+0000 7f31737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xafb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51162/0 (socket says 172.21.15.5:51162) 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.326+0000 7f31737fe640 1 -- 172.21.15.5:0/1519638490 learned_addr learned my addr 172.21.15.5:0/1519638490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.326+0000 7f31737fe640 1 -- 172.21.15.5:0/1519638490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xa00e10 con 0xb919b0 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.326+0000 7f31737fe640 1 --2- 172.21.15.5:0/1519638490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xafb720 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fc5798bbc65e7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.326+0000 7f3171ffb640 1 -- 172.21.15.5:0/1519638490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f316400b4a0 con 0xb919b0 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.326+0000 7f3171ffb640 1 -- 172.21.15.5:0/1519638490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f316400b600 con 0xb919b0 2024-09-21T21:38:32.328 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.326+0000 7f3171ffb640 1 -- 172.21.15.5:0/1519638490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f316400b8a0 con 0xb919b0 2024-09-21T21:38:32.329 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.327+0000 7f3180322ec0 1 -- 172.21.15.5:0/1519638490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 msgr2=0xafb720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.327+0000 7f3180322ec0 1 --2- 172.21.15.5:0/1519638490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xafb720 crc :-1 s=READY pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.327+0000 7f3180322ec0 1 -- 172.21.15.5:0/1519638490 shutdown_connections 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.327+0000 7f3180322ec0 1 --2- 172.21.15.5:0/1519638490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xafb720 unknown :-1 s=CLOSED pgs=12924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.327+0000 7f3180322ec0 1 -- 172.21.15.5:0/1519638490 >> 172.21.15.5:0/1519638490 conn(0xa24770 msgr2=0xaffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.327+0000 7f3180322ec0 1 -- 172.21.15.5:0/1519638490 shutdown_connections 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.327+0000 7f3180322ec0 1 -- 172.21.15.5:0/1519638490 wait complete. 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.328+0000 7f3180322ec0 1 Processor -- start 2024-09-21T21:38:32.330 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.328+0000 7f3180322ec0 1 -- start start 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.329+0000 7f3180322ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xb7c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.329+0000 7f3180322ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xa62280 con 0xb919b0 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f31737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xb7c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f31737fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xb7c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51164/0 (socket says 172.21.15.5:51164) 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f31737fe640 1 -- 172.21.15.5:0/3317358086 learned_addr learned my addr 172.21.15.5:0/3317358086 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f31737fe640 1 -- 172.21.15.5:0/3317358086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9f2920 con 0xb919b0 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f31737fe640 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xb7c310 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.332 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f3170ff9640 1 -- 172.21.15.5:0/3317358086 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f31640129f0 con 0xb919b0 2024-09-21T21:38:32.333 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f3170ff9640 1 -- 172.21.15.5:0/3317358086 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3164005040 con 0xb919b0 2024-09-21T21:38:32.333 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f3170ff9640 1 -- 172.21.15.5:0/3317358086 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3164012c80 con 0xb919b0 2024-09-21T21:38:32.333 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x9f2380 con 0xb919b0 2024-09-21T21:38:32.333 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.330+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xb7eea0 con 0xb919b0 2024-09-21T21:38:32.333 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.331+0000 7f3170ff9640 1 -- 172.21.15.5:0/3317358086 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f316400d040 con 0xb919b0 2024-09-21T21:38:32.334 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.331+0000 7f3170ff9640 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f316003d310 0x7f316003f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.334 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.332+0000 7f3170ff9640 1 -- 172.21.15.5:0/3317358086 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f316400a040 con 0xb919b0 2024-09-21T21:38:32.334 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.332+0000 7f3180322ec0 1 --2- 172.21.15.5:0/3317358086 >> v2:172.21.15.5:6804/1102615197 conn(0xb94700 0x102a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.334 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.332+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0xb7fac0 con 0xb94700 2024-09-21T21:38:32.334 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.332+0000 7f3172ffd640 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f316003d310 0x7f316003f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.334 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.332+0000 7f3172ffd640 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f316003d310 0x7f316003f820 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.335 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.333+0000 7f3178f9c640 1 --2- 172.21.15.5:0/3317358086 >> v2:172.21.15.5:6804/1102615197 conn(0xb94700 0x102a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.338 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.336+0000 7f3178f9c640 1 --2- 172.21.15.5:0/3317358086 >> v2:172.21.15.5:6804/1102615197 conn(0xb94700 0x102a920 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.368 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3178f9c640 1 -- 172.21.15.5:0/3317358086 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== osd_op_reply(1 obj3 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f316c00a430 con 0xb94700 2024-09-21T21:38:32.368 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 >> v2:172.21.15.5:6804/1102615197 conn(0xb94700 msgr2=0x102a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.368 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 --2- 172.21.15.5:0/3317358086 >> v2:172.21.15.5:6804/1102615197 conn(0xb94700 0x102a920 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f316003d310 msgr2=0x7f316003f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f316003d310 0x7f316003f820 crc :-1 s=READY pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 msgr2=0xb7c310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xb7c310 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 shutdown_connections 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 --2- 172.21.15.5:0/3317358086 >> v2:172.21.15.5:6804/1102615197 conn(0xb94700 0x102a920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f316003d310 0x7f316003f820 unknown :-1 s=CLOSED pgs=3833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 --2- 172.21.15.5:0/3317358086 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xb919b0 0xb7c310 unknown :-1 s=CLOSED pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 >> 172.21.15.5:0/3317358086 conn(0xa24770 msgr2=0xaffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 shutdown_connections 2024-09-21T21:38:32.369 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.366+0000 7f3180322ec0 1 -- 172.21.15.5:0/3317358086 wait complete. 2024-09-21T21:38:32.371 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.371 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj4 /etc/passwd 2024-09-21T21:38:32.408 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.406+0000 7f64d2ae7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.412+0000 7f64d2ae7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.414 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.412+0000 7f64d2ae7ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.415 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.413+0000 7f64d2ae7ec0 1 Processor -- start 2024-09-21T21:38:32.415 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.413+0000 7f64d2ae7ec0 1 -- start start 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.414+0000 7f64d2ae7ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xb79420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.414+0000 7f64d2ae7ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x9c3520 con 0xa5f240 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64caf9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xb79420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64caf9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xb79420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51182/0 (socket says 172.21.15.5:51182) 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64caf9b640 1 -- 172.21.15.5:0/1180420504 learned_addr learned my addr 172.21.15.5:0/1180420504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64caf9b640 1 -- 172.21.15.5:0/1180420504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x95fe10 con 0xa5f240 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64caf9b640 1 --2- 172.21.15.5:0/1180420504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xb79420 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8246def66c96a648 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64c9798640 1 -- 172.21.15.5:0/1180420504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64b4034040 con 0xa5f240 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64c9798640 1 -- 172.21.15.5:0/1180420504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f64b402dbc0 con 0xa5f240 2024-09-21T21:38:32.417 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.415+0000 7f64c9798640 1 -- 172.21.15.5:0/1180420504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64b402de60 con 0xa5f240 2024-09-21T21:38:32.418 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.416+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1180420504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 msgr2=0xb79420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.418 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.416+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1180420504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xb79420 crc :-1 s=READY pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.418 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.416+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1180420504 shutdown_connections 2024-09-21T21:38:32.418 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.416+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1180420504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xb79420 unknown :-1 s=CLOSED pgs=12928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.418 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.416+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1180420504 >> 172.21.15.5:0/1180420504 conn(0x983770 msgr2=0xa61630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.419 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.416+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1180420504 shutdown_connections 2024-09-21T21:38:32.419 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.416+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1180420504 wait complete. 2024-09-21T21:38:32.419 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.417+0000 7f64d2ae7ec0 1 Processor -- start 2024-09-21T21:38:32.419 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.417+0000 7f64d2ae7ec0 1 -- start start 2024-09-21T21:38:32.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64d2ae7ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xa563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64d2ae7ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x9c1280 con 0xa5f240 2024-09-21T21:38:32.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64caf9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xa563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64caf9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xa563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51192/0 (socket says 172.21.15.5:51192) 2024-09-21T21:38:32.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64caf9b640 1 -- 172.21.15.5:0/1968090770 learned_addr learned my addr 172.21.15.5:0/1968090770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64caf9b640 1 -- 172.21.15.5:0/1968090770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x951920 con 0xa5f240 2024-09-21T21:38:32.421 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64caf9b640 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xa563f0 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.422 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64c37fe640 1 -- 172.21.15.5:0/1968090770 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64b4034040 con 0xa5f240 2024-09-21T21:38:32.422 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64c37fe640 1 -- 172.21.15.5:0/1968090770 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f64b4035040 con 0xa5f240 2024-09-21T21:38:32.422 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x951380 con 0xa5f240 2024-09-21T21:38:32.422 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64c37fe640 1 -- 172.21.15.5:0/1968090770 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f64b4002c60 con 0xa5f240 2024-09-21T21:38:32.422 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.419+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xadd830 con 0xa5f240 2024-09-21T21:38:32.422 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.420+0000 7f64c37fe640 1 -- 172.21.15.5:0/1968090770 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f64b402fd50 con 0xa5f240 2024-09-21T21:38:32.423 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.421+0000 7f64c37fe640 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f64b003d360 0x7f64b003f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.423 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.421+0000 7f64c37fe640 1 -- 172.21.15.5:0/1968090770 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f64b4073050 con 0xa5f240 2024-09-21T21:38:32.423 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.421+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1968090770 >> v2:172.21.15.148:6805/1161645252 conn(0xaf09b0 0xaec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.423 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.421+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0xb79d20 con 0xaf09b0 2024-09-21T21:38:32.423 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.421+0000 7f64ca79a640 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f64b003d360 0x7f64b003f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.423 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.421+0000 7f64ca79a640 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f64b003d360 0x7f64b003f870 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.424 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.422+0000 7f64cb79c640 1 --2- 172.21.15.5:0/1968090770 >> v2:172.21.15.148:6805/1161645252 conn(0xaf09b0 0xaec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.427 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.426+0000 7f64cb79c640 1 --2- 172.21.15.5:0/1968090770 >> v2:172.21.15.148:6805/1161645252 conn(0xaf09b0 0xaec9f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64cb79c640 1 -- 172.21.15.5:0/1968090770 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 obj4 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f64bc00c430 con 0xaf09b0 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 >> v2:172.21.15.148:6805/1161645252 conn(0xaf09b0 msgr2=0xaec9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1968090770 >> v2:172.21.15.148:6805/1161645252 conn(0xaf09b0 0xaec9f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f64b003d360 msgr2=0x7f64b003f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f64b003d360 0x7f64b003f870 crc :-1 s=READY pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 msgr2=0xa563f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xa563f0 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 shutdown_connections 2024-09-21T21:38:32.444 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1968090770 >> v2:172.21.15.148:6805/1161645252 conn(0xaf09b0 0xaec9f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.445 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f64b003d360 0x7f64b003f870 unknown :-1 s=CLOSED pgs=3834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.445 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 --2- 172.21.15.5:0/1968090770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xa5f240 0xa563f0 unknown :-1 s=CLOSED pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.445 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 >> 172.21.15.5:0/1968090770 conn(0x983770 msgr2=0xa5bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.445 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 shutdown_connections 2024-09-21T21:38:32.445 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.442+0000 7f64d2ae7ec0 1 -- 172.21.15.5:0/1968090770 wait complete. 2024-09-21T21:38:32.446 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.446 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj5 /etc/passwd 2024-09-21T21:38:32.484 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.482+0000 7f911de7cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.489 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.488+0000 7f911de7cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.489 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.488+0000 7f911de7cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.491 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.489+0000 7f911de7cec0 1 Processor -- start 2024-09-21T21:38:32.491 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.489+0000 7f911de7cec0 1 -- start start 2024-09-21T21:38:32.492 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.490+0000 7f911de7cec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xf19520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.492 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.490+0000 7f911de7cec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xd64520 con 0xdf9650 2024-09-21T21:38:32.492 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.490+0000 7f9115f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xf19520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.492 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.490+0000 7f9115f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xf19520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51206/0 (socket says 172.21.15.5:51206) 2024-09-21T21:38:32.492 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.490+0000 7f9115f9b640 1 -- 172.21.15.5:0/429707936 learned_addr learned my addr 172.21.15.5:0/429707936 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.491+0000 7f9115f9b640 1 -- 172.21.15.5:0/429707936 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd00e10 con 0xdf9650 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.491+0000 7f9115f9b640 1 --2- 172.21.15.5:0/429707936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xf19520 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2e291b1863c4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.491+0000 7f910f7fe640 1 -- 172.21.15.5:0/429707936 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f910002d980 con 0xdf9650 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.491+0000 7f910f7fe640 1 -- 172.21.15.5:0/429707936 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f910002db80 con 0xdf9650 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.491+0000 7f910f7fe640 1 -- 172.21.15.5:0/429707936 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f910002de20 con 0xdf9650 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.492+0000 7f911de7cec0 1 -- 172.21.15.5:0/429707936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 msgr2=0xf19520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.492+0000 7f911de7cec0 1 --2- 172.21.15.5:0/429707936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xf19520 crc :-1 s=READY pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.492+0000 7f911de7cec0 1 -- 172.21.15.5:0/429707936 shutdown_connections 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.492+0000 7f911de7cec0 1 --2- 172.21.15.5:0/429707936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xf19520 unknown :-1 s=CLOSED pgs=12932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.492+0000 7f911de7cec0 1 -- 172.21.15.5:0/429707936 >> 172.21.15.5:0/429707936 conn(0xd24770 msgr2=0xe040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.492+0000 7f911de7cec0 1 -- 172.21.15.5:0/429707936 shutdown_connections 2024-09-21T21:38:32.494 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.492+0000 7f911de7cec0 1 -- 172.21.15.5:0/429707936 wait complete. 2024-09-21T21:38:32.495 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.493+0000 7f911de7cec0 1 Processor -- start 2024-09-21T21:38:32.495 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.493+0000 7f911de7cec0 1 -- start start 2024-09-21T21:38:32.496 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.494+0000 7f911de7cec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xdfbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.496 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.494+0000 7f911de7cec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xd62280 con 0xdf9650 2024-09-21T21:38:32.496 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.494+0000 7f9115f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xdfbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.496 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.494+0000 7f9115f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xdfbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51214/0 (socket says 172.21.15.5:51214) 2024-09-21T21:38:32.496 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.494+0000 7f9115f9b640 1 -- 172.21.15.5:0/1402341423 learned_addr learned my addr 172.21.15.5:0/1402341423 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.496 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.495+0000 7f9115f9b640 1 -- 172.21.15.5:0/1402341423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xcf2920 con 0xdf9650 2024-09-21T21:38:32.497 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.495+0000 7f9115f9b640 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xdfbe50 crc :-1 s=READY pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.497 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.495+0000 7f910e7fc640 1 -- 172.21.15.5:0/1402341423 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f910002d980 con 0xdf9650 2024-09-21T21:38:32.497 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.495+0000 7f910e7fc640 1 -- 172.21.15.5:0/1402341423 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f9100037b80 con 0xdf9650 2024-09-21T21:38:32.497 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.495+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xcf2380 con 0xdf9650 2024-09-21T21:38:32.498 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.495+0000 7f910e7fc640 1 -- 172.21.15.5:0/1402341423 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9100037e20 con 0xdf9650 2024-09-21T21:38:32.498 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.495+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xe00270 con 0xdf9650 2024-09-21T21:38:32.498 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.496+0000 7f910e7fc640 1 -- 172.21.15.5:0/1402341423 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f9100003040 con 0xdf9650 2024-09-21T21:38:32.498 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.496+0000 7f910e7fc640 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f90f003d360 0x7f90f003f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.499 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.496+0000 7f910e7fc640 1 -- 172.21.15.5:0/1402341423 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f9100032040 con 0xdf9650 2024-09-21T21:38:32.499 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.497+0000 7f911de7cec0 1 --2- 172.21.15.5:0/1402341423 >> v2:172.21.15.148:6805/1161645252 conn(0xe8fa80 0xe8ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.499 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.497+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0xdff870 con 0xe8fa80 2024-09-21T21:38:32.499 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.497+0000 7f911579a640 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f90f003d360 0x7f90f003f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.499 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.497+0000 7f911579a640 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f90f003d360 0x7f90f003f870 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.499 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.497+0000 7f911679c640 1 --2- 172.21.15.5:0/1402341423 >> v2:172.21.15.148:6805/1161645252 conn(0xe8fa80 0xe8ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.502 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.500+0000 7f911679c640 1 --2- 172.21.15.5:0/1402341423 >> v2:172.21.15.148:6805/1161645252 conn(0xe8fa80 0xe8ba00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.516 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911679c640 1 -- 172.21.15.5:0/1402341423 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 obj5 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f910800c430 con 0xe8fa80 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 >> v2:172.21.15.148:6805/1161645252 conn(0xe8fa80 msgr2=0xe8ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 --2- 172.21.15.5:0/1402341423 >> v2:172.21.15.148:6805/1161645252 conn(0xe8fa80 0xe8ba00 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f90f003d360 msgr2=0x7f90f003f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f90f003d360 0x7f90f003f870 crc :-1 s=READY pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 msgr2=0xdfbe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xdfbe50 crc :-1 s=READY pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 shutdown_connections 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 --2- 172.21.15.5:0/1402341423 >> v2:172.21.15.148:6805/1161645252 conn(0xe8fa80 0xe8ba00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f90f003d360 0x7f90f003f870 unknown :-1 s=CLOSED pgs=3835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 --2- 172.21.15.5:0/1402341423 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xdf9650 0xdfbe50 unknown :-1 s=CLOSED pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 >> 172.21.15.5:0/1402341423 conn(0xd24770 msgr2=0xf1a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.517 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 shutdown_connections 2024-09-21T21:38:32.518 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.514+0000 7f911de7cec0 1 -- 172.21.15.5:0/1402341423 wait complete. 2024-09-21T21:38:32.518 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.518 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj6 /etc/passwd 2024-09-21T21:38:32.556 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.555+0000 7ff470ce4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.562 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.560+0000 7ff470ce4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.562 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.561+0000 7ff470ce4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.563 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.561+0000 7ff470ce4ec0 1 Processor -- start 2024-09-21T21:38:32.563 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.561+0000 7ff470ce4ec0 1 -- start start 2024-09-21T21:38:32.565 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff470ce4ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x1870590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.565 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff470ce4ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x16bc520 con 0x17587c0 2024-09-21T21:38:32.565 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff46903f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x1870590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.565 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff46903f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x1870590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51220/0 (socket says 172.21.15.5:51220) 2024-09-21T21:38:32.565 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff46903f640 1 -- 172.21.15.5:0/2736407657 learned_addr learned my addr 172.21.15.5:0/2736407657 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.566 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff46903f640 1 -- 172.21.15.5:0/2736407657 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1658e10 con 0x17587c0 2024-09-21T21:38:32.566 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff46903f640 1 --2- 172.21.15.5:0/2736407657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x1870590 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8d2ff5cc5bd088 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.566 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.563+0000 7ff4637fe640 1 -- 172.21.15.5:0/2736407657 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff45c02dcc0 con 0x17587c0 2024-09-21T21:38:32.566 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff4637fe640 1 -- 172.21.15.5:0/2736407657 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff45c037370 con 0x17587c0 2024-09-21T21:38:32.566 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff4637fe640 1 -- 172.21.15.5:0/2736407657 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff45c037610 con 0x17587c0 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/2736407657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 msgr2=0x1870590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/2736407657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x1870590 crc :-1 s=READY pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/2736407657 shutdown_connections 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/2736407657 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x1870590 unknown :-1 s=CLOSED pgs=12936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/2736407657 >> 172.21.15.5:0/2736407657 conn(0x167c770 msgr2=0x175a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/2736407657 shutdown_connections 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.564+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/2736407657 wait complete. 2024-09-21T21:38:32.567 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.565+0000 7ff470ce4ec0 1 Processor -- start 2024-09-21T21:38:32.568 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.565+0000 7ff470ce4ec0 1 -- start start 2024-09-21T21:38:32.569 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff470ce4ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x187f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.569 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff470ce4ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x16ba280 con 0x17587c0 2024-09-21T21:38:32.569 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff46903f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x187f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.569 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff46903f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x187f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51232/0 (socket says 172.21.15.5:51232) 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff46903f640 1 -- 172.21.15.5:0/1128984451 learned_addr learned my addr 172.21.15.5:0/1128984451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff46903f640 1 -- 172.21.15.5:0/1128984451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x164a920 con 0x17587c0 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff46903f640 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x187f8d0 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff4627fc640 1 -- 172.21.15.5:0/1128984451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff45c03e040 con 0x17587c0 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff4627fc640 1 -- 172.21.15.5:0/1128984451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff45c02db90 con 0x17587c0 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff4627fc640 1 -- 172.21.15.5:0/1128984451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff45c037e40 con 0x17587c0 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.567+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x164a380 con 0x17587c0 2024-09-21T21:38:32.570 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.568+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x17d3ef0 con 0x17587c0 2024-09-21T21:38:32.571 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.568+0000 7ff4627fc640 1 -- 172.21.15.5:0/1128984451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7ff45c041040 con 0x17587c0 2024-09-21T21:38:32.571 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.569+0000 7ff4627fc640 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff44403d360 0x7ff44403f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.571 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.569+0000 7ff4627fc640 1 -- 172.21.15.5:0/1128984451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7ff45c032040 con 0x17587c0 2024-09-21T21:38:32.571 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.569+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/1128984451 >> v2:172.21.15.5:6804/1102615197 conn(0x17ea520 0x17e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.571 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.569+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 --> v2:172.21.15.5:6804/1102615197 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x17d6c20 con 0x17ea520 2024-09-21T21:38:32.571 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.569+0000 7ff46883e640 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff44403d360 0x7ff44403f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.572 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.570+0000 7ff46883e640 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff44403d360 0x7ff44403f870 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.572 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.570+0000 7ff469840640 1 --2- 172.21.15.5:0/1128984451 >> v2:172.21.15.5:6804/1102615197 conn(0x17ea520 0x17e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.574 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.572+0000 7ff469840640 1 --2- 172.21.15.5:0/1128984451 >> v2:172.21.15.5:6804/1102615197 conn(0x17ea520 0x17e6ed0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.587 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff469840640 1 -- 172.21.15.5:0/1128984451 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== osd_op_reply(1 obj6 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7ff45400a430 con 0x17ea520 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 >> v2:172.21.15.5:6804/1102615197 conn(0x17ea520 msgr2=0x17e6ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/1128984451 >> v2:172.21.15.5:6804/1102615197 conn(0x17ea520 0x17e6ed0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff44403d360 msgr2=0x7ff44403f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff44403d360 0x7ff44403f870 crc :-1 s=READY pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 msgr2=0x187f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x187f8d0 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 shutdown_connections 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/1128984451 >> v2:172.21.15.5:6804/1102615197 conn(0x17ea520 0x17e6ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff44403d360 0x7ff44403f870 unknown :-1 s=CLOSED pgs=3836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 --2- 172.21.15.5:0/1128984451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x17587c0 0x187f8d0 unknown :-1 s=CLOSED pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 >> 172.21.15.5:0/1128984451 conn(0x167c770 msgr2=0x175a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.588 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 shutdown_connections 2024-09-21T21:38:32.589 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.585+0000 7ff470ce4ec0 1 -- 172.21.15.5:0/1128984451 wait complete. 2024-09-21T21:38:32.590 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.590 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj7 /etc/passwd 2024-09-21T21:38:32.628 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.626+0000 7f494d63bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.632+0000 7f494d63bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.632+0000 7f494d63bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.633+0000 7f494d63bec0 1 Processor -- start 2024-09-21T21:38:32.634 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.633+0000 7f494d63bec0 1 -- start start 2024-09-21T21:38:32.636 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.634+0000 7f494d63bec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xe607c0 0xe62630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.634+0000 7f494d63bec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xdc4520 con 0xe607c0 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.634+0000 7f494579b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xe607c0 0xe62630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.634+0000 7f494579b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xe607c0 0xe62630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51258/0 (socket says 172.21.15.5:51258) 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.634+0000 7f494579b640 1 -- 172.21.15.5:0/976646617 learned_addr learned my addr 172.21.15.5:0/976646617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.635+0000 7f494579b640 1 -- 172.21.15.5:0/976646617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd60e10 con 0xe607c0 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.635+0000 7f494579b640 1 --2- 172.21.15.5:0/976646617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xe607c0 0xe62630 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c0a326f32d6b65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.635+0000 7f493effd640 1 -- 172.21.15.5:0/976646617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f493002dcc0 con 0xe607c0 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.635+0000 7f493effd640 1 -- 172.21.15.5:0/976646617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4930037370 con 0xe607c0 2024-09-21T21:38:32.637 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.635+0000 7f493effd640 1 -- 172.21.15.5:0/976646617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4930037610 con 0xe607c0 2024-09-21T21:38:32.638 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.635+0000 7f494d63bec0 1 -- 172.21.15.5:0/976646617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xe607c0 msgr2=0xe62630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.638 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.635+0000 7f494d63bec0 1 --2- 172.21.15.5:0/976646617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xe607c0 0xe62630 crc :-1 s=READY pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.638 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.636+0000 7f494d63bec0 1 -- 172.21.15.5:0/976646617 shutdown_connections 2024-09-21T21:38:32.639 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.636+0000 7f494d63bec0 1 --2- 172.21.15.5:0/976646617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xe607c0 0xe62630 unknown :-1 s=CLOSED pgs=12940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.639 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.636+0000 7f494d63bec0 1 -- 172.21.15.5:0/976646617 >> 172.21.15.5:0/976646617 conn(0xd84770 msgr2=0xf7b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.639 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.636+0000 7f494d63bec0 1 -- 172.21.15.5:0/976646617 shutdown_connections 2024-09-21T21:38:32.639 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.636+0000 7f494d63bec0 1 -- 172.21.15.5:0/976646617 wait complete. 2024-09-21T21:38:32.639 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.637+0000 7f494d63bec0 1 Processor -- start 2024-09-21T21:38:32.639 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.637+0000 7f494d63bec0 1 -- start start 2024-09-21T21:38:32.640 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.638+0000 7f494d63bec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xef2520 0xedb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.638+0000 7f494d63bec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0xdc2280 con 0xef2520 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.638+0000 7f494579b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xef2520 0xedb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.638+0000 7f494579b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xef2520 0xedb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51262/0 (socket says 172.21.15.5:51262) 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.638+0000 7f494579b640 1 -- 172.21.15.5:0/2150697215 learned_addr learned my addr 172.21.15.5:0/2150697215 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.638+0000 7f494579b640 1 -- 172.21.15.5:0/2150697215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd52920 con 0xef2520 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.639+0000 7f494579b640 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xef2520 0xedb830 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.639+0000 7f493dffb640 1 -- 172.21.15.5:0/2150697215 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f493003e040 con 0xef2520 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.639+0000 7f493dffb640 1 -- 172.21.15.5:0/2150697215 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4930037b70 con 0xef2520 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.639+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd52380 con 0xef2520 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.639+0000 7f493dffb640 1 -- 172.21.15.5:0/2150697215 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f493002dcc0 con 0xef2520 2024-09-21T21:38:32.641 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.639+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0xede940 con 0xef2520 2024-09-21T21:38:32.642 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.640+0000 7f493dffb640 1 -- 172.21.15.5:0/2150697215 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f4930041040 con 0xef2520 2024-09-21T21:38:32.642 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.640+0000 7f493dffb640 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f492c03d360 0x7f492c03f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.642 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.640+0000 7f493dffb640 1 -- 172.21.15.5:0/2150697215 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f4930032040 con 0xef2520 2024-09-21T21:38:32.642 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.640+0000 7f494d63bec0 1 --2- 172.21.15.5:0/2150697215 >> v2:172.21.15.5:6801/1340303177 conn(0xeeea50 0xeeee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.642 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.640+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0xedefc0 con 0xeeea50 2024-09-21T21:38:32.643 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.641+0000 7f4944f9a640 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f492c03d360 0x7f492c03f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.643 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.641+0000 7f4945f9c640 1 --2- 172.21.15.5:0/2150697215 >> v2:172.21.15.5:6801/1340303177 conn(0xeeea50 0xeeee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.643 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.641+0000 7f4944f9a640 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f492c03d360 0x7f492c03f870 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.646 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.645+0000 7f4945f9c640 1 --2- 172.21.15.5:0/2150697215 >> v2:172.21.15.5:6801/1340303177 conn(0xeeea50 0xeeee60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.658+0000 7f4945f9c640 1 -- 172.21.15.5:0/2150697215 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj7 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f493800a430 con 0xeeea50 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.658+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 >> v2:172.21.15.5:6801/1340303177 conn(0xeeea50 msgr2=0xeeee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.658+0000 7f494d63bec0 1 --2- 172.21.15.5:0/2150697215 >> v2:172.21.15.5:6801/1340303177 conn(0xeeea50 0xeeee60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f492c03d360 msgr2=0x7f492c03f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f492c03d360 0x7f492c03f870 crc :-1 s=READY pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xef2520 msgr2=0xedb830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xef2520 0xedb830 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 shutdown_connections 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 --2- 172.21.15.5:0/2150697215 >> v2:172.21.15.5:6801/1340303177 conn(0xeeea50 0xeeee60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f492c03d360 0x7f492c03f870 unknown :-1 s=CLOSED pgs=3837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.661 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 --2- 172.21.15.5:0/2150697215 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0xef2520 0xedb830 unknown :-1 s=CLOSED pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.662 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 >> 172.21.15.5:0/2150697215 conn(0xd84770 msgr2=0xe62630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.662 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 shutdown_connections 2024-09-21T21:38:32.662 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.659+0000 7f494d63bec0 1 -- 172.21.15.5:0/2150697215 wait complete. 2024-09-21T21:38:32.663 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.663 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj8 /etc/passwd 2024-09-21T21:38:32.701 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.699+0000 7f4b4942dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.705+0000 7f4b4942dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.707 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.705+0000 7f4b4942dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.708 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.706+0000 7f4b4942dec0 1 Processor -- start 2024-09-21T21:38:32.708 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.706+0000 7f4b4942dec0 1 -- start start 2024-09-21T21:38:32.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b4942dec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9d7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b4942dec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x8ab520 con 0x9477e0 2024-09-21T21:38:32.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b4143f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9d7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b4143f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9d7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51280/0 (socket says 172.21.15.5:51280) 2024-09-21T21:38:32.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b4143f640 1 -- 172.21.15.5:0/494022355 learned_addr learned my addr 172.21.15.5:0/494022355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.710 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b4143f640 1 -- 172.21.15.5:0/494022355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x847e10 con 0x9477e0 2024-09-21T21:38:32.711 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b4143f640 1 --2- 172.21.15.5:0/494022355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9d7070 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cc6ec867ca5333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.711 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b3affd640 1 -- 172.21.15.5:0/494022355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4b2c00d790 con 0x9477e0 2024-09-21T21:38:32.711 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b3affd640 1 -- 172.21.15.5:0/494022355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4b2c00d8f0 con 0x9477e0 2024-09-21T21:38:32.711 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.708+0000 7f4b3affd640 1 -- 172.21.15.5:0/494022355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4b2c00db90 con 0x9477e0 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.709+0000 7f4b4942dec0 1 -- 172.21.15.5:0/494022355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 msgr2=0x9d7070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.709+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/494022355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9d7070 crc :-1 s=READY pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.709+0000 7f4b4942dec0 1 -- 172.21.15.5:0/494022355 shutdown_connections 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.709+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/494022355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9d7070 unknown :-1 s=CLOSED pgs=12944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.709+0000 7f4b4942dec0 1 -- 172.21.15.5:0/494022355 >> 172.21.15.5:0/494022355 conn(0x86b770 msgr2=0x949240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.709+0000 7f4b4942dec0 1 -- 172.21.15.5:0/494022355 shutdown_connections 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.709+0000 7f4b4942dec0 1 -- 172.21.15.5:0/494022355 wait complete. 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.710+0000 7f4b4942dec0 1 Processor -- start 2024-09-21T21:38:32.712 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.710+0000 7f4b4942dec0 1 -- start start 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4942dec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4942dec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x8a9280 con 0x9477e0 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4143f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4143f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9c21c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51286/0 (socket says 172.21.15.5:51286) 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4143f640 1 -- 172.21.15.5:0/2550549484 learned_addr learned my addr 172.21.15.5:0/2550549484 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4143f640 1 -- 172.21.15.5:0/2550549484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x839920 con 0x9477e0 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4143f640 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9c21c0 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.714 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b39ffb640 1 -- 172.21.15.5:0/2550549484 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4b2c009380 con 0x9477e0 2024-09-21T21:38:32.715 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b39ffb640 1 -- 172.21.15.5:0/2550549484 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4b2c013040 con 0x9477e0 2024-09-21T21:38:32.715 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x839380 con 0x9477e0 2024-09-21T21:38:32.715 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b39ffb640 1 -- 172.21.15.5:0/2550549484 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4b2c009610 con 0x9477e0 2024-09-21T21:38:32.715 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.712+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x942ce0 con 0x9477e0 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.713+0000 7f4b39ffb640 1 -- 172.21.15.5:0/2550549484 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f4b2c009770 con 0x9477e0 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.713+0000 7f4b39ffb640 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4b2803d360 0x7f4b2803f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.713+0000 7f4b39ffb640 1 -- 172.21.15.5:0/2550549484 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f4b2c052230 con 0x9477e0 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.714+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/2550549484 >> v2:172.21.15.5:6801/1340303177 conn(0x9db880 0x9422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.714+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0xe70a90 con 0x9db880 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.714+0000 7f4b40c3e640 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4b2803d360 0x7f4b2803f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.714+0000 7f4b40c3e640 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4b2803d360 0x7f4b2803f870 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.716 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.714+0000 7f4b41c40640 1 --2- 172.21.15.5:0/2550549484 >> v2:172.21.15.5:6801/1340303177 conn(0x9db880 0x9422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.719 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.717+0000 7f4b41c40640 1 --2- 172.21.15.5:0/2550549484 >> v2:172.21.15.5:6801/1340303177 conn(0x9db880 0x9422b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.734 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.730+0000 7f4b41c40640 1 -- 172.21.15.5:0/2550549484 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj8 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f4b3400a430 con 0x9db880 2024-09-21T21:38:32.734 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 >> v2:172.21.15.5:6801/1340303177 conn(0x9db880 msgr2=0x9422b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.734 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/2550549484 >> v2:172.21.15.5:6801/1340303177 conn(0x9db880 0x9422b0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.734 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4b2803d360 msgr2=0x7f4b2803f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.734 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4b2803d360 0x7f4b2803f870 crc :-1 s=READY pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.734 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 msgr2=0x9c21c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9c21c0 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 shutdown_connections 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/2550549484 >> v2:172.21.15.5:6801/1340303177 conn(0x9db880 0x9422b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f4b2803d360 0x7f4b2803f870 unknown :-1 s=CLOSED pgs=3838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 --2- 172.21.15.5:0/2550549484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x9477e0 0x9c21c0 unknown :-1 s=CLOSED pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 >> 172.21.15.5:0/2550549484 conn(0x86b770 msgr2=0x94ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 shutdown_connections 2024-09-21T21:38:32.735 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.731+0000 7f4b4942dec0 1 -- 172.21.15.5:0/2550549484 wait complete. 2024-09-21T21:38:32.736 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.736 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj9 /etc/passwd 2024-09-21T21:38:32.773 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.771+0000 7fab78834ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.779 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.777+0000 7fab78834ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.779 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.777+0000 7fab78834ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.779 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.778+0000 7fab78834ec0 1 Processor -- start 2024-09-21T21:38:32.780 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.778+0000 7fab78834ec0 1 -- start start 2024-09-21T21:38:32.781 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.779+0000 7fab78834ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.781 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.779+0000 7fab78834ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1441520 con 0x14d55f0 2024-09-21T21:38:32.781 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.779+0000 7fab7099b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.781 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.779+0000 7fab7099b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51306/0 (socket says 172.21.15.5:51306) 2024-09-21T21:38:32.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.780+0000 7fab7099b640 1 -- 172.21.15.5:0/1932003680 learned_addr learned my addr 172.21.15.5:0/1932003680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.782 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.780+0000 7fab7099b640 1 -- 172.21.15.5:0/1932003680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13dde10 con 0x14d55f0 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.780+0000 7fab7099b640 1 --2- 172.21.15.5:0/1932003680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15f9c40 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488686a1cdcb2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.780+0000 7fab6a7fc640 1 -- 172.21.15.5:0/1932003680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab5c02db10 con 0x14d55f0 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.780+0000 7fab6a7fc640 1 -- 172.21.15.5:0/1932003680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab5c02dc70 con 0x14d55f0 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.780+0000 7fab6a7fc640 1 -- 172.21.15.5:0/1932003680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab5c0374a0 con 0x14d55f0 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.781+0000 7fab78834ec0 1 -- 172.21.15.5:0/1932003680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 msgr2=0x15f9c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.781+0000 7fab78834ec0 1 --2- 172.21.15.5:0/1932003680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15f9c40 crc :-1 s=READY pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.781+0000 7fab78834ec0 1 -- 172.21.15.5:0/1932003680 shutdown_connections 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.781+0000 7fab78834ec0 1 --2- 172.21.15.5:0/1932003680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15f9c40 unknown :-1 s=CLOSED pgs=12948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.783 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.781+0000 7fab78834ec0 1 -- 172.21.15.5:0/1932003680 >> 172.21.15.5:0/1932003680 conn(0x1401770 msgr2=0x14d66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.784 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.781+0000 7fab78834ec0 1 -- 172.21.15.5:0/1932003680 shutdown_connections 2024-09-21T21:38:32.784 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.781+0000 7fab78834ec0 1 -- 172.21.15.5:0/1932003680 wait complete. 2024-09-21T21:38:32.784 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.782+0000 7fab78834ec0 1 Processor -- start 2024-09-21T21:38:32.784 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.782+0000 7fab78834ec0 1 -- start start 2024-09-21T21:38:32.785 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.783+0000 7fab78834ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15dd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.785 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.783+0000 7fab78834ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x143f280 con 0x14d55f0 2024-09-21T21:38:32.785 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.783+0000 7fab7099b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15dd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.785 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.783+0000 7fab7099b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15dd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51322/0 (socket says 172.21.15.5:51322) 2024-09-21T21:38:32.785 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.783+0000 7fab7099b640 1 -- 172.21.15.5:0/2029169384 learned_addr learned my addr 172.21.15.5:0/2029169384 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.787 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.784+0000 7fab7099b640 1 -- 172.21.15.5:0/2029169384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13cf920 con 0x14d55f0 2024-09-21T21:38:32.787 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.784+0000 7fab7099b640 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15dd530 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.787 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.784+0000 7fab697fa640 1 -- 172.21.15.5:0/2029169384 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab5c03e040 con 0x14d55f0 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.784+0000 7fab697fa640 1 -- 172.21.15.5:0/2029169384 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fab5c037e00 con 0x14d55f0 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.784+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13cf380 con 0x14d55f0 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.784+0000 7fab697fa640 1 -- 172.21.15.5:0/2029169384 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fab5c0374a0 con 0x14d55f0 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.784+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15fc3f0 con 0x14d55f0 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.785+0000 7fab697fa640 1 -- 172.21.15.5:0/2029169384 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fab5c041040 con 0x14d55f0 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.785+0000 7fab697fa640 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fab4c03d360 0x7fab4c03f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.785+0000 7fab697fa640 1 -- 172.21.15.5:0/2029169384 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7fab5c032040 con 0x14d55f0 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.786+0000 7fab78834ec0 1 --2- 172.21.15.5:0/2029169384 >> v2:172.21.15.148:6805/1161645252 conn(0x14df450 0x15f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.786+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 --> v2:172.21.15.148:6805/1161645252 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x15dfef0 con 0x14df450 2024-09-21T21:38:32.788 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.786+0000 7fab6b7fe640 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fab4c03d360 0x7fab4c03f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.789 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.786+0000 7fab6b7fe640 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fab4c03d360 0x7fab4c03f870 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.789 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.787+0000 7fab7119c640 1 --2- 172.21.15.5:0/2029169384 >> v2:172.21.15.148:6805/1161645252 conn(0x14df450 0x15f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.792 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.790+0000 7fab7119c640 1 --2- 172.21.15.5:0/2029169384 >> v2:172.21.15.148:6805/1161645252 conn(0x14df450 0x15f51f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab7119c640 1 -- 172.21.15.5:0/2029169384 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== osd_op_reply(1 obj9 [writefull 0~12875] v716'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fab6400a430 con 0x14df450 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 >> v2:172.21.15.148:6805/1161645252 conn(0x14df450 msgr2=0x15f51f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 --2- 172.21.15.5:0/2029169384 >> v2:172.21.15.148:6805/1161645252 conn(0x14df450 0x15f51f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fab4c03d360 msgr2=0x7fab4c03f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fab4c03d360 0x7fab4c03f870 crc :-1 s=READY pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 msgr2=0x15dd530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15dd530 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 shutdown_connections 2024-09-21T21:38:32.808 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 --2- 172.21.15.5:0/2029169384 >> v2:172.21.15.148:6805/1161645252 conn(0x14df450 0x15f51f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.809 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fab4c03d360 0x7fab4c03f870 unknown :-1 s=CLOSED pgs=3839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.809 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 --2- 172.21.15.5:0/2029169384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x14d55f0 0x15dd530 unknown :-1 s=CLOSED pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.809 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 >> 172.21.15.5:0/2029169384 conn(0x1401770 msgr2=0x14d66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.809 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 shutdown_connections 2024-09-21T21:38:32.809 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.805+0000 7fab78834ec0 1 -- 172.21.15.5:0/2029169384 wait complete. 2024-09-21T21:38:32.809 INFO:tasks.workunit.client.0.smithi005.stderr:+ for f in `seq 1 10` 2024-09-21T21:38:32.809 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p 4715da7e-e73f-4c7f-b923-6e65b1dabe1a put obj10 /etc/passwd 2024-09-21T21:38:32.847 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.845+0000 7f2750e3eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.853 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.851+0000 7f2750e3eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.853 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.851+0000 7f2750e3eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:38:32.854 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.852+0000 7f2750e3eec0 1 Processor -- start 2024-09-21T21:38:32.854 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.852+0000 7f2750e3eec0 1 -- start start 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.853+0000 7f2750e3eec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2094ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f2750e3eec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1ffe520 con 0x209a7c0 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f2748f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2094ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f2748f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2094ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51350/0 (socket says 172.21.15.5:51350) 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f2748f9b640 1 -- 172.21.15.5:0/2314677873 learned_addr learned my addr 172.21.15.5:0/2314677873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f2748f9b640 1 -- 172.21.15.5:0/2314677873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f9ae10 con 0x209a7c0 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f2748f9b640 1 --2- 172.21.15.5:0/2314677873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2094ee0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8117de8d87cb0d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.856 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f27427fc640 1 -- 172.21.15.5:0/2314677873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f27340061e0 con 0x209a7c0 2024-09-21T21:38:32.857 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f27427fc640 1 -- 172.21.15.5:0/2314677873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2734006340 con 0x209a7c0 2024-09-21T21:38:32.857 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.854+0000 7f27427fc640 1 -- 172.21.15.5:0/2314677873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2734001b00 con 0x209a7c0 2024-09-21T21:38:32.857 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.855+0000 7f2750e3eec0 1 -- 172.21.15.5:0/2314677873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 msgr2=0x2094ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.855+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/2314677873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2094ee0 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.855+0000 7f2750e3eec0 1 -- 172.21.15.5:0/2314677873 shutdown_connections 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.855+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/2314677873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2094ee0 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.855+0000 7f2750e3eec0 1 -- 172.21.15.5:0/2314677873 >> 172.21.15.5:0/2314677873 conn(0x1fbe770 msgr2=0x212b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.855+0000 7f2750e3eec0 1 -- 172.21.15.5:0/2314677873 shutdown_connections 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.855+0000 7f2750e3eec0 1 -- 172.21.15.5:0/2314677873 wait complete. 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.856+0000 7f2750e3eec0 1 Processor -- start 2024-09-21T21:38:32.858 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.856+0000 7f2750e3eec0 1 -- start start 2024-09-21T21:38:32.860 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.857+0000 7f2750e3eec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2117320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.860 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.857+0000 7f2750e3eec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1ffc280 con 0x209a7c0 2024-09-21T21:38:32.860 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f2748f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2117320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.860 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f2748f9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2117320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51366/0 (socket says 172.21.15.5:51366) 2024-09-21T21:38:32.860 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f2748f9b640 1 -- 172.21.15.5:0/1014143295 learned_addr learned my addr 172.21.15.5:0/1014143295 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:38:32.861 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f2748f9b640 1 -- 172.21.15.5:0/1014143295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1f8c920 con 0x209a7c0 2024-09-21T21:38:32.861 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f2748f9b640 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2117320 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.861 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f27417fa640 1 -- 172.21.15.5:0/1014143295 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2734004a60 con 0x209a7c0 2024-09-21T21:38:32.861 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f27417fa640 1 -- 172.21.15.5:0/1014143295 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2734004bc0 con 0x209a7c0 2024-09-21T21:38:32.861 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1f8c380 con 0x209a7c0 2024-09-21T21:38:32.861 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f27417fa640 1 -- 172.21.15.5:0/1014143295 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2734004e60 con 0x209a7c0 2024-09-21T21:38:32.861 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.858+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x21195d0 con 0x209a7c0 2024-09-21T21:38:32.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.859+0000 7f27417fa640 1 -- 172.21.15.5:0/1014143295 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f27340133a0 con 0x209a7c0 2024-09-21T21:38:32.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.860+0000 7f27417fa640 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f273003d360 0x7f273003f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.860+0000 7f27417fa640 1 -- 172.21.15.5:0/1014143295 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(716..716 src has 1..716) ==== 4207+0+0 (crc 0 0 0) 0x7f273404fe80 con 0x209a7c0 2024-09-21T21:38:32.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.860+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/1014143295 >> v2:172.21.15.5:6801/1340303177 conn(0x212f890 0x25c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:38:32.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.860+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 --> v2:172.21.15.5:6801/1340303177 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e716) -- 0x211a2d0 con 0x212f890 2024-09-21T21:38:32.862 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.860+0000 7f27437fe640 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f273003d360 0x7f273003f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:38:32.863 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.860+0000 7f27437fe640 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f273003d360 0x7f273003f870 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.863 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.861+0000 7f274979c640 1 --2- 172.21.15.5:0/1014143295 >> v2:172.21.15.5:6801/1340303177 conn(0x212f890 0x25c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:38:32.866 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.864+0000 7f274979c640 1 --2- 172.21.15.5:0/1014143295 >> v2:172.21.15.5:6801/1340303177 conn(0x212f890 0x25c5ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f274979c640 1 -- 172.21.15.5:0/1014143295 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== osd_op_reply(1 obj10 [writefull 0~12875] v716'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f273c00c430 con 0x212f890 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 >> v2:172.21.15.5:6801/1340303177 conn(0x212f890 msgr2=0x25c5ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/1014143295 >> v2:172.21.15.5:6801/1340303177 conn(0x212f890 0x25c5ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f273003d360 msgr2=0x7f273003f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f273003d360 0x7f273003f870 crc :-1 s=READY pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 msgr2=0x2117320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2117320 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 shutdown_connections 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/1014143295 >> v2:172.21.15.5:6801/1340303177 conn(0x212f890 0x25c5ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f273003d360 0x7f273003f870 unknown :-1 s=CLOSED pgs=3840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 --2- 172.21.15.5:0/1014143295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x209a7c0 0x2117320 unknown :-1 s=CLOSED pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:38:32.881 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.878+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 >> 172.21.15.5:0/1014143295 conn(0x1fbe770 msgr2=0x212e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:38:32.882 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.879+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 shutdown_connections 2024-09-21T21:38:32.882 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:38:32.879+0000 7f2750e3eec0 1 -- 172.21.15.5:0/1014143295 wait complete. 2024-09-21T21:38:32.883 INFO:tasks.workunit.client.0.smithi005.stderr:+ sleep 30 2024-09-21T21:39:02.884 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p e9819043-ddba-4507-b76c-4ec545d96daf put threemore /etc/passwd 2024-09-21T21:39:02.931 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.929+0000 7f434e534ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:02.937 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.935+0000 7f434e534ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:02.937 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.935+0000 7f434e534ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:02.938 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.936+0000 7f434e534ec0 1 Processor -- start 2024-09-21T21:39:02.938 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.936+0000 7f434e534ec0 1 -- start start 2024-09-21T21:39:02.942 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.938+0000 7f434e534ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x1f8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:02.942 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.938+0000 7f434e534ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1f0b520 con 0x1f9f5f0 2024-09-21T21:39:02.942 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.938+0000 7f434683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x1f8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:02.942 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.938+0000 7f434683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x1f8cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34778/0 (socket says 172.21.15.5:34778) 2024-09-21T21:39:02.943 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.938+0000 7f434683f640 1 -- 172.21.15.5:0/3106754023 learned_addr learned my addr 172.21.15.5:0/3106754023 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:02.943 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.939+0000 7f434683f640 1 -- 172.21.15.5:0/3106754023 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1ea7e10 con 0x1f9f5f0 2024-09-21T21:39:02.943 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.939+0000 7f434683f640 1 --2- 172.21.15.5:0/3106754023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x1f8cc50 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539852f61c7d3974 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:02.943 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.939+0000 7f434503c640 1 -- 172.21.15.5:0/3106754023 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f433002dbb0 con 0x1f9f5f0 2024-09-21T21:39:02.943 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.939+0000 7f434503c640 1 -- 172.21.15.5:0/3106754023 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4330033040 con 0x1f9f5f0 2024-09-21T21:39:02.943 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.939+0000 7f434503c640 1 -- 172.21.15.5:0/3106754023 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f433002de40 con 0x1f9f5f0 2024-09-21T21:39:02.944 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.940+0000 7f434e534ec0 1 -- 172.21.15.5:0/3106754023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 msgr2=0x1f8cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:02.944 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.940+0000 7f434e534ec0 1 --2- 172.21.15.5:0/3106754023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x1f8cc50 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.944 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.940+0000 7f434e534ec0 1 -- 172.21.15.5:0/3106754023 shutdown_connections 2024-09-21T21:39:02.944 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.940+0000 7f434e534ec0 1 --2- 172.21.15.5:0/3106754023 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x1f8cc50 unknown :-1 s=CLOSED pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.944 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.940+0000 7f434e534ec0 1 -- 172.21.15.5:0/3106754023 >> 172.21.15.5:0/3106754023 conn(0x1ecb770 msgr2=0x1fa06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:02.944 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.940+0000 7f434e534ec0 1 -- 172.21.15.5:0/3106754023 shutdown_connections 2024-09-21T21:39:02.945 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.940+0000 7f434e534ec0 1 -- 172.21.15.5:0/3106754023 wait complete. 2024-09-21T21:39:02.949 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.941+0000 7f434e534ec0 1 Processor -- start 2024-09-21T21:39:02.949 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.941+0000 7f434e534ec0 1 -- start start 2024-09-21T21:39:02.950 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.942+0000 7f434e534ec0 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x20ab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:02.950 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.942+0000 7f434e534ec0 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x1f09280 con 0x1f9f5f0 2024-09-21T21:39:02.950 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f434683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x20ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:02.950 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f434683f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x20ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34780/0 (socket says 172.21.15.5:34780) 2024-09-21T21:39:02.950 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f434683f640 1 -- 172.21.15.5:0/2042592302 learned_addr learned my addr 172.21.15.5:0/2042592302 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:02.950 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f434683f640 1 -- 172.21.15.5:0/2042592302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1e99920 con 0x1f9f5f0 2024-09-21T21:39:02.951 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f434683f640 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x20ab750 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:02.951 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f433f7fe640 1 -- 172.21.15.5:0/2042592302 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f433003a610 con 0x1f9f5f0 2024-09-21T21:39:02.951 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f433f7fe640 1 -- 172.21.15.5:0/2042592302 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f433003a770 con 0x1f9f5f0 2024-09-21T21:39:02.951 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1e99380 con 0x1f9f5f0 2024-09-21T21:39:02.951 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f433f7fe640 1 -- 172.21.15.5:0/2042592302 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f433003aa10 con 0x1f9f5f0 2024-09-21T21:39:02.951 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.943+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x20c49d0 con 0x1f9f5f0 2024-09-21T21:39:02.952 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.944+0000 7f433f7fe640 1 -- 172.21.15.5:0/2042592302 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f433003abc0 con 0x1f9f5f0 2024-09-21T21:39:02.952 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.945+0000 7f433f7fe640 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f432c03d360 0x7f432c03f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:02.952 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.945+0000 7f433f7fe640 1 -- 172.21.15.5:0/2042592302 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(718..718 src has 1..718) ==== 4207+0+0 (crc 0 0 0) 0x7f433003f040 con 0x1f9f5f0 2024-09-21T21:39:02.952 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.945+0000 7f433f7fe640 1 -- 172.21.15.5:0/2042592302 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7f432c043df0 con 0x1f9f5f0 2024-09-21T21:39:02.952 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.945+0000 7f434e534ec0 1 --2- 172.21.15.5:0/2042592302 >> v2:172.21.15.148:6803/877610312 conn(0x1fa9450 0x20c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:02.952 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.945+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 --> v2:172.21.15.148:6803/877610312 -- osd_op(unknown.0.0:1 199.2 199:47cad802:::threemore:head [writefull 0~12875 in=12875b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e718) -- 0x20ae290 con 0x1fa9450 2024-09-21T21:39:02.953 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.945+0000 7f434603e640 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f432c03d360 0x7f432c03f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:02.953 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.946+0000 7f434603e640 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f432c03d360 0x7f432c03f870 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:02.953 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.946+0000 7f4347040640 1 --2- 172.21.15.5:0/2042592302 >> v2:172.21.15.148:6803/877610312 conn(0x1fa9450 0x20c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:39:02.953 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.951+0000 7f4347040640 1 --2- 172.21.15.5:0/2042592302 >> v2:172.21.15.148:6803/877610312 conn(0x1fa9450 0x20c3490 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:02.973 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f4347040640 1 -- 172.21.15.5:0/2042592302 <== osd.2 v2:172.21.15.148:6803/877610312 1 ==== osd_op_reply(1 threemore [writefull 0~12875] v718'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f433800c430 con 0x1fa9450 2024-09-21T21:39:02.973 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 >> v2:172.21.15.148:6803/877610312 conn(0x1fa9450 msgr2=0x20c3490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:02.973 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 --2- 172.21.15.5:0/2042592302 >> v2:172.21.15.148:6803/877610312 conn(0x1fa9450 0x20c3490 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.973 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f432c03d360 msgr2=0x7f432c03f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:02.973 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f432c03d360 0x7f432c03f870 crc :-1 s=READY pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.973 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 msgr2=0x20ab750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x20ab750 crc :-1 s=READY pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 shutdown_connections 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 --2- 172.21.15.5:0/2042592302 >> v2:172.21.15.148:6803/877610312 conn(0x1fa9450 0x20c3490 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f432c03d360 0x7f432c03f870 unknown :-1 s=CLOSED pgs=3841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 --2- 172.21.15.5:0/2042592302 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x1f9f5f0 0x20ab750 unknown :-1 s=CLOSED pgs=12957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 >> 172.21.15.5:0/2042592302 conn(0x1ecb770 msgr2=0x1fa06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 shutdown_connections 2024-09-21T21:39:02.974 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:02.970+0000 7f434e534ec0 1 -- 172.21.15.5:0/2042592302 wait complete. 2024-09-21T21:39:02.975 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota e9819043-ddba-4507-b76c-4ec545d96daf max_bytes 0 2024-09-21T21:39:03.076 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.066+0000 7fdb07674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:03.077 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.075+0000 7fdb07674640 1 Processor -- start 2024-09-21T21:39:03.077 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.076+0000 7fdb07674640 1 -- start start 2024-09-21T21:39:03.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.077+0000 7fdb07674640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb0006f6b0 0x7fdb000a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:03.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.077+0000 7fdb07674640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0006fe80 con 0x7fdb000a2180 2024-09-21T21:39:03.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.077+0000 7fdb07674640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fdb000709b0 con 0x7fdb0006f6b0 2024-09-21T21:39:03.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.077+0000 7fdb05410640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb0006f6b0 0x7fdb000a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:03.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.077+0000 7fdb04c0f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fdb000a2180 0x7fdb00133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33870/0 (socket says 172.21.15.5:33870) 2024-09-21T21:39:03.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.077+0000 7fdb04c0f640 1 -- 172.21.15.5:0/271770179 learned_addr learned my addr 172.21.15.5:0/271770179 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:03.080 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.077+0000 7fdb05410640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fdb0006f6b0 0x7fdb000a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34796/0 (socket says 172.21.15.5:34796) 2024-09-21T21:39:03.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.078+0000 7fdb05410640 1 -- 172.21.15.5:0/271770179 >> v1:172.21.15.5:6789/0 conn(0x7fdb000a2180 legacy=0x7fdb00133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:03.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.078+0000 7fdb05410640 1 -- 172.21.15.5:0/271770179 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0006fb70 con 0x7fdb0006f6b0 2024-09-21T21:39:03.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.078+0000 7fdb05410640 1 --2- 172.21.15.5:0/271770179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0006f6b0 0x7fdb000a1c40 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d12f6b39bed154 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:03.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.078+0000 7fdaf7fff640 1 -- 172.21.15.5:0/271770179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdafc009d90 con 0x7fdb0006f6b0 2024-09-21T21:39:03.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.078+0000 7fdaf7fff640 1 -- 172.21.15.5:0/271770179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdafc00e230 con 0x7fdb0006f6b0 2024-09-21T21:39:03.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.078+0000 7fdaf7fff640 1 -- 172.21.15.5:0/271770179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdafc00e4d0 con 0x7fdb0006f6b0 2024-09-21T21:39:03.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 1 -- 172.21.15.5:0/271770179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0006f6b0 msgr2=0x7fdb000a1c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:03.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 1 --2- 172.21.15.5:0/271770179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0006f6b0 0x7fdb000a1c40 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:03.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 1 -- 172.21.15.5:0/271770179 shutdown_connections 2024-09-21T21:39:03.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 1 --2- 172.21.15.5:0/271770179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb0006f6b0 0x7fdb000a1c40 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:03.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 1 -- 172.21.15.5:0/271770179 >> 172.21.15.5:0/271770179 conn(0x7fdb000a3400 msgr2=0x7fdb000a3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:03.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 1 -- 172.21.15.5:0/271770179 shutdown_connections 2024-09-21T21:39:03.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 1 -- 172.21.15.5:0/271770179 wait complete. 2024-09-21T21:39:03.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.079+0000 7fdb07674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:03.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.081+0000 7fdb07674640 1 Processor -- start 2024-09-21T21:39:03.083 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.081+0000 7fdb07674640 1 -- start start 2024-09-21T21:39:03.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb07674640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb000a2180 0x7fdb001c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:03.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb07674640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdb00123740 con 0x7fdb000a2180 2024-09-21T21:39:03.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb05410640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb000a2180 0x7fdb001c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:03.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb05410640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb000a2180 0x7fdb001c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34808/0 (socket says 172.21.15.5:34808) 2024-09-21T21:39:03.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb05410640 1 -- 172.21.15.5:0/2384230048 learned_addr learned my addr 172.21.15.5:0/2384230048 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:03.085 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb05410640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb00073670 con 0x7fdb000a2180 2024-09-21T21:39:03.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb05410640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb000a2180 0x7fdb001c7f60 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:03.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdafc014620 con 0x7fdb000a2180 2024-09-21T21:39:03.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdafc014780 con 0x7fdb000a2180 2024-09-21T21:39:03.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb00124dd0 con 0x7fdb000a2180 2024-09-21T21:39:03.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.083+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdafc014a20 con 0x7fdb000a2180 2024-09-21T21:39:03.086 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.084+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb001233a0 con 0x7fdb000a2180 2024-09-21T21:39:03.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.084+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fdafc014bd0 con 0x7fdb000a2180 2024-09-21T21:39:03.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.085+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0006f6b0 con 0x7fdb000a2180 2024-09-21T21:39:03.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.085+0000 7fdaf5ffb640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdae403eb20 0x7fdae4041030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:03.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.085+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(718..718 src has 1..718) ==== 4207+0+0 (crc 0 0 0) 0x7fdafc019040 con 0x7fdb000a2180 2024-09-21T21:39:03.087 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.085+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=719}) -- 0x7fdae4045630 con 0x7fdb000a2180 2024-09-21T21:39:03.088 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.085+0000 7fdb04c0f640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdae403eb20 0x7fdae4041030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:03.088 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.086+0000 7fdb04c0f640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdae403eb20 0x7fdae4041030 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:03.092 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.090+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fdafc012580 con 0x7fdb000a2180 2024-09-21T21:39:03.294 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:03.292+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"} v 0) -- 0x7fdb00078820 con 0x7fdb000a2180 2024-09-21T21:39:04.034 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:04.032+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v719) ==== 217+0+0 (crc 0 0 0) 0x7fdafc008f20 con 0x7fdb000a2180 2024-09-21T21:39:04.034 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:04.032+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(719..719 src has 1..719) ==== 628+0+0 (crc 0 0 0) 0x7fdafc018710 con 0x7fdb000a2180 2024-09-21T21:39:04.034 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:04.032+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=720}) -- 0x7fdae40466a0 con 0x7fdb000a2180 2024-09-21T21:39:04.158 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:04.157+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"} v 0) -- 0x7fdb000704a0 con 0x7fdb000a2180 2024-09-21T21:39:05.035 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.033+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v720) ==== 217+0+0 (crc 0 0 0) 0x7fdafc018190 con 0x7fdb000a2180 2024-09-21T21:39:05.035 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_bytes = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:39:05.035 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.033+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 <== mon.0 v2:172.21.15.5:3300/0 10 ==== osd_map(720..720 src has 1..720) ==== 628+0+0 (crc 0 0 0) 0x7fdafc0504e0 con 0x7fdb000a2180 2024-09-21T21:39:05.035 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.033+0000 7fdaf5ffb640 1 -- 172.21.15.5:0/2384230048 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7fdae40467c0 con 0x7fdb000a2180 2024-09-21T21:39:05.038 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.036+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdae403eb20 msgr2=0x7fdae4041030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.036+0000 7fdb07674640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdae403eb20 0x7fdae4041030 crc :-1 s=READY pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.036+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb000a2180 msgr2=0x7fdb001c7f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.036+0000 7fdb07674640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb000a2180 0x7fdb001c7f60 crc :-1 s=READY pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.036+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 shutdown_connections 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.036+0000 7fdb07674640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fdae403eb20 0x7fdae4041030 unknown :-1 s=CLOSED pgs=3842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.036+0000 7fdb07674640 1 --2- 172.21.15.5:0/2384230048 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdb000a2180 0x7fdb001c7f60 unknown :-1 s=CLOSED pgs=12960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.037+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 >> 172.21.15.5:0/2384230048 conn(0x7fdb000a3400 msgr2=0x7fdb0009da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.037+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 shutdown_connections 2024-09-21T21:39:05.039 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.037+0000 7fdb07674640 1 -- 172.21.15.5:0/2384230048 wait complete. 2024-09-21T21:39:05.057 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool set-quota e9819043-ddba-4507-b76c-4ec545d96daf max_objects 0 2024-09-21T21:39:05.175 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.164+0000 7f62dad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:05.176 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.174+0000 7f62dad91640 1 Processor -- start 2024-09-21T21:39:05.176 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.174+0000 7f62dad91640 1 -- start start 2024-09-21T21:39:05.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62dad91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62d406f6b0 0x7f62d40a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:05.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62dad91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62d406fe80 con 0x7f62d40a2180 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62dad91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f62d40709b0 con 0x7f62d406f6b0 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d8b2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62d406f6b0 0x7f62d40a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d8b2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f62d406f6b0 0x7f62d40a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34820/0 (socket says 172.21.15.5:34820) 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d8b2d640 1 -- 172.21.15.5:0/3293034112 learned_addr learned my addr 172.21.15.5:0/3293034112 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d3fff640 1 --1- 172.21.15.5:0/3293034112 >> v1:172.21.15.5:6789/0 conn(0x7f62d40a2180 0x7f62d4133cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:33884/0 (socket says 172.21.15.5:33884) 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d8b2d640 1 -- 172.21.15.5:0/3293034112 >> v1:172.21.15.5:6789/0 conn(0x7f62d40a2180 legacy=0x7f62d4133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d8b2d640 1 -- 172.21.15.5:0/3293034112 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d406fb70 con 0x7f62d406f6b0 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d37fe640 1 -- 172.21.15.5:0/3293034112 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128022813 0 0) 0x7f62d406fe80 con 0x7f62d40a2180 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d8b2d640 1 --2- 172.21.15.5:0/3293034112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d406f6b0 0x7f62d40a1c40 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc042de11ce50af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.176+0000 7f62d37fe640 1 -- 172.21.15.5:0/3293034112 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62c4009e50 con 0x7f62d406f6b0 2024-09-21T21:39:05.179 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62d37fe640 1 -- 172.21.15.5:0/3293034112 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62c400e230 con 0x7f62d406f6b0 2024-09-21T21:39:05.180 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62d37fe640 1 -- 172.21.15.5:0/3293034112 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62c400e4d0 con 0x7f62d406f6b0 2024-09-21T21:39:05.180 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62dad91640 1 -- 172.21.15.5:0/3293034112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d406f6b0 msgr2=0x7f62d40a1c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:05.180 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62dad91640 1 --2- 172.21.15.5:0/3293034112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d406f6b0 0x7f62d40a1c40 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62dad91640 1 -- 172.21.15.5:0/3293034112 shutdown_connections 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62dad91640 1 --2- 172.21.15.5:0/3293034112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d406f6b0 0x7f62d40a1c40 unknown :-1 s=CLOSED pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62dad91640 1 -- 172.21.15.5:0/3293034112 >> 172.21.15.5:0/3293034112 conn(0x7f62d40a3400 msgr2=0x7f62d40a3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62dad91640 1 -- 172.21.15.5:0/3293034112 shutdown_connections 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.177+0000 7f62dad91640 1 -- 172.21.15.5:0/3293034112 wait complete. 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.178+0000 7f62dad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.179+0000 7f62dad91640 1 Processor -- start 2024-09-21T21:39:05.181 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.179+0000 7f62dad91640 1 -- start start 2024-09-21T21:39:05.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.181+0000 7f62dad91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40a2180 0x7f62d40a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:05.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.181+0000 7f62dad91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f62d40a1550 con 0x7f62d40a2180 2024-09-21T21:39:05.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.181+0000 7f62d8b2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40a2180 0x7f62d40a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:05.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.181+0000 7f62d8b2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40a2180 0x7f62d40a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34824/0 (socket says 172.21.15.5:34824) 2024-09-21T21:39:05.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.181+0000 7f62d8b2d640 1 -- 172.21.15.5:0/278595782 learned_addr learned my addr 172.21.15.5:0/278595782 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:05.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.182+0000 7f62d8b2d640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d4127bc0 con 0x7f62d40a2180 2024-09-21T21:39:05.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.182+0000 7f62d8b2d640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40a2180 0x7f62d40a0200 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:05.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.182+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62c400edc0 con 0x7f62d40a2180 2024-09-21T21:39:05.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.182+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f62c4015420 con 0x7f62d40a2180 2024-09-21T21:39:05.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.182+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d41293b0 con 0x7f62d40a2180 2024-09-21T21:39:05.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.182+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f62c40156c0 con 0x7f62d40a2180 2024-09-21T21:39:05.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.182+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d4128860 con 0x7f62d40a2180 2024-09-21T21:39:05.185 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.183+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f62c4015870 con 0x7f62d40a2180 2024-09-21T21:39:05.185 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.183+0000 7f62d17fa640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c003ead0 0x7f62c0040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:05.185 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.183+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(720..720 src has 1..720) ==== 4207+0+0 (crc 0 0 0) 0x7f62c4051640 con 0x7f62d40a2180 2024-09-21T21:39:05.186 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.183+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d406f6b0 con 0x7f62d40a2180 2024-09-21T21:39:05.186 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.183+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=721}) -- 0x7f62c0045560 con 0x7f62d40a2180 2024-09-21T21:39:05.186 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.184+0000 7f62d3fff640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c003ead0 0x7f62c0040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:05.186 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.184+0000 7f62d3fff640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c003ead0 0x7f62c0040fe0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:05.190 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.189+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f62c4014c60 con 0x7f62d40a2180 2024-09-21T21:39:05.380 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:05.379+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"} v 0) -- 0x7f62d4078820 con 0x7f62d40a2180 2024-09-21T21:39:06.043 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:06.041+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v721) ==== 221+0+0 (crc 0 0 0) 0x7f62c40109c0 con 0x7f62d40a2180 2024-09-21T21:39:06.043 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:06.041+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(721..721 src has 1..721) ==== 628+0+0 (crc 0 0 0) 0x7f62c4011e00 con 0x7f62d40a2180 2024-09-21T21:39:06.043 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:06.041+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=722}) -- 0x7f62c0046430 con 0x7f62d40a2180 2024-09-21T21:39:06.178 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:06.174+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"} v 0) -- 0x7f62d409fae0 con 0x7f62d40a2180 2024-09-21T21:39:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.042+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf v722) ==== 221+0+0 (crc 0 0 0) 0x7f62c400f2a0 con 0x7f62d40a2180 2024-09-21T21:39:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:set-quota max_objects = 0 for pool e9819043-ddba-4507-b76c-4ec545d96daf 2024-09-21T21:39:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.042+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 <== mon.0 v2:172.21.15.5:3300/0 10 ==== osd_map(722..722 src has 1..722) ==== 628+0+0 (crc 0 0 0) 0x7f62c4001b50 con 0x7f62d40a2180 2024-09-21T21:39:07.044 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.042+0000 7f62d17fa640 1 -- 172.21.15.5:0/278595782 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7f62c0046620 con 0x7f62d40a2180 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c003ead0 msgr2=0x7f62c0040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c003ead0 0x7f62c0040fe0 crc :-1 s=READY pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40a2180 msgr2=0x7f62d40a0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40a2180 0x7f62d40a0200 crc :-1 s=READY pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 shutdown_connections 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f62c003ead0 0x7f62c0040fe0 unknown :-1 s=CLOSED pgs=3843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 --2- 172.21.15.5:0/278595782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f62d40a2180 0x7f62d40a0200 unknown :-1 s=CLOSED pgs=12963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 >> 172.21.15.5:0/278595782 conn(0x7f62d40a3400 msgr2=0x7f62d4072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:07.049 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 shutdown_connections 2024-09-21T21:39:07.050 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:07.047+0000 7f62dad91640 1 -- 172.21.15.5:0/278595782 wait complete. 2024-09-21T21:39:07.071 INFO:tasks.workunit.client.0.smithi005.stderr:+ sleep 30 2024-09-21T21:39:37.074 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool delete e9819043-ddba-4507-b76c-4ec545d96daf e9819043-ddba-4507-b76c-4ec545d96daf --yes-i-really-really-mean-it 2024-09-21T21:39:37.183 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.172+0000 7f1b8ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:37.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.183+0000 7f1b8ef91640 1 Processor -- start 2024-09-21T21:39:37.184 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.183+0000 7f1b8ef91640 1 -- start start 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.184+0000 7f1b8ef91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b8809c6e0 0x7f1b88137850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.184+0000 7f1b8ef91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b880a1ae0 con 0x7f1b88098480 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.184+0000 7f1b8ef91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1b8809e590 con 0x7f1b8809c6e0 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.184+0000 7f1b87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b8809c6e0 0x7f1b88137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.184+0000 7f1b87fff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f1b8809c6e0 0x7f1b88137850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44086/0 (socket says 172.21.15.5:44086) 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.184+0000 7f1b8cd2d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f1b88098480 0x7f1b8809bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52948/0 (socket says 172.21.15.5:52948) 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.184+0000 7f1b87fff640 1 -- 172.21.15.5:0/2134428653 learned_addr learned my addr 172.21.15.5:0/2134428653 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.185+0000 7f1b87fff640 1 -- 172.21.15.5:0/2134428653 >> v1:172.21.15.5:6789/0 conn(0x7f1b88098480 legacy=0x7f1b8809bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:37.187 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.185+0000 7f1b87fff640 1 -- 172.21.15.5:0/2134428653 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b88098960 con 0x7f1b8809c6e0 2024-09-21T21:39:37.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.185+0000 7f1b877fe640 1 -- 172.21.15.5:0/2134428653 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941835421 0 0) 0x7f1b880a1ae0 con 0x7f1b88098480 2024-09-21T21:39:37.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.185+0000 7f1b87fff640 1 --2- 172.21.15.5:0/2134428653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8809c6e0 0x7f1b88137850 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec09e3454a3f00e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:37.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.185+0000 7f1b877fe640 1 -- 172.21.15.5:0/2134428653 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b7800e040 con 0x7f1b8809c6e0 2024-09-21T21:39:37.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.185+0000 7f1b877fe640 1 -- 172.21.15.5:0/2134428653 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1b780091e0 con 0x7f1b8809c6e0 2024-09-21T21:39:37.188 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.185+0000 7f1b877fe640 1 -- 172.21.15.5:0/2134428653 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b78007730 con 0x7f1b8809c6e0 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 1 -- 172.21.15.5:0/2134428653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8809c6e0 msgr2=0x7f1b88137850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 1 --2- 172.21.15.5:0/2134428653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8809c6e0 0x7f1b88137850 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 1 -- 172.21.15.5:0/2134428653 shutdown_connections 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 1 --2- 172.21.15.5:0/2134428653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8809c6e0 0x7f1b88137850 unknown :-1 s=CLOSED pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 1 -- 172.21.15.5:0/2134428653 >> 172.21.15.5:0/2134428653 conn(0x7f1b880a0d40 msgr2=0x7f1b880a1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 1 -- 172.21.15.5:0/2134428653 shutdown_connections 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 1 -- 172.21.15.5:0/2134428653 wait complete. 2024-09-21T21:39:37.189 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.186+0000 7f1b8ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:37.190 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.188+0000 7f1b8ef91640 1 Processor -- start 2024-09-21T21:39:37.190 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.188+0000 7f1b8ef91640 1 -- start start 2024-09-21T21:39:37.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.190+0000 7f1b8ef91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b88098480 0x7f1b880974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:37.192 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.190+0000 7f1b8ef91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88096b80 con 0x7f1b88098480 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.190+0000 7f1b8cd2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b88098480 0x7f1b880974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.190+0000 7f1b8cd2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b88098480 0x7f1b880974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44090/0 (socket says 172.21.15.5:44090) 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.190+0000 7f1b8cd2d640 1 -- 172.21.15.5:0/3690012450 learned_addr learned my addr 172.21.15.5:0/3690012450 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.190+0000 7f1b8cd2d640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8806db90 con 0x7f1b88098480 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.190+0000 7f1b8cd2d640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b88098480 0x7f1b880974d0 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.191+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b70004b80 con 0x7f1b88098480 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.191+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1b70004ce0 con 0x7f1b88098480 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.191+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b880a02d0 con 0x7f1b88098480 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.191+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1b70007120 con 0x7f1b88098480 2024-09-21T21:39:37.193 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.191+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b880970a0 con 0x7f1b88098480 2024-09-21T21:39:37.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.192+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8809ab30 con 0x7f1b88098480 2024-09-21T21:39:37.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.192+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f1b700072d0 con 0x7f1b88098480 2024-09-21T21:39:37.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.192+0000 7f1b857fa640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1b6803ead0 0x7f1b68040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:37.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.192+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(722..722 src has 1..722) ==== 4207+0+0 (crc 0 0 0) 0x7f1b70050030 con 0x7f1b88098480 2024-09-21T21:39:37.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.192+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=723}) -- 0x7f1b68045560 con 0x7f1b88098480 2024-09-21T21:39:37.194 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.192+0000 7f1b87fff640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1b6803ead0 0x7f1b68040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:37.195 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.193+0000 7f1b87fff640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1b6803ead0 0x7f1b68040fe0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:37.199 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.197+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f1b7000f420 con 0x7f1b88098480 2024-09-21T21:39:37.388 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:37.386+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pool2": "e9819043-ddba-4507-b76c-4ec545d96daf", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1b88094600 con 0x7f1b88098480 2024-09-21T21:39:38.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.079+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pool2": "e9819043-ddba-4507-b76c-4ec545d96daf", "yes_i_really_really_mean_it": true}]=0 pool 'e9819043-ddba-4507-b76c-4ec545d96daf' removed v723) ==== 248+0+0 (crc 0 0 0) 0x7f1b7000a0c0 con 0x7f1b88098480 2024-09-21T21:39:38.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.079+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(723..723 src has 1..723) ==== 296+0+0 (crc 0 0 0) 0x7f1b7000cdc0 con 0x7f1b88098480 2024-09-21T21:39:38.081 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.079+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7f1b68046100 con 0x7f1b88098480 2024-09-21T21:39:38.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.233+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pool2": "e9819043-ddba-4507-b76c-4ec545d96daf", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1b8809b740 con 0x7f1b88098480 2024-09-21T21:39:38.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.233+0000 7f1b857fa640 1 -- 172.21.15.5:0/3690012450 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "e9819043-ddba-4507-b76c-4ec545d96daf", "pool2": "e9819043-ddba-4507-b76c-4ec545d96daf", "yes_i_really_really_mean_it": true}]=0 pool 'e9819043-ddba-4507-b76c-4ec545d96daf' does not exist v723) ==== 255+0+0 (crc 0 0 0) 0x7f1b7000a7b0 con 0x7f1b88098480 2024-09-21T21:39:38.235 INFO:tasks.workunit.client.0.smithi005.stderr:pool 'e9819043-ddba-4507-b76c-4ec545d96daf' does not exist 2024-09-21T21:39:38.238 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1b6803ead0 msgr2=0x7f1b68040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:38.238 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1b6803ead0 0x7f1b68040fe0 crc :-1 s=READY pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b88098480 msgr2=0x7f1b880974d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b88098480 0x7f1b880974d0 crc :-1 s=READY pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 shutdown_connections 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f1b6803ead0 0x7f1b68040fe0 unknown :-1 s=CLOSED pgs=3844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 --2- 172.21.15.5:0/3690012450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b88098480 0x7f1b880974d0 unknown :-1 s=CLOSED pgs=12966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 >> 172.21.15.5:0/3690012450 conn(0x7f1b880a0d40 msgr2=0x7f1b880996a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.236+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 shutdown_connections 2024-09-21T21:39:38.239 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.237+0000 7f1b8ef91640 1 -- 172.21.15.5:0/3690012450 wait complete. 2024-09-21T21:39:38.249 INFO:tasks.workunit.client.0.smithi005.stderr:+ ceph osd pool delete 4715da7e-e73f-4c7f-b923-6e65b1dabe1a 4715da7e-e73f-4c7f-b923-6e65b1dabe1a --yes-i-really-really-mean-it 2024-09-21T21:39:38.346 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.335+0000 7fcae2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:38.347 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.345+0000 7fcae2f11640 1 Processor -- start 2024-09-21T21:39:38.347 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.345+0000 7fcae2f11640 1 -- start start 2024-09-21T21:39:38.349 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcae2f11640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcadc0724f0 0x7fcadc139270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:38.349 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcae2f11640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcadc073430 con 0x7fcadc074630 2024-09-21T21:39:38.349 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcae2f11640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcadc09df40 con 0x7fcadc0724f0 2024-09-21T21:39:38.349 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcae0cad640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcadc074630 0x7fcadc071de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52964/0 (socket says 172.21.15.5:52964) 2024-09-21T21:39:38.349 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcadbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcadc0724f0 0x7fcadc139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:38.349 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcae0cad640 1 -- 172.21.15.5:0/2125718806 learned_addr learned my addr 172.21.15.5:0/2125718806 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcadbfff640 1 -- 172.21.15.5:0/2125718806 >> v1:172.21.15.5:6789/0 conn(0x7fcadc074630 legacy=0x7fcadc071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcadb7fe640 1 -- 172.21.15.5:0/2125718806 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2375082861 0 0) 0x7fcadc073430 con 0x7fcadc074630 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.347+0000 7fcadbfff640 1 -- 172.21.15.5:0/2125718806 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc073a40 con 0x7fcadc0724f0 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcadbfff640 1 --2- 172.21.15.5:0/2125718806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc139270 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11aeb3e802900cda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcadb7fe640 1 -- 172.21.15.5:0/2125718806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcad0009d90 con 0x7fcadc0724f0 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcadb7fe640 1 -- 172.21.15.5:0/2125718806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcad000e230 con 0x7fcadc0724f0 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcadb7fe640 1 -- 172.21.15.5:0/2125718806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcad000e4d0 con 0x7fcadc0724f0 2024-09-21T21:39:38.351 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcae2f11640 1 -- 172.21.15.5:0/2125718806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 msgr2=0x7fcadc139270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcae2f11640 1 --2- 172.21.15.5:0/2125718806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc139270 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcae2f11640 1 -- 172.21.15.5:0/2125718806 shutdown_connections 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcae2f11640 1 --2- 172.21.15.5:0/2125718806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc139270 unknown :-1 s=CLOSED pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.348+0000 7fcae2f11640 1 -- 172.21.15.5:0/2125718806 >> 172.21.15.5:0/2125718806 conn(0x7fcadc0a3160 msgr2=0x7fcadc0a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.349+0000 7fcae2f11640 1 -- 172.21.15.5:0/2125718806 shutdown_connections 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.349+0000 7fcae2f11640 1 -- 172.21.15.5:0/2125718806 wait complete. 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.349+0000 7fcae2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:38.352 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.350+0000 7fcae2f11640 1 Processor -- start 2024-09-21T21:39:38.353 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.351+0000 7fcae2f11640 1 -- start start 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.352+0000 7fcae2f11640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc121dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.352+0000 7fcae2f11640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc123fa0 con 0x7fcadc0724f0 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.352+0000 7fcae0cad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc121dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.352+0000 7fcae0cad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc121dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44106/0 (socket says 172.21.15.5:44106) 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.352+0000 7fcae0cad640 1 -- 172.21.15.5:0/1605497668 learned_addr learned my addr 172.21.15.5:0/1605497668 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.353+0000 7fcae0cad640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc072df0 con 0x7fcadc0724f0 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.353+0000 7fcae0cad640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc121dc0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.353+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcacc005a60 con 0x7fcadc0724f0 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.353+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcacc005bc0 con 0x7fcadc0724f0 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.353+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcadc121ab0 con 0x7fcadc0724f0 2024-09-21T21:39:38.355 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.353+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcacc005e60 con 0x7fcadc0724f0 2024-09-21T21:39:38.356 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.353+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc121860 con 0x7fcadc0724f0 2024-09-21T21:39:38.356 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.354+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcadc072990 con 0x7fcadc0724f0 2024-09-21T21:39:38.356 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.354+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fcacc0070b0 con 0x7fcadc0724f0 2024-09-21T21:39:38.356 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.354+0000 7fcad97fa640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcac803ead0 0x7fcac8040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:38.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.354+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(723..723 src has 1..723) ==== 3819+0+0 (crc 0 0 0) 0x7fcacc04fc10 con 0x7fcadc0724f0 2024-09-21T21:39:38.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.355+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=724}) -- 0x7fcac8044dc0 con 0x7fcadc0724f0 2024-09-21T21:39:38.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.355+0000 7fcadbfff640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcac803ead0 0x7fcac8040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:38.357 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.355+0000 7fcadbfff640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcac803ead0 0x7fcac8040fe0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:38.361 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.360+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fcacc00f230 con 0x7fcadc0724f0 2024-09-21T21:39:38.552 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:38.551+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pool2": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcadc1256e0 con 0x7fcadc0724f0 2024-09-21T21:39:39.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.080+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pool2": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "yes_i_really_really_mean_it": true}]=0 pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' removed v724) ==== 248+0+0 (crc 0 0 0) 0x7fcacc00d610 con 0x7fcadc0724f0 2024-09-21T21:39:39.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.080+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 8 ==== osd_map(724..724 src has 1..724) ==== 296+0+0 (crc 0 0 0) 0x7fcacc00d9b0 con 0x7fcadc0724f0 2024-09-21T21:39:39.082 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.080+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=725}) -- 0x7fcac8045b10 con 0x7fcadc0724f0 2024-09-21T21:39:39.231 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.229+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pool2": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcadc078820 con 0x7fcadc0724f0 2024-09-21T21:39:39.232 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.230+0000 7fcad97fa640 1 -- 172.21.15.5:0/1605497668 <== mon.0 v2:172.21.15.5:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "pool2": "4715da7e-e73f-4c7f-b923-6e65b1dabe1a", "yes_i_really_really_mean_it": true}]=0 pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' does not exist v724) ==== 255+0+0 (crc 0 0 0) 0x7fcacc00d7f0 con 0x7fcadc0724f0 2024-09-21T21:39:39.232 INFO:tasks.workunit.client.0.smithi005.stderr:pool '4715da7e-e73f-4c7f-b923-6e65b1dabe1a' does not exist 2024-09-21T21:39:39.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcac803ead0 msgr2=0x7fcac8040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:39.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcac803ead0 0x7fcac8040fe0 crc :-1 s=READY pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:39.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 msgr2=0x7fcadc121dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:39.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc121dc0 crc :-1 s=READY pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:39.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 shutdown_connections 2024-09-21T21:39:39.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcac803ead0 0x7fcac8040fe0 unknown :-1 s=CLOSED pgs=3845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:39.234 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 --2- 172.21.15.5:0/1605497668 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcadc0724f0 0x7fcadc121dc0 unknown :-1 s=CLOSED pgs=12969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:39.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 >> 172.21.15.5:0/1605497668 conn(0x7fcadc0a3160 msgr2=0x7fcadc0a4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:39.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 shutdown_connections 2024-09-21T21:39:39.235 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-21T21:39:39.232+0000 7fcae2f11640 1 -- 172.21.15.5:0/1605497668 wait complete. 2024-09-21T21:39:39.244 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo OK 2024-09-21T21:39:39.245 INFO:tasks.workunit.client.0.smithi005.stdout:OK 2024-09-21T21:39:39.245 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T21:39:39.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T21:39:39.312 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-09-21T21:39:39.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T21:39:39.663 DEBUG:teuthology.parallel:result is None 2024-09-21T21:39:39.664 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T21:39:39.689 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T21:39:39.689 DEBUG:teuthology.orchestra.run.smithi005:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-21T21:39:39.756 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T21:39:39.756 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-21T21:39:39.766 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-21T21:39:39.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T21:39:39.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.905+0000 7f3c29b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:39.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.911+0000 7f3c29b91640 1 Processor -- start 2024-09-21T21:39:39.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.911+0000 7f3c29b91640 1 -- start start 2024-09-21T21:39:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.912+0000 7f3c29b91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f3c24131140 0x7f3c24138df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.912+0000 7f3c29b91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c241304f0 con 0x7f3c240a4490 2024-09-21T21:39:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.912+0000 7f3c29b91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2409de70 con 0x7f3c24131140 2024-09-21T21:39:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.912+0000 7f3c237fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f3c240a4490 0x7f3c24130a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:52974/0 (socket says 172.21.15.5:52974) 2024-09-21T21:39:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.912+0000 7f3c237fe640 1 -- 172.21.15.5:0/3086347493 learned_addr learned my addr 172.21.15.5:0/3086347493 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:39.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.912+0000 7f3c22ffd640 1 --2- 172.21.15.5:0/3086347493 >> v2:172.21.15.5:3300/0 conn(0x7f3c24131140 0x7f3c24138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.913+0000 7f3c22ffd640 1 -- 172.21.15.5:0/3086347493 >> v1:172.21.15.5:6789/0 conn(0x7f3c240a4490 legacy=0x7f3c24130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.913+0000 7f3c22ffd640 1 -- 172.21.15.5:0/3086347493 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2409ef80 con 0x7f3c24131140 2024-09-21T21:39:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.913+0000 7f3c22ffd640 1 --2- 172.21.15.5:0/3086347493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c24131140 0x7f3c24138df0 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddc9805038fe752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.913+0000 7f3c227fc640 1 -- 172.21.15.5:0/3086347493 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c18009d90 con 0x7f3c24131140 2024-09-21T21:39:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.913+0000 7f3c227fc640 1 -- 172.21.15.5:0/3086347493 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c1800e230 con 0x7f3c24131140 2024-09-21T21:39:39.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.913+0000 7f3c227fc640 1 -- 172.21.15.5:0/3086347493 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c1800e4d0 con 0x7f3c24131140 2024-09-21T21:39:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 1 -- 172.21.15.5:0/3086347493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c24131140 msgr2=0x7f3c24138df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 1 --2- 172.21.15.5:0/3086347493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c24131140 0x7f3c24138df0 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 1 -- 172.21.15.5:0/3086347493 shutdown_connections 2024-09-21T21:39:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 1 --2- 172.21.15.5:0/3086347493 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c24131140 0x7f3c24138df0 unknown :-1 s=CLOSED pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 1 -- 172.21.15.5:0/3086347493 >> 172.21.15.5:0/3086347493 conn(0x7f3c240a2960 msgr2=0x7f3c240a2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:39.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 1 -- 172.21.15.5:0/3086347493 shutdown_connections 2024-09-21T21:39:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 1 -- 172.21.15.5:0/3086347493 wait complete. 2024-09-21T21:39:39.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.914+0000 7f3c29b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.916+0000 7f3c29b91640 1 Processor -- start 2024-09-21T21:39:39.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.916+0000 7f3c29b91640 1 -- start start 2024-09-21T21:39:39.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.917+0000 7f3c29b91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c240a4490 0x7f3c2411b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:39.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.917+0000 7f3c29b91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2412f280 con 0x7f3c240a4490 2024-09-21T21:39:39.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c240a4490 0x7f3c2411b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:39.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c237fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c240a4490 0x7f3c2411b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44118/0 (socket says 172.21.15.5:44118) 2024-09-21T21:39:39.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c237fe640 1 -- 172.21.15.5:0/3360512999 learned_addr learned my addr 172.21.15.5:0/3360512999 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:39.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c237fe640 1 -- 172.21.15.5:0/3360512999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2411eed0 con 0x7f3c240a4490 2024-09-21T21:39:39.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c237fe640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c240a4490 0x7f3c2411b2d0 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:39.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c0bfff640 1 -- 172.21.15.5:0/3360512999 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c14005a60 con 0x7f3c240a4490 2024-09-21T21:39:39.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c0bfff640 1 -- 172.21.15.5:0/3360512999 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3c14005bc0 con 0x7f3c240a4490 2024-09-21T21:39:39.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2411f1d0 con 0x7f3c240a4490 2024-09-21T21:39:39.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c0bfff640 1 -- 172.21.15.5:0/3360512999 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3c14005e60 con 0x7f3c240a4490 2024-09-21T21:39:39.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.918+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2409e160 con 0x7f3c240a4490 2024-09-21T21:39:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.919+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c240a0850 con 0x7f3c240a4490 2024-09-21T21:39:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.919+0000 7f3c0bfff640 1 -- 172.21.15.5:0/3360512999 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f3c140070b0 con 0x7f3c240a4490 2024-09-21T21:39:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.920+0000 7f3c0bfff640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3c1003ea80 0x7f3c10040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.920+0000 7f3c0bfff640 1 -- 172.21.15.5:0/3360512999 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7f3c1404fad0 con 0x7f3c240a4490 2024-09-21T21:39:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.920+0000 7f3c22ffd640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3c1003ea80 0x7f3c10040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:39.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.921+0000 7f3c22ffd640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3c1003ea80 0x7f3c10040f90 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:39.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:39.925+0000 7f3c0bfff640 1 -- 172.21.15.5:0/3360512999 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f3c1400dc10 con 0x7f3c240a4490 2024-09-21T21:39:40.116 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.114+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c2409eaf0 con 0x7f3c1003ea80 2024-09-21T21:39:40.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.117+0000 7f3c0bfff640 1 -- 172.21.15.5:0/3360512999 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109235 (crc 0 0 0) 0x7f3c18009e80 con 0x7f3c1003ea80 2024-09-21T21:39:40.119 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:39:40.120 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3c1003ea80 msgr2=0x7f3c10040f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3c1003ea80 0x7f3c10040f90 crc :-1 s=READY pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c240a4490 msgr2=0x7f3c2411b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c240a4490 0x7f3c2411b2d0 crc :-1 s=READY pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 shutdown_connections 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f3c1003ea80 0x7f3c10040f90 unknown :-1 s=CLOSED pgs=3846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 --2- 172.21.15.5:0/3360512999 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c240a4490 0x7f3c2411b2d0 unknown :-1 s=CLOSED pgs=12972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 >> 172.21.15.5:0/3360512999 conn(0x7f3c240a2960 msgr2=0x7f3c241bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 shutdown_connections 2024-09-21T21:39:40.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.120+0000 7f3c29b91640 1 -- 172.21.15.5:0/3360512999 wait complete. 2024-09-21T21:39:40.133 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1295,"stamp":"2024-09-21T21:39:39.350804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":275916,"kb_used_data":27020,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377211444,"statfs":{"total":386547056640,"available":386264518656,"internally_reserved":0,"allocated":27668480,"data_stored":12743517,"data_compressed":218950,"data_compressed_allocated":303104,"data_compressed_original":1478656,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002448"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.125975+0000","last_change":"2024-09-21T21:25:34.029761+0000","last_active":"2024-09-21T21:39:38.125975+0000","last_peered":"2024-09-21T21:39:38.125975+0000","last_clean":"2024-09-21T21:39:38.125975+0000","last_became_active":"2024-09-21T21:25:34.012471+0000","last_became_peered":"2024-09-21T21:25:34.012471+0000","last_unstale":"2024-09-21T21:39:38.125975+0000","last_undegraded":"2024-09-21T21:39:38.125975+0000","last_fullsized":"2024-09-21T21:39:38.125975+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130941+0000","last_change":"2024-09-21T21:25:34.106122+0000","last_active":"2024-09-21T21:39:39.130941+0000","last_peered":"2024-09-21T21:39:39.130941+0000","last_clean":"2024-09-21T21:39:39.130941+0000","last_became_active":"2024-09-21T21:25:34.089828+0000","last_became_peered":"2024-09-21T21:25:34.089828+0000","last_unstale":"2024-09-21T21:39:39.130941+0000","last_undegraded":"2024-09-21T21:39:39.130941+0000","last_fullsized":"2024-09-21T21:39:39.130941+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118711+0000","last_change":"2024-09-21T21:25:34.128590+0000","last_active":"2024-09-21T21:39:39.118711+0000","last_peered":"2024-09-21T21:39:39.118711+0000","last_clean":"2024-09-21T21:39:39.118711+0000","last_became_active":"2024-09-21T21:25:34.123143+0000","last_became_peered":"2024-09-21T21:25:34.123143+0000","last_unstale":"2024-09-21T21:39:39.118711+0000","last_undegraded":"2024-09-21T21:39:39.118711+0000","last_fullsized":"2024-09-21T21:39:39.118711+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101148+0000","last_change":"2024-09-21T21:25:34.040888+0000","last_active":"2024-09-21T21:39:39.101148+0000","last_peered":"2024-09-21T21:39:39.101148+0000","last_clean":"2024-09-21T21:39:39.101148+0000","last_became_active":"2024-09-21T21:25:34.018004+0000","last_became_peered":"2024-09-21T21:25:34.018004+0000","last_unstale":"2024-09-21T21:39:39.101148+0000","last_undegraded":"2024-09-21T21:39:39.101148+0000","last_fullsized":"2024-09-21T21:39:39.101148+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.116675+0000","last_change":"2024-09-21T21:25:34.086835+0000","last_active":"2024-09-21T21:39:38.116675+0000","last_peered":"2024-09-21T21:39:38.116675+0000","last_clean":"2024-09-21T21:39:38.116675+0000","last_became_active":"2024-09-21T21:25:34.080013+0000","last_became_peered":"2024-09-21T21:25:34.080013+0000","last_unstale":"2024-09-21T21:39:38.116675+0000","last_undegraded":"2024-09-21T21:39:38.116675+0000","last_fullsized":"2024-09-21T21:39:38.116675+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.128637+0000","last_change":"2024-09-21T21:25:34.056398+0000","last_active":"2024-09-21T21:39:39.128637+0000","last_peered":"2024-09-21T21:39:39.128637+0000","last_clean":"2024-09-21T21:39:39.128637+0000","last_became_active":"2024-09-21T21:25:34.025780+0000","last_became_peered":"2024-09-21T21:25:34.025780+0000","last_unstale":"2024-09-21T21:39:39.128637+0000","last_undegraded":"2024-09-21T21:39:39.128637+0000","last_fullsized":"2024-09-21T21:39:39.128637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130249+0000","last_change":"2024-09-21T21:25:34.149489+0000","last_active":"2024-09-21T21:39:39.130249+0000","last_peered":"2024-09-21T21:39:39.130249+0000","last_clean":"2024-09-21T21:39:39.130249+0000","last_became_active":"2024-09-21T21:25:34.139437+0000","last_became_peered":"2024-09-21T21:25:34.139437+0000","last_unstale":"2024-09-21T21:39:39.130249+0000","last_undegraded":"2024-09-21T21:39:39.130249+0000","last_fullsized":"2024-09-21T21:39:39.130249+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130207+0000","last_change":"2024-09-21T21:25:34.213148+0000","last_active":"2024-09-21T21:39:39.130207+0000","last_peered":"2024-09-21T21:39:39.130207+0000","last_clean":"2024-09-21T21:39:39.130207+0000","last_became_active":"2024-09-21T21:25:34.201780+0000","last_became_peered":"2024-09-21T21:25:34.201780+0000","last_unstale":"2024-09-21T21:39:39.130207+0000","last_undegraded":"2024-09-21T21:39:39.130207+0000","last_fullsized":"2024-09-21T21:39:39.130207+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105208+0000","last_change":"2024-09-21T21:25:34.073687+0000","last_active":"2024-09-21T21:39:39.105208+0000","last_peered":"2024-09-21T21:39:39.105208+0000","last_clean":"2024-09-21T21:39:39.105208+0000","last_became_active":"2024-09-21T21:25:34.064521+0000","last_became_peered":"2024-09-21T21:25:34.064521+0000","last_unstale":"2024-09-21T21:39:39.105208+0000","last_undegraded":"2024-09-21T21:39:39.105208+0000","last_fullsized":"2024-09-21T21:39:39.105208+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.091873+0000","last_change":"2024-09-21T21:25:34.085317+0000","last_active":"2024-09-21T21:39:39.091873+0000","last_peered":"2024-09-21T21:39:39.091873+0000","last_clean":"2024-09-21T21:39:39.091873+0000","last_became_active":"2024-09-21T21:25:34.067565+0000","last_became_peered":"2024-09-21T21:25:34.067565+0000","last_unstale":"2024-09-21T21:39:39.091873+0000","last_undegraded":"2024-09-21T21:39:39.091873+0000","last_fullsized":"2024-09-21T21:39:39.091873+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.093009+0000","last_change":"2024-09-21T21:25:34.077035+0000","last_active":"2024-09-21T21:39:39.093009+0000","last_peered":"2024-09-21T21:39:39.093009+0000","last_clean":"2024-09-21T21:39:39.093009+0000","last_became_active":"2024-09-21T21:25:34.062261+0000","last_became_peered":"2024-09-21T21:25:34.062261+0000","last_unstale":"2024-09-21T21:39:39.093009+0000","last_undegraded":"2024-09-21T21:39:39.093009+0000","last_fullsized":"2024-09-21T21:39:39.093009+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.129644+0000","last_change":"2024-09-21T21:25:34.111175+0000","last_active":"2024-09-21T21:39:39.129644+0000","last_peered":"2024-09-21T21:39:39.129644+0000","last_clean":"2024-09-21T21:39:39.129644+0000","last_became_active":"2024-09-21T21:25:34.089008+0000","last_became_peered":"2024-09-21T21:25:34.089008+0000","last_unstale":"2024-09-21T21:39:39.129644+0000","last_undegraded":"2024-09-21T21:39:39.129644+0000","last_fullsized":"2024-09-21T21:39:39.129644+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105956+0000","last_change":"2024-09-21T21:25:34.090272+0000","last_active":"2024-09-21T21:39:39.105956+0000","last_peered":"2024-09-21T21:39:39.105956+0000","last_clean":"2024-09-21T21:39:39.105956+0000","last_became_active":"2024-09-21T21:25:34.079561+0000","last_became_peered":"2024-09-21T21:25:34.079561+0000","last_unstale":"2024-09-21T21:39:39.105956+0000","last_undegraded":"2024-09-21T21:39:39.105956+0000","last_fullsized":"2024-09-21T21:39:39.105956+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118060+0000","last_change":"2024-09-21T21:25:34.131274+0000","last_active":"2024-09-21T21:39:39.118060+0000","last_peered":"2024-09-21T21:39:39.118060+0000","last_clean":"2024-09-21T21:39:39.118060+0000","last_became_active":"2024-09-21T21:25:34.124318+0000","last_became_peered":"2024-09-21T21:25:34.124318+0000","last_unstale":"2024-09-21T21:39:39.118060+0000","last_undegraded":"2024-09-21T21:39:39.118060+0000","last_fullsized":"2024-09-21T21:39:39.118060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.135902+0000","last_change":"2024-09-21T21:25:34.231684+0000","last_active":"2024-09-21T21:39:39.135902+0000","last_peered":"2024-09-21T21:39:39.135902+0000","last_clean":"2024-09-21T21:39:39.135902+0000","last_became_active":"2024-09-21T21:25:34.226528+0000","last_became_peered":"2024-09-21T21:25:34.226528+0000","last_unstale":"2024-09-21T21:39:39.135902+0000","last_undegraded":"2024-09-21T21:39:39.135902+0000","last_fullsized":"2024-09-21T21:39:39.135902+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124409+0000","last_change":"2024-09-21T21:25:34.067759+0000","last_active":"2024-09-21T21:39:39.124409+0000","last_peered":"2024-09-21T21:39:39.124409+0000","last_clean":"2024-09-21T21:39:39.124409+0000","last_became_active":"2024-09-21T21:25:34.050600+0000","last_became_peered":"2024-09-21T21:25:34.050600+0000","last_unstale":"2024-09-21T21:39:39.124409+0000","last_undegraded":"2024-09-21T21:39:39.124409+0000","last_fullsized":"2024-09-21T21:39:39.124409+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.103595+0000","last_change":"2024-09-21T21:25:34.133956+0000","last_active":"2024-09-21T21:39:39.103595+0000","last_peered":"2024-09-21T21:39:39.103595+0000","last_clean":"2024-09-21T21:39:39.103595+0000","last_became_active":"2024-09-21T21:25:34.100820+0000","last_became_peered":"2024-09-21T21:25:34.100820+0000","last_unstale":"2024-09-21T21:39:39.103595+0000","last_undegraded":"2024-09-21T21:39:39.103595+0000","last_fullsized":"2024-09-21T21:39:39.103595+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.109680+0000","last_change":"2024-09-21T21:25:34.044370+0000","last_active":"2024-09-21T21:39:39.109680+0000","last_peered":"2024-09-21T21:39:39.109680+0000","last_clean":"2024-09-21T21:39:39.109680+0000","last_became_active":"2024-09-21T21:25:34.027204+0000","last_became_peered":"2024-09-21T21:25:34.027204+0000","last_unstale":"2024-09-21T21:39:39.109680+0000","last_undegraded":"2024-09-21T21:39:39.109680+0000","last_fullsized":"2024-09-21T21:39:39.109680+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119701+0000","last_change":"2024-09-21T21:25:34.073415+0000","last_active":"2024-09-21T21:39:39.119701+0000","last_peered":"2024-09-21T21:39:39.119701+0000","last_clean":"2024-09-21T21:39:39.119701+0000","last_became_active":"2024-09-21T21:25:34.065857+0000","last_became_peered":"2024-09-21T21:25:34.065857+0000","last_unstale":"2024-09-21T21:39:39.119701+0000","last_undegraded":"2024-09-21T21:39:39.119701+0000","last_fullsized":"2024-09-21T21:39:39.119701+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.124840+0000","last_change":"2024-09-21T21:25:34.158667+0000","last_active":"2024-09-21T21:39:38.124840+0000","last_peered":"2024-09-21T21:39:38.124840+0000","last_clean":"2024-09-21T21:39:38.124840+0000","last_became_active":"2024-09-21T21:25:34.152022+0000","last_became_peered":"2024-09-21T21:25:34.152022+0000","last_unstale":"2024-09-21T21:39:38.124840+0000","last_undegraded":"2024-09-21T21:39:38.124840+0000","last_fullsized":"2024-09-21T21:39:38.124840+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.120637+0000","last_change":"2024-09-21T21:25:34.089847+0000","last_active":"2024-09-21T21:39:38.120637+0000","last_peered":"2024-09-21T21:39:38.120637+0000","last_clean":"2024-09-21T21:39:38.120637+0000","last_became_active":"2024-09-21T21:25:34.081214+0000","last_became_peered":"2024-09-21T21:25:34.081214+0000","last_unstale":"2024-09-21T21:39:38.120637+0000","last_undegraded":"2024-09-21T21:39:38.120637+0000","last_fullsized":"2024-09-21T21:39:38.120637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.107081+0000","last_change":"2024-09-21T21:25:34.052204+0000","last_active":"2024-09-21T21:39:38.107081+0000","last_peered":"2024-09-21T21:39:38.107081+0000","last_clean":"2024-09-21T21:39:38.107081+0000","last_became_active":"2024-09-21T21:25:34.040136+0000","last_became_peered":"2024-09-21T21:25:34.040136+0000","last_unstale":"2024-09-21T21:39:38.107081+0000","last_undegraded":"2024-09-21T21:39:38.107081+0000","last_fullsized":"2024-09-21T21:39:38.107081+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113523+0000","last_change":"2024-09-21T21:25:34.148087+0000","last_active":"2024-09-21T21:39:39.113523+0000","last_peered":"2024-09-21T21:39:39.113523+0000","last_clean":"2024-09-21T21:39:39.113523+0000","last_became_active":"2024-09-21T21:25:34.141821+0000","last_became_peered":"2024-09-21T21:25:34.141821+0000","last_unstale":"2024-09-21T21:39:39.113523+0000","last_undegraded":"2024-09-21T21:39:39.113523+0000","last_fullsized":"2024-09-21T21:39:39.113523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.120082+0000","last_change":"2024-09-21T21:25:34.040107+0000","last_active":"2024-09-21T21:39:39.120082+0000","last_peered":"2024-09-21T21:39:39.120082+0000","last_clean":"2024-09-21T21:39:39.120082+0000","last_became_active":"2024-09-21T21:25:34.023200+0000","last_became_peered":"2024-09-21T21:25:34.023200+0000","last_unstale":"2024-09-21T21:39:39.120082+0000","last_undegraded":"2024-09-21T21:39:39.120082+0000","last_fullsized":"2024-09-21T21:39:39.120082+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107419+0000","last_change":"2024-09-21T21:25:34.094490+0000","last_active":"2024-09-21T21:39:39.107419+0000","last_peered":"2024-09-21T21:39:39.107419+0000","last_clean":"2024-09-21T21:39:39.107419+0000","last_became_active":"2024-09-21T21:25:34.085139+0000","last_became_peered":"2024-09-21T21:25:34.085139+0000","last_unstale":"2024-09-21T21:39:39.107419+0000","last_undegraded":"2024-09-21T21:39:39.107419+0000","last_fullsized":"2024-09-21T21:39:39.107419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.112703+0000","last_change":"2024-09-21T21:25:34.072314+0000","last_active":"2024-09-21T21:39:39.112703+0000","last_peered":"2024-09-21T21:39:39.112703+0000","last_clean":"2024-09-21T21:39:39.112703+0000","last_became_active":"2024-09-21T21:25:34.040364+0000","last_became_peered":"2024-09-21T21:25:34.040364+0000","last_unstale":"2024-09-21T21:39:39.112703+0000","last_undegraded":"2024-09-21T21:39:39.112703+0000","last_fullsized":"2024-09-21T21:39:39.112703+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107433+0000","last_change":"2024-09-21T21:25:34.119092+0000","last_active":"2024-09-21T21:39:39.107433+0000","last_peered":"2024-09-21T21:39:39.107433+0000","last_clean":"2024-09-21T21:39:39.107433+0000","last_became_active":"2024-09-21T21:25:34.108210+0000","last_became_peered":"2024-09-21T21:25:34.108210+0000","last_unstale":"2024-09-21T21:39:39.107433+0000","last_undegraded":"2024-09-21T21:39:39.107433+0000","last_fullsized":"2024-09-21T21:39:39.107433+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.123968+0000","last_change":"2024-09-21T21:25:34.180232+0000","last_active":"2024-09-21T21:39:39.123968+0000","last_peered":"2024-09-21T21:39:39.123968+0000","last_clean":"2024-09-21T21:39:39.123968+0000","last_became_active":"2024-09-21T21:25:34.175298+0000","last_became_peered":"2024-09-21T21:25:34.175298+0000","last_unstale":"2024-09-21T21:39:39.123968+0000","last_undegraded":"2024-09-21T21:39:39.123968+0000","last_fullsized":"2024-09-21T21:39:39.123968+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.111596+0000","last_change":"2024-09-21T21:25:34.174441+0000","last_active":"2024-09-21T21:39:39.111596+0000","last_peered":"2024-09-21T21:39:39.111596+0000","last_clean":"2024-09-21T21:39:39.111596+0000","last_became_active":"2024-09-21T21:25:34.167932+0000","last_became_peered":"2024-09-21T21:25:34.167932+0000","last_unstale":"2024-09-21T21:39:39.111596+0000","last_undegraded":"2024-09-21T21:39:39.111596+0000","last_fullsized":"2024-09-21T21:39:39.111596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.096596+0000","last_change":"2024-09-21T21:25:34.139852+0000","last_active":"2024-09-21T21:39:39.096596+0000","last_peered":"2024-09-21T21:39:39.096596+0000","last_clean":"2024-09-21T21:39:39.096596+0000","last_became_active":"2024-09-21T21:25:34.117704+0000","last_became_peered":"2024-09-21T21:25:34.117704+0000","last_unstale":"2024-09-21T21:39:39.096596+0000","last_undegraded":"2024-09-21T21:39:39.096596+0000","last_fullsized":"2024-09-21T21:39:39.096596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1479,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.108579+0000","last_change":"2024-09-21T21:25:34.037306+0000","last_active":"2024-09-21T21:39:38.108579+0000","last_peered":"2024-09-21T21:39:38.108579+0000","last_clean":"2024-09-21T21:39:38.108579+0000","last_became_active":"2024-09-21T21:25:34.022737+0000","last_became_peered":"2024-09-21T21:25:34.022737+0000","last_unstale":"2024-09-21T21:39:38.108579+0000","last_undegraded":"2024-09-21T21:39:38.108579+0000","last_fullsized":"2024-09-21T21:39:38.108579+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113573+0000","last_change":"2024-09-21T21:25:34.053451+0000","last_active":"2024-09-21T21:39:39.113573+0000","last_peered":"2024-09-21T21:39:39.113573+0000","last_clean":"2024-09-21T21:39:39.113573+0000","last_became_active":"2024-09-21T21:25:34.042008+0000","last_became_peered":"2024-09-21T21:25:34.042008+0000","last_unstale":"2024-09-21T21:39:39.113573+0000","last_undegraded":"2024-09-21T21:39:39.113573+0000","last_fullsized":"2024-09-21T21:39:39.113573+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2139,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.134103+0000","last_change":"2024-09-21T21:20:29.170558+0000","last_active":"2024-09-21T21:39:38.134103+0000","last_peered":"2024-09-21T21:39:38.134103+0000","last_clean":"2024-09-21T21:39:38.134103+0000","last_became_active":"2024-09-21T21:20:27.209536+0000","last_became_peered":"2024-09-21T21:20:27.209536+0000","last_unstale":"2024-09-21T21:39:38.134103+0000","last_undegraded":"2024-09-21T21:39:38.134103+0000","last_fullsized":"2024-09-21T21:39:38.134103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.106177+0000","last_change":"2024-09-21T21:20:29.168730+0000","last_active":"2024-09-21T21:39:39.106177+0000","last_peered":"2024-09-21T21:39:39.106177+0000","last_clean":"2024-09-21T21:39:39.106177+0000","last_became_active":"2024-09-21T21:20:27.208215+0000","last_became_peered":"2024-09-21T21:20:27.208215+0000","last_unstale":"2024-09-21T21:39:39.106177+0000","last_undegraded":"2024-09-21T21:39:39.106177+0000","last_fullsized":"2024-09-21T21:39:39.106177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119386+0000","last_change":"2024-09-21T21:20:29.169143+0000","last_active":"2024-09-21T21:39:39.119386+0000","last_peered":"2024-09-21T21:39:39.119386+0000","last_clean":"2024-09-21T21:39:39.119386+0000","last_became_active":"2024-09-21T21:20:27.191527+0000","last_became_peered":"2024-09-21T21:20:27.191527+0000","last_unstale":"2024-09-21T21:39:39.119386+0000","last_undegraded":"2024-09-21T21:39:39.119386+0000","last_fullsized":"2024-09-21T21:39:39.119386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101535+0000","last_change":"2024-09-21T21:20:29.167100+0000","last_active":"2024-09-21T21:39:39.101535+0000","last_peered":"2024-09-21T21:39:39.101535+0000","last_clean":"2024-09-21T21:39:39.101535+0000","last_became_active":"2024-09-21T21:20:27.193527+0000","last_became_peered":"2024-09-21T21:20:27.193527+0000","last_unstale":"2024-09-21T21:39:39.101535+0000","last_undegraded":"2024-09-21T21:39:39.101535+0000","last_fullsized":"2024-09-21T21:39:39.101535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124842+0000","last_change":"2024-09-21T21:20:29.169124+0000","last_active":"2024-09-21T21:39:39.124842+0000","last_peered":"2024-09-21T21:39:39.124842+0000","last_clean":"2024-09-21T21:39:39.124842+0000","last_became_active":"2024-09-21T21:20:27.194367+0000","last_became_peered":"2024-09-21T21:20:27.194367+0000","last_unstale":"2024-09-21T21:39:39.124842+0000","last_undegraded":"2024-09-21T21:39:39.124842+0000","last_fullsized":"2024-09-21T21:39:39.124842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2139,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.096227+0000","last_change":"2024-09-21T21:20:29.166574+0000","last_active":"2024-09-21T21:39:38.096227+0000","last_peered":"2024-09-21T21:39:38.096227+0000","last_clean":"2024-09-21T21:39:38.096227+0000","last_became_active":"2024-09-21T21:20:27.194446+0000","last_became_peered":"2024-09-21T21:20:27.194446+0000","last_unstale":"2024-09-21T21:39:38.096227+0000","last_undegraded":"2024-09-21T21:39:38.096227+0000","last_fullsized":"2024-09-21T21:39:38.096227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.125600+0000","last_change":"2024-09-21T21:20:29.170643+0000","last_active":"2024-09-21T21:39:39.125600+0000","last_peered":"2024-09-21T21:39:39.125600+0000","last_clean":"2024-09-21T21:39:39.125600+0000","last_became_active":"2024-09-21T21:20:27.204212+0000","last_became_peered":"2024-09-21T21:20:27.204212+0000","last_unstale":"2024-09-21T21:39:39.125600+0000","last_undegraded":"2024-09-21T21:39:39.125600+0000","last_fullsized":"2024-09-21T21:39:39.125600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2140,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.123038+0000","last_change":"2024-09-21T21:20:29.170295+0000","last_active":"2024-09-21T21:39:38.123038+0000","last_peered":"2024-09-21T21:39:38.123038+0000","last_clean":"2024-09-21T21:39:38.123038+0000","last_became_active":"2024-09-21T21:20:27.211878+0000","last_became_peered":"2024-09-21T21:20:27.211878+0000","last_unstale":"2024-09-21T21:39:38.123038+0000","last_undegraded":"2024-09-21T21:39:38.123038+0000","last_fullsized":"2024-09-21T21:39:38.123038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2211,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.102375+0000","last_change":"2024-09-21T21:20:26.198858+0000","last_active":"2024-09-21T21:39:39.102375+0000","last_peered":"2024-09-21T21:39:39.102375+0000","last_clean":"2024-09-21T21:39:39.102375+0000","last_became_active":"2024-09-21T21:20:26.190843+0000","last_became_peered":"2024-09-21T21:20:26.190843+0000","last_unstale":"2024-09-21T21:39:39.102375+0000","last_undegraded":"2024-09-21T21:39:39.102375+0000","last_fullsized":"2024-09-21T21:39:39.102375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_clean_scrub_stamp":"2024-09-21T21:20:25.135404+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64120,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":6922240,"data_stored":3458617,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69648,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94302192,"statfs":{"total":96636764160,"available":96565444608,"internally_reserved":0,"allocated":6881280,"data_stored":2881148,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68284,"kb_used_data":6764,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94303556,"statfs":{"total":96636764160,"available":96566841344,"internally_reserved":0,"allocated":6926336,"data_stored":2941101,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73864,"kb_used_data":6776,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94297976,"statfs":{"total":96636764160,"available":96561127424,"internally_reserved":0,"allocated":6938624,"data_stored":3462651,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T21:39:40.135 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T21:39:40.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.244+0000 7fc3f8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.250+0000 7fc3f8191640 1 Processor -- start 2024-09-21T21:39:40.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.250+0000 7fc3f8191640 1 -- start start 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.251+0000 7fc3f8191640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3f009d610 0x7fc3f0138400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.251+0000 7fc3f8191640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f009e380 con 0x7fc3f009caf0 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.251+0000 7fc3f8191640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f006c360 con 0x7fc3f009d610 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.251+0000 7fc3f572c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fc3f009d610 0x7fc3f0138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.251+0000 7fc3f5f2d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fc3f009caf0 0x7fc3f009cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42364/0 (socket says 172.21.15.5:42364) 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.251+0000 7fc3f5f2d640 1 -- 172.21.15.5:0/4270385345 learned_addr learned my addr 172.21.15.5:0/4270385345 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.251+0000 7fc3f572c640 1 --2- 172.21.15.5:0/4270385345 >> v2:172.21.15.5:3300/0 conn(0x7fc3f009d610 0x7fc3f0138400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35872/0 (socket says 172.21.15.5:35872) 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.252+0000 7fc3f572c640 1 -- 172.21.15.5:0/4270385345 >> v1:172.21.15.5:6789/0 conn(0x7fc3f009caf0 legacy=0x7fc3f009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.252+0000 7fc3f572c640 1 -- 172.21.15.5:0/4270385345 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f009e950 con 0x7fc3f009d610 2024-09-21T21:39:40.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.252+0000 7fc3f4f2b640 1 -- 172.21.15.5:0/4270385345 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311762949 0 0) 0x7fc3f009e380 con 0x7fc3f009caf0 2024-09-21T21:39:40.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.252+0000 7fc3f572c640 1 --2- 172.21.15.5:0/4270385345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009d610 0x7fc3f0138400 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a62e8d8fdc01f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.252+0000 7fc3f4f2b640 1 -- 172.21.15.5:0/4270385345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3e0009d90 con 0x7fc3f009d610 2024-09-21T21:39:40.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.252+0000 7fc3f4f2b640 1 -- 172.21.15.5:0/4270385345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3e000e230 con 0x7fc3f009d610 2024-09-21T21:39:40.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.252+0000 7fc3f4f2b640 1 -- 172.21.15.5:0/4270385345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3e000e4d0 con 0x7fc3f009d610 2024-09-21T21:39:40.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 1 -- 172.21.15.5:0/4270385345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009d610 msgr2=0x7fc3f0138400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 1 --2- 172.21.15.5:0/4270385345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009d610 0x7fc3f0138400 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 1 -- 172.21.15.5:0/4270385345 shutdown_connections 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 1 --2- 172.21.15.5:0/4270385345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009d610 0x7fc3f0138400 unknown :-1 s=CLOSED pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 1 -- 172.21.15.5:0/4270385345 >> 172.21.15.5:0/4270385345 conn(0x7fc3f00a3520 msgr2=0x7fc3f00a3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 1 -- 172.21.15.5:0/4270385345 shutdown_connections 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 1 -- 172.21.15.5:0/4270385345 wait complete. 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.253+0000 7fc3f8191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:40.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.255+0000 7fc3f8191640 1 Processor -- start 2024-09-21T21:39:40.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.255+0000 7fc3f8191640 1 -- start start 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.256+0000 7fc3f8191640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009caf0 0x7fc3f0092d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.256+0000 7fc3f8191640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f00952b0 con 0x7fc3f009caf0 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.256+0000 7fc3f5f2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009caf0 0x7fc3f0092d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3f5f2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009caf0 0x7fc3f0092d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35882/0 (socket says 172.21.15.5:35882) 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3f5f2d640 1 -- 172.21.15.5:0/2564126794 learned_addr learned my addr 172.21.15.5:0/2564126794 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3f5f2d640 1 -- 172.21.15.5:0/2564126794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f0095be0 con 0x7fc3f009caf0 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3f5f2d640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009caf0 0x7fc3f0092d70 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3e67fc640 1 -- 172.21.15.5:0/2564126794 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3ec004b80 con 0x7fc3f009caf0 2024-09-21T21:39:40.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3e67fc640 1 -- 172.21.15.5:0/2564126794 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc3ec004ce0 con 0x7fc3f009caf0 2024-09-21T21:39:40.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f0096b10 con 0x7fc3f009caf0 2024-09-21T21:39:40.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3e67fc640 1 -- 172.21.15.5:0/2564126794 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc3ec007120 con 0x7fc3f009caf0 2024-09-21T21:39:40.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.257+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f0096670 con 0x7fc3f009caf0 2024-09-21T21:39:40.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.258+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f0094f40 con 0x7fc3f009caf0 2024-09-21T21:39:40.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.258+0000 7fc3e67fc640 1 -- 172.21.15.5:0/2564126794 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fc3ec0072d0 con 0x7fc3f009caf0 2024-09-21T21:39:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.259+0000 7fc3e67fc640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc3d403ead0 0x7fc3d4040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.259+0000 7fc3e67fc640 1 -- 172.21.15.5:0/2564126794 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7fc3ec04fc10 con 0x7fc3f009caf0 2024-09-21T21:39:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.259+0000 7fc3f572c640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc3d403ead0 0x7fc3d4040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.259+0000 7fc3f572c640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc3d403ead0 0x7fc3d4040fe0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.264+0000 7fc3e67fc640 1 -- 172.21.15.5:0/2564126794 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fc3ec00f230 con 0x7fc3f009caf0 2024-09-21T21:39:40.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.451+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3f009f3c0 con 0x7fc3d403ead0 2024-09-21T21:39:40.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.454+0000 7fc3e67fc640 1 -- 172.21.15.5:0/2564126794 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109235 (crc 0 0 0) 0x7fc3e000e3a0 con 0x7fc3d403ead0 2024-09-21T21:39:40.456 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:39:40.457 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-21T21:39:40.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.456+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc3d403ead0 msgr2=0x7fc3d4040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.456+0000 7fc3f8191640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc3d403ead0 0x7fc3d4040fe0 crc :-1 s=READY pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.456+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009caf0 msgr2=0x7fc3f0092d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.456+0000 7fc3f8191640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009caf0 0x7fc3f0092d70 crc :-1 s=READY pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.457+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 shutdown_connections 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.457+0000 7fc3f8191640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fc3d403ead0 0x7fc3d4040fe0 unknown :-1 s=CLOSED pgs=3847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.457+0000 7fc3f8191640 1 --2- 172.21.15.5:0/2564126794 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc3f009caf0 0x7fc3f0092d70 unknown :-1 s=CLOSED pgs=12975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.457+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 >> 172.21.15.5:0/2564126794 conn(0x7fc3f00a3520 msgr2=0x7fc3f00725d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.457+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 shutdown_connections 2024-09-21T21:39:40.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.457+0000 7fc3f8191640 1 -- 172.21.15.5:0/2564126794 wait complete. 2024-09-21T21:39:40.469 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1295,"stamp":"2024-09-21T21:39:39.350804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":275916,"kb_used_data":27020,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377211444,"statfs":{"total":386547056640,"available":386264518656,"internally_reserved":0,"allocated":27668480,"data_stored":12743517,"data_compressed":218950,"data_compressed_allocated":303104,"data_compressed_original":1478656,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002448"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.125975+0000","last_change":"2024-09-21T21:25:34.029761+0000","last_active":"2024-09-21T21:39:38.125975+0000","last_peered":"2024-09-21T21:39:38.125975+0000","last_clean":"2024-09-21T21:39:38.125975+0000","last_became_active":"2024-09-21T21:25:34.012471+0000","last_became_peered":"2024-09-21T21:25:34.012471+0000","last_unstale":"2024-09-21T21:39:38.125975+0000","last_undegraded":"2024-09-21T21:39:38.125975+0000","last_fullsized":"2024-09-21T21:39:38.125975+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130941+0000","last_change":"2024-09-21T21:25:34.106122+0000","last_active":"2024-09-21T21:39:39.130941+0000","last_peered":"2024-09-21T21:39:39.130941+0000","last_clean":"2024-09-21T21:39:39.130941+0000","last_became_active":"2024-09-21T21:25:34.089828+0000","last_became_peered":"2024-09-21T21:25:34.089828+0000","last_unstale":"2024-09-21T21:39:39.130941+0000","last_undegraded":"2024-09-21T21:39:39.130941+0000","last_fullsized":"2024-09-21T21:39:39.130941+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118711+0000","last_change":"2024-09-21T21:25:34.128590+0000","last_active":"2024-09-21T21:39:39.118711+0000","last_peered":"2024-09-21T21:39:39.118711+0000","last_clean":"2024-09-21T21:39:39.118711+0000","last_became_active":"2024-09-21T21:25:34.123143+0000","last_became_peered":"2024-09-21T21:25:34.123143+0000","last_unstale":"2024-09-21T21:39:39.118711+0000","last_undegraded":"2024-09-21T21:39:39.118711+0000","last_fullsized":"2024-09-21T21:39:39.118711+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101148+0000","last_change":"2024-09-21T21:25:34.040888+0000","last_active":"2024-09-21T21:39:39.101148+0000","last_peered":"2024-09-21T21:39:39.101148+0000","last_clean":"2024-09-21T21:39:39.101148+0000","last_became_active":"2024-09-21T21:25:34.018004+0000","last_became_peered":"2024-09-21T21:25:34.018004+0000","last_unstale":"2024-09-21T21:39:39.101148+0000","last_undegraded":"2024-09-21T21:39:39.101148+0000","last_fullsized":"2024-09-21T21:39:39.101148+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.116675+0000","last_change":"2024-09-21T21:25:34.086835+0000","last_active":"2024-09-21T21:39:38.116675+0000","last_peered":"2024-09-21T21:39:38.116675+0000","last_clean":"2024-09-21T21:39:38.116675+0000","last_became_active":"2024-09-21T21:25:34.080013+0000","last_became_peered":"2024-09-21T21:25:34.080013+0000","last_unstale":"2024-09-21T21:39:38.116675+0000","last_undegraded":"2024-09-21T21:39:38.116675+0000","last_fullsized":"2024-09-21T21:39:38.116675+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.128637+0000","last_change":"2024-09-21T21:25:34.056398+0000","last_active":"2024-09-21T21:39:39.128637+0000","last_peered":"2024-09-21T21:39:39.128637+0000","last_clean":"2024-09-21T21:39:39.128637+0000","last_became_active":"2024-09-21T21:25:34.025780+0000","last_became_peered":"2024-09-21T21:25:34.025780+0000","last_unstale":"2024-09-21T21:39:39.128637+0000","last_undegraded":"2024-09-21T21:39:39.128637+0000","last_fullsized":"2024-09-21T21:39:39.128637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130249+0000","last_change":"2024-09-21T21:25:34.149489+0000","last_active":"2024-09-21T21:39:39.130249+0000","last_peered":"2024-09-21T21:39:39.130249+0000","last_clean":"2024-09-21T21:39:39.130249+0000","last_became_active":"2024-09-21T21:25:34.139437+0000","last_became_peered":"2024-09-21T21:25:34.139437+0000","last_unstale":"2024-09-21T21:39:39.130249+0000","last_undegraded":"2024-09-21T21:39:39.130249+0000","last_fullsized":"2024-09-21T21:39:39.130249+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130207+0000","last_change":"2024-09-21T21:25:34.213148+0000","last_active":"2024-09-21T21:39:39.130207+0000","last_peered":"2024-09-21T21:39:39.130207+0000","last_clean":"2024-09-21T21:39:39.130207+0000","last_became_active":"2024-09-21T21:25:34.201780+0000","last_became_peered":"2024-09-21T21:25:34.201780+0000","last_unstale":"2024-09-21T21:39:39.130207+0000","last_undegraded":"2024-09-21T21:39:39.130207+0000","last_fullsized":"2024-09-21T21:39:39.130207+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105208+0000","last_change":"2024-09-21T21:25:34.073687+0000","last_active":"2024-09-21T21:39:39.105208+0000","last_peered":"2024-09-21T21:39:39.105208+0000","last_clean":"2024-09-21T21:39:39.105208+0000","last_became_active":"2024-09-21T21:25:34.064521+0000","last_became_peered":"2024-09-21T21:25:34.064521+0000","last_unstale":"2024-09-21T21:39:39.105208+0000","last_undegraded":"2024-09-21T21:39:39.105208+0000","last_fullsized":"2024-09-21T21:39:39.105208+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.091873+0000","last_change":"2024-09-21T21:25:34.085317+0000","last_active":"2024-09-21T21:39:39.091873+0000","last_peered":"2024-09-21T21:39:39.091873+0000","last_clean":"2024-09-21T21:39:39.091873+0000","last_became_active":"2024-09-21T21:25:34.067565+0000","last_became_peered":"2024-09-21T21:25:34.067565+0000","last_unstale":"2024-09-21T21:39:39.091873+0000","last_undegraded":"2024-09-21T21:39:39.091873+0000","last_fullsized":"2024-09-21T21:39:39.091873+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.093009+0000","last_change":"2024-09-21T21:25:34.077035+0000","last_active":"2024-09-21T21:39:39.093009+0000","last_peered":"2024-09-21T21:39:39.093009+0000","last_clean":"2024-09-21T21:39:39.093009+0000","last_became_active":"2024-09-21T21:25:34.062261+0000","last_became_peered":"2024-09-21T21:25:34.062261+0000","last_unstale":"2024-09-21T21:39:39.093009+0000","last_undegraded":"2024-09-21T21:39:39.093009+0000","last_fullsized":"2024-09-21T21:39:39.093009+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.129644+0000","last_change":"2024-09-21T21:25:34.111175+0000","last_active":"2024-09-21T21:39:39.129644+0000","last_peered":"2024-09-21T21:39:39.129644+0000","last_clean":"2024-09-21T21:39:39.129644+0000","last_became_active":"2024-09-21T21:25:34.089008+0000","last_became_peered":"2024-09-21T21:25:34.089008+0000","last_unstale":"2024-09-21T21:39:39.129644+0000","last_undegraded":"2024-09-21T21:39:39.129644+0000","last_fullsized":"2024-09-21T21:39:39.129644+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105956+0000","last_change":"2024-09-21T21:25:34.090272+0000","last_active":"2024-09-21T21:39:39.105956+0000","last_peered":"2024-09-21T21:39:39.105956+0000","last_clean":"2024-09-21T21:39:39.105956+0000","last_became_active":"2024-09-21T21:25:34.079561+0000","last_became_peered":"2024-09-21T21:25:34.079561+0000","last_unstale":"2024-09-21T21:39:39.105956+0000","last_undegraded":"2024-09-21T21:39:39.105956+0000","last_fullsized":"2024-09-21T21:39:39.105956+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118060+0000","last_change":"2024-09-21T21:25:34.131274+0000","last_active":"2024-09-21T21:39:39.118060+0000","last_peered":"2024-09-21T21:39:39.118060+0000","last_clean":"2024-09-21T21:39:39.118060+0000","last_became_active":"2024-09-21T21:25:34.124318+0000","last_became_peered":"2024-09-21T21:25:34.124318+0000","last_unstale":"2024-09-21T21:39:39.118060+0000","last_undegraded":"2024-09-21T21:39:39.118060+0000","last_fullsized":"2024-09-21T21:39:39.118060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.135902+0000","last_change":"2024-09-21T21:25:34.231684+0000","last_active":"2024-09-21T21:39:39.135902+0000","last_peered":"2024-09-21T21:39:39.135902+0000","last_clean":"2024-09-21T21:39:39.135902+0000","last_became_active":"2024-09-21T21:25:34.226528+0000","last_became_peered":"2024-09-21T21:25:34.226528+0000","last_unstale":"2024-09-21T21:39:39.135902+0000","last_undegraded":"2024-09-21T21:39:39.135902+0000","last_fullsized":"2024-09-21T21:39:39.135902+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124409+0000","last_change":"2024-09-21T21:25:34.067759+0000","last_active":"2024-09-21T21:39:39.124409+0000","last_peered":"2024-09-21T21:39:39.124409+0000","last_clean":"2024-09-21T21:39:39.124409+0000","last_became_active":"2024-09-21T21:25:34.050600+0000","last_became_peered":"2024-09-21T21:25:34.050600+0000","last_unstale":"2024-09-21T21:39:39.124409+0000","last_undegraded":"2024-09-21T21:39:39.124409+0000","last_fullsized":"2024-09-21T21:39:39.124409+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.103595+0000","last_change":"2024-09-21T21:25:34.133956+0000","last_active":"2024-09-21T21:39:39.103595+0000","last_peered":"2024-09-21T21:39:39.103595+0000","last_clean":"2024-09-21T21:39:39.103595+0000","last_became_active":"2024-09-21T21:25:34.100820+0000","last_became_peered":"2024-09-21T21:25:34.100820+0000","last_unstale":"2024-09-21T21:39:39.103595+0000","last_undegraded":"2024-09-21T21:39:39.103595+0000","last_fullsized":"2024-09-21T21:39:39.103595+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.109680+0000","last_change":"2024-09-21T21:25:34.044370+0000","last_active":"2024-09-21T21:39:39.109680+0000","last_peered":"2024-09-21T21:39:39.109680+0000","last_clean":"2024-09-21T21:39:39.109680+0000","last_became_active":"2024-09-21T21:25:34.027204+0000","last_became_peered":"2024-09-21T21:25:34.027204+0000","last_unstale":"2024-09-21T21:39:39.109680+0000","last_undegraded":"2024-09-21T21:39:39.109680+0000","last_fullsized":"2024-09-21T21:39:39.109680+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119701+0000","last_change":"2024-09-21T21:25:34.073415+0000","last_active":"2024-09-21T21:39:39.119701+0000","last_peered":"2024-09-21T21:39:39.119701+0000","last_clean":"2024-09-21T21:39:39.119701+0000","last_became_active":"2024-09-21T21:25:34.065857+0000","last_became_peered":"2024-09-21T21:25:34.065857+0000","last_unstale":"2024-09-21T21:39:39.119701+0000","last_undegraded":"2024-09-21T21:39:39.119701+0000","last_fullsized":"2024-09-21T21:39:39.119701+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.124840+0000","last_change":"2024-09-21T21:25:34.158667+0000","last_active":"2024-09-21T21:39:38.124840+0000","last_peered":"2024-09-21T21:39:38.124840+0000","last_clean":"2024-09-21T21:39:38.124840+0000","last_became_active":"2024-09-21T21:25:34.152022+0000","last_became_peered":"2024-09-21T21:25:34.152022+0000","last_unstale":"2024-09-21T21:39:38.124840+0000","last_undegraded":"2024-09-21T21:39:38.124840+0000","last_fullsized":"2024-09-21T21:39:38.124840+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.120637+0000","last_change":"2024-09-21T21:25:34.089847+0000","last_active":"2024-09-21T21:39:38.120637+0000","last_peered":"2024-09-21T21:39:38.120637+0000","last_clean":"2024-09-21T21:39:38.120637+0000","last_became_active":"2024-09-21T21:25:34.081214+0000","last_became_peered":"2024-09-21T21:25:34.081214+0000","last_unstale":"2024-09-21T21:39:38.120637+0000","last_undegraded":"2024-09-21T21:39:38.120637+0000","last_fullsized":"2024-09-21T21:39:38.120637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.107081+0000","last_change":"2024-09-21T21:25:34.052204+0000","last_active":"2024-09-21T21:39:38.107081+0000","last_peered":"2024-09-21T21:39:38.107081+0000","last_clean":"2024-09-21T21:39:38.107081+0000","last_became_active":"2024-09-21T21:25:34.040136+0000","last_became_peered":"2024-09-21T21:25:34.040136+0000","last_unstale":"2024-09-21T21:39:38.107081+0000","last_undegraded":"2024-09-21T21:39:38.107081+0000","last_fullsized":"2024-09-21T21:39:38.107081+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113523+0000","last_change":"2024-09-21T21:25:34.148087+0000","last_active":"2024-09-21T21:39:39.113523+0000","last_peered":"2024-09-21T21:39:39.113523+0000","last_clean":"2024-09-21T21:39:39.113523+0000","last_became_active":"2024-09-21T21:25:34.141821+0000","last_became_peered":"2024-09-21T21:25:34.141821+0000","last_unstale":"2024-09-21T21:39:39.113523+0000","last_undegraded":"2024-09-21T21:39:39.113523+0000","last_fullsized":"2024-09-21T21:39:39.113523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.120082+0000","last_change":"2024-09-21T21:25:34.040107+0000","last_active":"2024-09-21T21:39:39.120082+0000","last_peered":"2024-09-21T21:39:39.120082+0000","last_clean":"2024-09-21T21:39:39.120082+0000","last_became_active":"2024-09-21T21:25:34.023200+0000","last_became_peered":"2024-09-21T21:25:34.023200+0000","last_unstale":"2024-09-21T21:39:39.120082+0000","last_undegraded":"2024-09-21T21:39:39.120082+0000","last_fullsized":"2024-09-21T21:39:39.120082+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107419+0000","last_change":"2024-09-21T21:25:34.094490+0000","last_active":"2024-09-21T21:39:39.107419+0000","last_peered":"2024-09-21T21:39:39.107419+0000","last_clean":"2024-09-21T21:39:39.107419+0000","last_became_active":"2024-09-21T21:25:34.085139+0000","last_became_peered":"2024-09-21T21:25:34.085139+0000","last_unstale":"2024-09-21T21:39:39.107419+0000","last_undegraded":"2024-09-21T21:39:39.107419+0000","last_fullsized":"2024-09-21T21:39:39.107419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.112703+0000","last_change":"2024-09-21T21:25:34.072314+0000","last_active":"2024-09-21T21:39:39.112703+0000","last_peered":"2024-09-21T21:39:39.112703+0000","last_clean":"2024-09-21T21:39:39.112703+0000","last_became_active":"2024-09-21T21:25:34.040364+0000","last_became_peered":"2024-09-21T21:25:34.040364+0000","last_unstale":"2024-09-21T21:39:39.112703+0000","last_undegraded":"2024-09-21T21:39:39.112703+0000","last_fullsized":"2024-09-21T21:39:39.112703+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107433+0000","last_change":"2024-09-21T21:25:34.119092+0000","last_active":"2024-09-21T21:39:39.107433+0000","last_peered":"2024-09-21T21:39:39.107433+0000","last_clean":"2024-09-21T21:39:39.107433+0000","last_became_active":"2024-09-21T21:25:34.108210+0000","last_became_peered":"2024-09-21T21:25:34.108210+0000","last_unstale":"2024-09-21T21:39:39.107433+0000","last_undegraded":"2024-09-21T21:39:39.107433+0000","last_fullsized":"2024-09-21T21:39:39.107433+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.123968+0000","last_change":"2024-09-21T21:25:34.180232+0000","last_active":"2024-09-21T21:39:39.123968+0000","last_peered":"2024-09-21T21:39:39.123968+0000","last_clean":"2024-09-21T21:39:39.123968+0000","last_became_active":"2024-09-21T21:25:34.175298+0000","last_became_peered":"2024-09-21T21:25:34.175298+0000","last_unstale":"2024-09-21T21:39:39.123968+0000","last_undegraded":"2024-09-21T21:39:39.123968+0000","last_fullsized":"2024-09-21T21:39:39.123968+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.111596+0000","last_change":"2024-09-21T21:25:34.174441+0000","last_active":"2024-09-21T21:39:39.111596+0000","last_peered":"2024-09-21T21:39:39.111596+0000","last_clean":"2024-09-21T21:39:39.111596+0000","last_became_active":"2024-09-21T21:25:34.167932+0000","last_became_peered":"2024-09-21T21:25:34.167932+0000","last_unstale":"2024-09-21T21:39:39.111596+0000","last_undegraded":"2024-09-21T21:39:39.111596+0000","last_fullsized":"2024-09-21T21:39:39.111596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.096596+0000","last_change":"2024-09-21T21:25:34.139852+0000","last_active":"2024-09-21T21:39:39.096596+0000","last_peered":"2024-09-21T21:39:39.096596+0000","last_clean":"2024-09-21T21:39:39.096596+0000","last_became_active":"2024-09-21T21:25:34.117704+0000","last_became_peered":"2024-09-21T21:25:34.117704+0000","last_unstale":"2024-09-21T21:39:39.096596+0000","last_undegraded":"2024-09-21T21:39:39.096596+0000","last_fullsized":"2024-09-21T21:39:39.096596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1479,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.108579+0000","last_change":"2024-09-21T21:25:34.037306+0000","last_active":"2024-09-21T21:39:38.108579+0000","last_peered":"2024-09-21T21:39:38.108579+0000","last_clean":"2024-09-21T21:39:38.108579+0000","last_became_active":"2024-09-21T21:25:34.022737+0000","last_became_peered":"2024-09-21T21:25:34.022737+0000","last_unstale":"2024-09-21T21:39:38.108579+0000","last_undegraded":"2024-09-21T21:39:38.108579+0000","last_fullsized":"2024-09-21T21:39:38.108579+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113573+0000","last_change":"2024-09-21T21:25:34.053451+0000","last_active":"2024-09-21T21:39:39.113573+0000","last_peered":"2024-09-21T21:39:39.113573+0000","last_clean":"2024-09-21T21:39:39.113573+0000","last_became_active":"2024-09-21T21:25:34.042008+0000","last_became_peered":"2024-09-21T21:25:34.042008+0000","last_unstale":"2024-09-21T21:39:39.113573+0000","last_undegraded":"2024-09-21T21:39:39.113573+0000","last_fullsized":"2024-09-21T21:39:39.113573+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2139,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.134103+0000","last_change":"2024-09-21T21:20:29.170558+0000","last_active":"2024-09-21T21:39:38.134103+0000","last_peered":"2024-09-21T21:39:38.134103+0000","last_clean":"2024-09-21T21:39:38.134103+0000","last_became_active":"2024-09-21T21:20:27.209536+0000","last_became_peered":"2024-09-21T21:20:27.209536+0000","last_unstale":"2024-09-21T21:39:38.134103+0000","last_undegraded":"2024-09-21T21:39:38.134103+0000","last_fullsized":"2024-09-21T21:39:38.134103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.106177+0000","last_change":"2024-09-21T21:20:29.168730+0000","last_active":"2024-09-21T21:39:39.106177+0000","last_peered":"2024-09-21T21:39:39.106177+0000","last_clean":"2024-09-21T21:39:39.106177+0000","last_became_active":"2024-09-21T21:20:27.208215+0000","last_became_peered":"2024-09-21T21:20:27.208215+0000","last_unstale":"2024-09-21T21:39:39.106177+0000","last_undegraded":"2024-09-21T21:39:39.106177+0000","last_fullsized":"2024-09-21T21:39:39.106177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119386+0000","last_change":"2024-09-21T21:20:29.169143+0000","last_active":"2024-09-21T21:39:39.119386+0000","last_peered":"2024-09-21T21:39:39.119386+0000","last_clean":"2024-09-21T21:39:39.119386+0000","last_became_active":"2024-09-21T21:20:27.191527+0000","last_became_peered":"2024-09-21T21:20:27.191527+0000","last_unstale":"2024-09-21T21:39:39.119386+0000","last_undegraded":"2024-09-21T21:39:39.119386+0000","last_fullsized":"2024-09-21T21:39:39.119386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101535+0000","last_change":"2024-09-21T21:20:29.167100+0000","last_active":"2024-09-21T21:39:39.101535+0000","last_peered":"2024-09-21T21:39:39.101535+0000","last_clean":"2024-09-21T21:39:39.101535+0000","last_became_active":"2024-09-21T21:20:27.193527+0000","last_became_peered":"2024-09-21T21:20:27.193527+0000","last_unstale":"2024-09-21T21:39:39.101535+0000","last_undegraded":"2024-09-21T21:39:39.101535+0000","last_fullsized":"2024-09-21T21:39:39.101535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124842+0000","last_change":"2024-09-21T21:20:29.169124+0000","last_active":"2024-09-21T21:39:39.124842+0000","last_peered":"2024-09-21T21:39:39.124842+0000","last_clean":"2024-09-21T21:39:39.124842+0000","last_became_active":"2024-09-21T21:20:27.194367+0000","last_became_peered":"2024-09-21T21:20:27.194367+0000","last_unstale":"2024-09-21T21:39:39.124842+0000","last_undegraded":"2024-09-21T21:39:39.124842+0000","last_fullsized":"2024-09-21T21:39:39.124842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2139,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.096227+0000","last_change":"2024-09-21T21:20:29.166574+0000","last_active":"2024-09-21T21:39:38.096227+0000","last_peered":"2024-09-21T21:39:38.096227+0000","last_clean":"2024-09-21T21:39:38.096227+0000","last_became_active":"2024-09-21T21:20:27.194446+0000","last_became_peered":"2024-09-21T21:20:27.194446+0000","last_unstale":"2024-09-21T21:39:38.096227+0000","last_undegraded":"2024-09-21T21:39:38.096227+0000","last_fullsized":"2024-09-21T21:39:38.096227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.125600+0000","last_change":"2024-09-21T21:20:29.170643+0000","last_active":"2024-09-21T21:39:39.125600+0000","last_peered":"2024-09-21T21:39:39.125600+0000","last_clean":"2024-09-21T21:39:39.125600+0000","last_became_active":"2024-09-21T21:20:27.204212+0000","last_became_peered":"2024-09-21T21:20:27.204212+0000","last_unstale":"2024-09-21T21:39:39.125600+0000","last_undegraded":"2024-09-21T21:39:39.125600+0000","last_fullsized":"2024-09-21T21:39:39.125600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2140,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.123038+0000","last_change":"2024-09-21T21:20:29.170295+0000","last_active":"2024-09-21T21:39:38.123038+0000","last_peered":"2024-09-21T21:39:38.123038+0000","last_clean":"2024-09-21T21:39:38.123038+0000","last_became_active":"2024-09-21T21:20:27.211878+0000","last_became_peered":"2024-09-21T21:20:27.211878+0000","last_unstale":"2024-09-21T21:39:38.123038+0000","last_undegraded":"2024-09-21T21:39:38.123038+0000","last_fullsized":"2024-09-21T21:39:38.123038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2211,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.102375+0000","last_change":"2024-09-21T21:20:26.198858+0000","last_active":"2024-09-21T21:39:39.102375+0000","last_peered":"2024-09-21T21:39:39.102375+0000","last_clean":"2024-09-21T21:39:39.102375+0000","last_became_active":"2024-09-21T21:20:26.190843+0000","last_became_peered":"2024-09-21T21:20:26.190843+0000","last_unstale":"2024-09-21T21:39:39.102375+0000","last_undegraded":"2024-09-21T21:39:39.102375+0000","last_fullsized":"2024-09-21T21:39:39.102375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_clean_scrub_stamp":"2024-09-21T21:20:25.135404+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64120,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":6922240,"data_stored":3458617,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69648,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94302192,"statfs":{"total":96636764160,"available":96565444608,"internally_reserved":0,"allocated":6881280,"data_stored":2881148,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68284,"kb_used_data":6764,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94303556,"statfs":{"total":96636764160,"available":96566841344,"internally_reserved":0,"allocated":6926336,"data_stored":2941101,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73864,"kb_used_data":6776,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94297976,"statfs":{"total":96636764160,"available":96561127424,"internally_reserved":0,"allocated":6938624,"data_stored":3462651,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T21:39:40.471 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-21T21:39:40.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T21:39:40.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.579+0000 7ff1edabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:40.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.585+0000 7ff1edabd640 1 Processor -- start 2024-09-21T21:39:40.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.585+0000 7ff1edabd640 1 -- start start 2024-09-21T21:39:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.586+0000 7ff1edabd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1e809c920 0x7ff1e8137730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.586+0000 7ff1edabd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e806f8e0 con 0x7ff1e809be00 2024-09-21T21:39:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.586+0000 7ff1edabd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e806f3b0 con 0x7ff1e809c920 2024-09-21T21:39:40.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.586+0000 7ff1e6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1e809c920 0x7ff1e8137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.586+0000 7ff1e6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7ff1e809c920 0x7ff1e8137730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35896/0 (socket says 172.21.15.5:35896) 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.586+0000 7ff1e77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7ff1e809be00 0x7ff1e809c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42374/0 (socket says 172.21.15.5:42374) 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.586+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/262037557 learned_addr learned my addr 172.21.15.5:0/262037557 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.587+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/262037557 >> v1:172.21.15.5:6789/0 conn(0x7ff1e809be00 legacy=0x7ff1e809c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.587+0000 7ff1e67fc640 1 -- 172.21.15.5:0/262037557 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252245536 0 0) 0x7ff1e806f8e0 con 0x7ff1e809be00 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.587+0000 7ff1e6ffd640 1 -- 172.21.15.5:0/262037557 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e809cf30 con 0x7ff1e809c920 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.587+0000 7ff1e6ffd640 1 --2- 172.21.15.5:0/262037557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809c920 0x7ff1e8137730 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e01ee80c9c6fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.587+0000 7ff1e67fc640 1 -- 172.21.15.5:0/262037557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1dc009e50 con 0x7ff1e809c920 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.587+0000 7ff1e67fc640 1 -- 172.21.15.5:0/262037557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff1dc00e230 con 0x7ff1e809c920 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.587+0000 7ff1e67fc640 1 -- 172.21.15.5:0/262037557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1dc00e4d0 con 0x7ff1e809c920 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 1 -- 172.21.15.5:0/262037557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809c920 msgr2=0x7ff1e8137730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 1 --2- 172.21.15.5:0/262037557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809c920 0x7ff1e8137730 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 1 -- 172.21.15.5:0/262037557 shutdown_connections 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 1 --2- 172.21.15.5:0/262037557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809c920 0x7ff1e8137730 unknown :-1 s=CLOSED pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 1 -- 172.21.15.5:0/262037557 >> 172.21.15.5:0/262037557 conn(0x7ff1e80a4070 msgr2=0x7ff1e80a4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 1 -- 172.21.15.5:0/262037557 shutdown_connections 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 1 -- 172.21.15.5:0/262037557 wait complete. 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.588+0000 7ff1edabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.590+0000 7ff1edabd640 1 Processor -- start 2024-09-21T21:39:40.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.590+0000 7ff1edabd640 1 -- start start 2024-09-21T21:39:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1edabd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809be00 0x7ff1e8129780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1edabd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e812ac10 con 0x7ff1e809be00 2024-09-21T21:39:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809be00 0x7ff1e8129780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1e77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809be00 0x7ff1e8129780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35912/0 (socket says 172.21.15.5:35912) 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1e77fe640 1 -- 172.21.15.5:0/2457838850 learned_addr learned my addr 172.21.15.5:0/2457838850 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1e77fe640 1 -- 172.21.15.5:0/2457838850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e812cc20 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1e77fe640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809be00 0x7ff1e8129780 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1cffff640 1 -- 172.21.15.5:0/2457838850 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1d800ebb0 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1cffff640 1 -- 172.21.15.5:0/2457838850 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff1d800ed10 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e812c880 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1cffff640 1 -- 172.21.15.5:0/2457838850 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff1d8004840 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.592+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e812d210 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.593+0000 7ff1cffff640 1 -- 172.21.15.5:0/2457838850 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7ff1d80049a0 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.594+0000 7ff1cffff640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff1d403ead0 0x7ff1d4040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.594+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e809fb90 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.594+0000 7ff1cffff640 1 -- 172.21.15.5:0/2457838850 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7ff1d8052720 con 0x7ff1e809be00 2024-09-21T21:39:40.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.594+0000 7ff1e6ffd640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff1d403ead0 0x7ff1d4040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.595+0000 7ff1e6ffd640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff1d403ead0 0x7ff1d4040fe0 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.599+0000 7ff1cffff640 1 -- 172.21.15.5:0/2457838850 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7ff1d8011de0 con 0x7ff1e809be00 2024-09-21T21:39:40.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.784+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1e806e4e0 con 0x7ff1d403ead0 2024-09-21T21:39:40.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.786+0000 7ff1cffff640 1 -- 172.21.15.5:0/2457838850 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109235 (crc 0 0 0) 0x7ff1e806e4e0 con 0x7ff1d403ead0 2024-09-21T21:39:40.790 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:39:40.790 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-21T21:39:40.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff1d403ead0 msgr2=0x7ff1d4040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff1d403ead0 0x7ff1d4040fe0 crc :-1 s=READY pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809be00 msgr2=0x7ff1e8129780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809be00 0x7ff1e8129780 crc :-1 s=READY pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 shutdown_connections 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7ff1d403ead0 0x7ff1d4040fe0 unknown :-1 s=CLOSED pgs=3848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 --2- 172.21.15.5:0/2457838850 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1e809be00 0x7ff1e8129780 unknown :-1 s=CLOSED pgs=12978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 >> 172.21.15.5:0/2457838850 conn(0x7ff1e80a4070 msgr2=0x7ff1e80740a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:40.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 shutdown_connections 2024-09-21T21:39:40.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.789+0000 7ff1edabd640 1 -- 172.21.15.5:0/2457838850 wait complete. 2024-09-21T21:39:40.803 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1295,"stamp":"2024-09-21T21:39:39.350804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":275916,"kb_used_data":27020,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377211444,"statfs":{"total":386547056640,"available":386264518656,"internally_reserved":0,"allocated":27668480,"data_stored":12743517,"data_compressed":218950,"data_compressed_allocated":303104,"data_compressed_original":1478656,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002448"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.125975+0000","last_change":"2024-09-21T21:25:34.029761+0000","last_active":"2024-09-21T21:39:38.125975+0000","last_peered":"2024-09-21T21:39:38.125975+0000","last_clean":"2024-09-21T21:39:38.125975+0000","last_became_active":"2024-09-21T21:25:34.012471+0000","last_became_peered":"2024-09-21T21:25:34.012471+0000","last_unstale":"2024-09-21T21:39:38.125975+0000","last_undegraded":"2024-09-21T21:39:38.125975+0000","last_fullsized":"2024-09-21T21:39:38.125975+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130941+0000","last_change":"2024-09-21T21:25:34.106122+0000","last_active":"2024-09-21T21:39:39.130941+0000","last_peered":"2024-09-21T21:39:39.130941+0000","last_clean":"2024-09-21T21:39:39.130941+0000","last_became_active":"2024-09-21T21:25:34.089828+0000","last_became_peered":"2024-09-21T21:25:34.089828+0000","last_unstale":"2024-09-21T21:39:39.130941+0000","last_undegraded":"2024-09-21T21:39:39.130941+0000","last_fullsized":"2024-09-21T21:39:39.130941+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118711+0000","last_change":"2024-09-21T21:25:34.128590+0000","last_active":"2024-09-21T21:39:39.118711+0000","last_peered":"2024-09-21T21:39:39.118711+0000","last_clean":"2024-09-21T21:39:39.118711+0000","last_became_active":"2024-09-21T21:25:34.123143+0000","last_became_peered":"2024-09-21T21:25:34.123143+0000","last_unstale":"2024-09-21T21:39:39.118711+0000","last_undegraded":"2024-09-21T21:39:39.118711+0000","last_fullsized":"2024-09-21T21:39:39.118711+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101148+0000","last_change":"2024-09-21T21:25:34.040888+0000","last_active":"2024-09-21T21:39:39.101148+0000","last_peered":"2024-09-21T21:39:39.101148+0000","last_clean":"2024-09-21T21:39:39.101148+0000","last_became_active":"2024-09-21T21:25:34.018004+0000","last_became_peered":"2024-09-21T21:25:34.018004+0000","last_unstale":"2024-09-21T21:39:39.101148+0000","last_undegraded":"2024-09-21T21:39:39.101148+0000","last_fullsized":"2024-09-21T21:39:39.101148+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.116675+0000","last_change":"2024-09-21T21:25:34.086835+0000","last_active":"2024-09-21T21:39:38.116675+0000","last_peered":"2024-09-21T21:39:38.116675+0000","last_clean":"2024-09-21T21:39:38.116675+0000","last_became_active":"2024-09-21T21:25:34.080013+0000","last_became_peered":"2024-09-21T21:25:34.080013+0000","last_unstale":"2024-09-21T21:39:38.116675+0000","last_undegraded":"2024-09-21T21:39:38.116675+0000","last_fullsized":"2024-09-21T21:39:38.116675+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.128637+0000","last_change":"2024-09-21T21:25:34.056398+0000","last_active":"2024-09-21T21:39:39.128637+0000","last_peered":"2024-09-21T21:39:39.128637+0000","last_clean":"2024-09-21T21:39:39.128637+0000","last_became_active":"2024-09-21T21:25:34.025780+0000","last_became_peered":"2024-09-21T21:25:34.025780+0000","last_unstale":"2024-09-21T21:39:39.128637+0000","last_undegraded":"2024-09-21T21:39:39.128637+0000","last_fullsized":"2024-09-21T21:39:39.128637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130249+0000","last_change":"2024-09-21T21:25:34.149489+0000","last_active":"2024-09-21T21:39:39.130249+0000","last_peered":"2024-09-21T21:39:39.130249+0000","last_clean":"2024-09-21T21:39:39.130249+0000","last_became_active":"2024-09-21T21:25:34.139437+0000","last_became_peered":"2024-09-21T21:25:34.139437+0000","last_unstale":"2024-09-21T21:39:39.130249+0000","last_undegraded":"2024-09-21T21:39:39.130249+0000","last_fullsized":"2024-09-21T21:39:39.130249+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130207+0000","last_change":"2024-09-21T21:25:34.213148+0000","last_active":"2024-09-21T21:39:39.130207+0000","last_peered":"2024-09-21T21:39:39.130207+0000","last_clean":"2024-09-21T21:39:39.130207+0000","last_became_active":"2024-09-21T21:25:34.201780+0000","last_became_peered":"2024-09-21T21:25:34.201780+0000","last_unstale":"2024-09-21T21:39:39.130207+0000","last_undegraded":"2024-09-21T21:39:39.130207+0000","last_fullsized":"2024-09-21T21:39:39.130207+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105208+0000","last_change":"2024-09-21T21:25:34.073687+0000","last_active":"2024-09-21T21:39:39.105208+0000","last_peered":"2024-09-21T21:39:39.105208+0000","last_clean":"2024-09-21T21:39:39.105208+0000","last_became_active":"2024-09-21T21:25:34.064521+0000","last_became_peered":"2024-09-21T21:25:34.064521+0000","last_unstale":"2024-09-21T21:39:39.105208+0000","last_undegraded":"2024-09-21T21:39:39.105208+0000","last_fullsized":"2024-09-21T21:39:39.105208+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.091873+0000","last_change":"2024-09-21T21:25:34.085317+0000","last_active":"2024-09-21T21:39:39.091873+0000","last_peered":"2024-09-21T21:39:39.091873+0000","last_clean":"2024-09-21T21:39:39.091873+0000","last_became_active":"2024-09-21T21:25:34.067565+0000","last_became_peered":"2024-09-21T21:25:34.067565+0000","last_unstale":"2024-09-21T21:39:39.091873+0000","last_undegraded":"2024-09-21T21:39:39.091873+0000","last_fullsized":"2024-09-21T21:39:39.091873+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.093009+0000","last_change":"2024-09-21T21:25:34.077035+0000","last_active":"2024-09-21T21:39:39.093009+0000","last_peered":"2024-09-21T21:39:39.093009+0000","last_clean":"2024-09-21T21:39:39.093009+0000","last_became_active":"2024-09-21T21:25:34.062261+0000","last_became_peered":"2024-09-21T21:25:34.062261+0000","last_unstale":"2024-09-21T21:39:39.093009+0000","last_undegraded":"2024-09-21T21:39:39.093009+0000","last_fullsized":"2024-09-21T21:39:39.093009+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.129644+0000","last_change":"2024-09-21T21:25:34.111175+0000","last_active":"2024-09-21T21:39:39.129644+0000","last_peered":"2024-09-21T21:39:39.129644+0000","last_clean":"2024-09-21T21:39:39.129644+0000","last_became_active":"2024-09-21T21:25:34.089008+0000","last_became_peered":"2024-09-21T21:25:34.089008+0000","last_unstale":"2024-09-21T21:39:39.129644+0000","last_undegraded":"2024-09-21T21:39:39.129644+0000","last_fullsized":"2024-09-21T21:39:39.129644+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105956+0000","last_change":"2024-09-21T21:25:34.090272+0000","last_active":"2024-09-21T21:39:39.105956+0000","last_peered":"2024-09-21T21:39:39.105956+0000","last_clean":"2024-09-21T21:39:39.105956+0000","last_became_active":"2024-09-21T21:25:34.079561+0000","last_became_peered":"2024-09-21T21:25:34.079561+0000","last_unstale":"2024-09-21T21:39:39.105956+0000","last_undegraded":"2024-09-21T21:39:39.105956+0000","last_fullsized":"2024-09-21T21:39:39.105956+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118060+0000","last_change":"2024-09-21T21:25:34.131274+0000","last_active":"2024-09-21T21:39:39.118060+0000","last_peered":"2024-09-21T21:39:39.118060+0000","last_clean":"2024-09-21T21:39:39.118060+0000","last_became_active":"2024-09-21T21:25:34.124318+0000","last_became_peered":"2024-09-21T21:25:34.124318+0000","last_unstale":"2024-09-21T21:39:39.118060+0000","last_undegraded":"2024-09-21T21:39:39.118060+0000","last_fullsized":"2024-09-21T21:39:39.118060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.135902+0000","last_change":"2024-09-21T21:25:34.231684+0000","last_active":"2024-09-21T21:39:39.135902+0000","last_peered":"2024-09-21T21:39:39.135902+0000","last_clean":"2024-09-21T21:39:39.135902+0000","last_became_active":"2024-09-21T21:25:34.226528+0000","last_became_peered":"2024-09-21T21:25:34.226528+0000","last_unstale":"2024-09-21T21:39:39.135902+0000","last_undegraded":"2024-09-21T21:39:39.135902+0000","last_fullsized":"2024-09-21T21:39:39.135902+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124409+0000","last_change":"2024-09-21T21:25:34.067759+0000","last_active":"2024-09-21T21:39:39.124409+0000","last_peered":"2024-09-21T21:39:39.124409+0000","last_clean":"2024-09-21T21:39:39.124409+0000","last_became_active":"2024-09-21T21:25:34.050600+0000","last_became_peered":"2024-09-21T21:25:34.050600+0000","last_unstale":"2024-09-21T21:39:39.124409+0000","last_undegraded":"2024-09-21T21:39:39.124409+0000","last_fullsized":"2024-09-21T21:39:39.124409+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.103595+0000","last_change":"2024-09-21T21:25:34.133956+0000","last_active":"2024-09-21T21:39:39.103595+0000","last_peered":"2024-09-21T21:39:39.103595+0000","last_clean":"2024-09-21T21:39:39.103595+0000","last_became_active":"2024-09-21T21:25:34.100820+0000","last_became_peered":"2024-09-21T21:25:34.100820+0000","last_unstale":"2024-09-21T21:39:39.103595+0000","last_undegraded":"2024-09-21T21:39:39.103595+0000","last_fullsized":"2024-09-21T21:39:39.103595+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.109680+0000","last_change":"2024-09-21T21:25:34.044370+0000","last_active":"2024-09-21T21:39:39.109680+0000","last_peered":"2024-09-21T21:39:39.109680+0000","last_clean":"2024-09-21T21:39:39.109680+0000","last_became_active":"2024-09-21T21:25:34.027204+0000","last_became_peered":"2024-09-21T21:25:34.027204+0000","last_unstale":"2024-09-21T21:39:39.109680+0000","last_undegraded":"2024-09-21T21:39:39.109680+0000","last_fullsized":"2024-09-21T21:39:39.109680+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119701+0000","last_change":"2024-09-21T21:25:34.073415+0000","last_active":"2024-09-21T21:39:39.119701+0000","last_peered":"2024-09-21T21:39:39.119701+0000","last_clean":"2024-09-21T21:39:39.119701+0000","last_became_active":"2024-09-21T21:25:34.065857+0000","last_became_peered":"2024-09-21T21:25:34.065857+0000","last_unstale":"2024-09-21T21:39:39.119701+0000","last_undegraded":"2024-09-21T21:39:39.119701+0000","last_fullsized":"2024-09-21T21:39:39.119701+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.124840+0000","last_change":"2024-09-21T21:25:34.158667+0000","last_active":"2024-09-21T21:39:38.124840+0000","last_peered":"2024-09-21T21:39:38.124840+0000","last_clean":"2024-09-21T21:39:38.124840+0000","last_became_active":"2024-09-21T21:25:34.152022+0000","last_became_peered":"2024-09-21T21:25:34.152022+0000","last_unstale":"2024-09-21T21:39:38.124840+0000","last_undegraded":"2024-09-21T21:39:38.124840+0000","last_fullsized":"2024-09-21T21:39:38.124840+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.120637+0000","last_change":"2024-09-21T21:25:34.089847+0000","last_active":"2024-09-21T21:39:38.120637+0000","last_peered":"2024-09-21T21:39:38.120637+0000","last_clean":"2024-09-21T21:39:38.120637+0000","last_became_active":"2024-09-21T21:25:34.081214+0000","last_became_peered":"2024-09-21T21:25:34.081214+0000","last_unstale":"2024-09-21T21:39:38.120637+0000","last_undegraded":"2024-09-21T21:39:38.120637+0000","last_fullsized":"2024-09-21T21:39:38.120637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1466,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.107081+0000","last_change":"2024-09-21T21:25:34.052204+0000","last_active":"2024-09-21T21:39:38.107081+0000","last_peered":"2024-09-21T21:39:38.107081+0000","last_clean":"2024-09-21T21:39:38.107081+0000","last_became_active":"2024-09-21T21:25:34.040136+0000","last_became_peered":"2024-09-21T21:25:34.040136+0000","last_unstale":"2024-09-21T21:39:38.107081+0000","last_undegraded":"2024-09-21T21:39:38.107081+0000","last_fullsized":"2024-09-21T21:39:38.107081+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113523+0000","last_change":"2024-09-21T21:25:34.148087+0000","last_active":"2024-09-21T21:39:39.113523+0000","last_peered":"2024-09-21T21:39:39.113523+0000","last_clean":"2024-09-21T21:39:39.113523+0000","last_became_active":"2024-09-21T21:25:34.141821+0000","last_became_peered":"2024-09-21T21:25:34.141821+0000","last_unstale":"2024-09-21T21:39:39.113523+0000","last_undegraded":"2024-09-21T21:39:39.113523+0000","last_fullsized":"2024-09-21T21:39:39.113523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.120082+0000","last_change":"2024-09-21T21:25:34.040107+0000","last_active":"2024-09-21T21:39:39.120082+0000","last_peered":"2024-09-21T21:39:39.120082+0000","last_clean":"2024-09-21T21:39:39.120082+0000","last_became_active":"2024-09-21T21:25:34.023200+0000","last_became_peered":"2024-09-21T21:25:34.023200+0000","last_unstale":"2024-09-21T21:39:39.120082+0000","last_undegraded":"2024-09-21T21:39:39.120082+0000","last_fullsized":"2024-09-21T21:39:39.120082+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107419+0000","last_change":"2024-09-21T21:25:34.094490+0000","last_active":"2024-09-21T21:39:39.107419+0000","last_peered":"2024-09-21T21:39:39.107419+0000","last_clean":"2024-09-21T21:39:39.107419+0000","last_became_active":"2024-09-21T21:25:34.085139+0000","last_became_peered":"2024-09-21T21:25:34.085139+0000","last_unstale":"2024-09-21T21:39:39.107419+0000","last_undegraded":"2024-09-21T21:39:39.107419+0000","last_fullsized":"2024-09-21T21:39:39.107419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.112703+0000","last_change":"2024-09-21T21:25:34.072314+0000","last_active":"2024-09-21T21:39:39.112703+0000","last_peered":"2024-09-21T21:39:39.112703+0000","last_clean":"2024-09-21T21:39:39.112703+0000","last_became_active":"2024-09-21T21:25:34.040364+0000","last_became_peered":"2024-09-21T21:25:34.040364+0000","last_unstale":"2024-09-21T21:39:39.112703+0000","last_undegraded":"2024-09-21T21:39:39.112703+0000","last_fullsized":"2024-09-21T21:39:39.112703+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107433+0000","last_change":"2024-09-21T21:25:34.119092+0000","last_active":"2024-09-21T21:39:39.107433+0000","last_peered":"2024-09-21T21:39:39.107433+0000","last_clean":"2024-09-21T21:39:39.107433+0000","last_became_active":"2024-09-21T21:25:34.108210+0000","last_became_peered":"2024-09-21T21:25:34.108210+0000","last_unstale":"2024-09-21T21:39:39.107433+0000","last_undegraded":"2024-09-21T21:39:39.107433+0000","last_fullsized":"2024-09-21T21:39:39.107433+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.123968+0000","last_change":"2024-09-21T21:25:34.180232+0000","last_active":"2024-09-21T21:39:39.123968+0000","last_peered":"2024-09-21T21:39:39.123968+0000","last_clean":"2024-09-21T21:39:39.123968+0000","last_became_active":"2024-09-21T21:25:34.175298+0000","last_became_peered":"2024-09-21T21:25:34.175298+0000","last_unstale":"2024-09-21T21:39:39.123968+0000","last_undegraded":"2024-09-21T21:39:39.123968+0000","last_fullsized":"2024-09-21T21:39:39.123968+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.111596+0000","last_change":"2024-09-21T21:25:34.174441+0000","last_active":"2024-09-21T21:39:39.111596+0000","last_peered":"2024-09-21T21:39:39.111596+0000","last_clean":"2024-09-21T21:39:39.111596+0000","last_became_active":"2024-09-21T21:25:34.167932+0000","last_became_peered":"2024-09-21T21:25:34.167932+0000","last_unstale":"2024-09-21T21:39:39.111596+0000","last_undegraded":"2024-09-21T21:39:39.111596+0000","last_fullsized":"2024-09-21T21:39:39.111596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.096596+0000","last_change":"2024-09-21T21:25:34.139852+0000","last_active":"2024-09-21T21:39:39.096596+0000","last_peered":"2024-09-21T21:39:39.096596+0000","last_clean":"2024-09-21T21:39:39.096596+0000","last_became_active":"2024-09-21T21:25:34.117704+0000","last_became_peered":"2024-09-21T21:25:34.117704+0000","last_unstale":"2024-09-21T21:39:39.096596+0000","last_undegraded":"2024-09-21T21:39:39.096596+0000","last_fullsized":"2024-09-21T21:39:39.096596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1479,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.108579+0000","last_change":"2024-09-21T21:25:34.037306+0000","last_active":"2024-09-21T21:39:38.108579+0000","last_peered":"2024-09-21T21:39:38.108579+0000","last_clean":"2024-09-21T21:39:38.108579+0000","last_became_active":"2024-09-21T21:25:34.022737+0000","last_became_peered":"2024-09-21T21:25:34.022737+0000","last_unstale":"2024-09-21T21:39:38.108579+0000","last_undegraded":"2024-09-21T21:39:38.108579+0000","last_fullsized":"2024-09-21T21:39:38.108579+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113573+0000","last_change":"2024-09-21T21:25:34.053451+0000","last_active":"2024-09-21T21:39:39.113573+0000","last_peered":"2024-09-21T21:39:39.113573+0000","last_clean":"2024-09-21T21:39:39.113573+0000","last_became_active":"2024-09-21T21:25:34.042008+0000","last_became_peered":"2024-09-21T21:25:34.042008+0000","last_unstale":"2024-09-21T21:39:39.113573+0000","last_undegraded":"2024-09-21T21:39:39.113573+0000","last_fullsized":"2024-09-21T21:39:39.113573+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2139,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.134103+0000","last_change":"2024-09-21T21:20:29.170558+0000","last_active":"2024-09-21T21:39:38.134103+0000","last_peered":"2024-09-21T21:39:38.134103+0000","last_clean":"2024-09-21T21:39:38.134103+0000","last_became_active":"2024-09-21T21:20:27.209536+0000","last_became_peered":"2024-09-21T21:20:27.209536+0000","last_unstale":"2024-09-21T21:39:38.134103+0000","last_undegraded":"2024-09-21T21:39:38.134103+0000","last_fullsized":"2024-09-21T21:39:38.134103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.106177+0000","last_change":"2024-09-21T21:20:29.168730+0000","last_active":"2024-09-21T21:39:39.106177+0000","last_peered":"2024-09-21T21:39:39.106177+0000","last_clean":"2024-09-21T21:39:39.106177+0000","last_became_active":"2024-09-21T21:20:27.208215+0000","last_became_peered":"2024-09-21T21:20:27.208215+0000","last_unstale":"2024-09-21T21:39:39.106177+0000","last_undegraded":"2024-09-21T21:39:39.106177+0000","last_fullsized":"2024-09-21T21:39:39.106177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119386+0000","last_change":"2024-09-21T21:20:29.169143+0000","last_active":"2024-09-21T21:39:39.119386+0000","last_peered":"2024-09-21T21:39:39.119386+0000","last_clean":"2024-09-21T21:39:39.119386+0000","last_became_active":"2024-09-21T21:20:27.191527+0000","last_became_peered":"2024-09-21T21:20:27.191527+0000","last_unstale":"2024-09-21T21:39:39.119386+0000","last_undegraded":"2024-09-21T21:39:39.119386+0000","last_fullsized":"2024-09-21T21:39:39.119386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101535+0000","last_change":"2024-09-21T21:20:29.167100+0000","last_active":"2024-09-21T21:39:39.101535+0000","last_peered":"2024-09-21T21:39:39.101535+0000","last_clean":"2024-09-21T21:39:39.101535+0000","last_became_active":"2024-09-21T21:20:27.193527+0000","last_became_peered":"2024-09-21T21:20:27.193527+0000","last_unstale":"2024-09-21T21:39:39.101535+0000","last_undegraded":"2024-09-21T21:39:39.101535+0000","last_fullsized":"2024-09-21T21:39:39.101535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124842+0000","last_change":"2024-09-21T21:20:29.169124+0000","last_active":"2024-09-21T21:39:39.124842+0000","last_peered":"2024-09-21T21:39:39.124842+0000","last_clean":"2024-09-21T21:39:39.124842+0000","last_became_active":"2024-09-21T21:20:27.194367+0000","last_became_peered":"2024-09-21T21:20:27.194367+0000","last_unstale":"2024-09-21T21:39:39.124842+0000","last_undegraded":"2024-09-21T21:39:39.124842+0000","last_fullsized":"2024-09-21T21:39:39.124842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2139,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.096227+0000","last_change":"2024-09-21T21:20:29.166574+0000","last_active":"2024-09-21T21:39:38.096227+0000","last_peered":"2024-09-21T21:39:38.096227+0000","last_clean":"2024-09-21T21:39:38.096227+0000","last_became_active":"2024-09-21T21:20:27.194446+0000","last_became_peered":"2024-09-21T21:20:27.194446+0000","last_unstale":"2024-09-21T21:39:38.096227+0000","last_undegraded":"2024-09-21T21:39:38.096227+0000","last_fullsized":"2024-09-21T21:39:38.096227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.125600+0000","last_change":"2024-09-21T21:20:29.170643+0000","last_active":"2024-09-21T21:39:39.125600+0000","last_peered":"2024-09-21T21:39:39.125600+0000","last_clean":"2024-09-21T21:39:39.125600+0000","last_became_active":"2024-09-21T21:20:27.204212+0000","last_became_peered":"2024-09-21T21:20:27.204212+0000","last_unstale":"2024-09-21T21:39:39.125600+0000","last_undegraded":"2024-09-21T21:39:39.125600+0000","last_fullsized":"2024-09-21T21:39:39.125600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2140,"reported_epoch":723,"state":"active+clean","last_fresh":"2024-09-21T21:39:38.123038+0000","last_change":"2024-09-21T21:20:29.170295+0000","last_active":"2024-09-21T21:39:38.123038+0000","last_peered":"2024-09-21T21:39:38.123038+0000","last_clean":"2024-09-21T21:39:38.123038+0000","last_became_active":"2024-09-21T21:20:27.211878+0000","last_became_peered":"2024-09-21T21:20:27.211878+0000","last_unstale":"2024-09-21T21:39:38.123038+0000","last_undegraded":"2024-09-21T21:39:38.123038+0000","last_fullsized":"2024-09-21T21:39:38.123038+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2211,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.102375+0000","last_change":"2024-09-21T21:20:26.198858+0000","last_active":"2024-09-21T21:39:39.102375+0000","last_peered":"2024-09-21T21:39:39.102375+0000","last_clean":"2024-09-21T21:39:39.102375+0000","last_became_active":"2024-09-21T21:20:26.190843+0000","last_became_peered":"2024-09-21T21:20:26.190843+0000","last_unstale":"2024-09-21T21:39:39.102375+0000","last_undegraded":"2024-09-21T21:39:39.102375+0000","last_fullsized":"2024-09-21T21:39:39.102375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_clean_scrub_stamp":"2024-09-21T21:20:25.135404+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64120,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":6922240,"data_stored":3458617,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69648,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94302192,"statfs":{"total":96636764160,"available":96565444608,"internally_reserved":0,"allocated":6881280,"data_stored":2881148,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706818,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68284,"kb_used_data":6764,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94303556,"statfs":{"total":96636764160,"available":96566841344,"internally_reserved":0,"allocated":6926336,"data_stored":2941101,"data_compressed":64768,"data_compressed_allocated":90112,"data_compressed_original":135168,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73864,"kb_used_data":6776,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94297976,"statfs":{"total":96636764160,"available":96561127424,"internally_reserved":0,"allocated":6938624,"data_stored":3462651,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T21:39:40.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T21:39:40.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.913+0000 7f116fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.918+0000 7f116fd91640 1 Processor -- start 2024-09-21T21:39:40.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.918+0000 7f116fd91640 1 -- start start 2024-09-21T21:39:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116fd91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f116809d0e0 0x7f1168138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116fd91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116809e2e0 con 0x7f116809da50 2024-09-21T21:39:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116fd91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f1168073d20 con 0x7f116809d0e0 2024-09-21T21:39:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116d32c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f116809d0e0 0x7f1168138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116d32c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f116809d0e0 0x7f1168138fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35916/0 (socket says 172.21.15.5:35916) 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116db2d640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f116809da50 0x7f116809c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42376/0 (socket says 172.21.15.5:42376) 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116d32c640 1 -- 172.21.15.5:0/1861788479 learned_addr learned my addr 172.21.15.5:0/1861788479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116d32c640 1 -- 172.21.15.5:0/1861788479 >> v1:172.21.15.5:6789/0 conn(0x7f116809da50 legacy=0x7f116809c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116d32c640 1 -- 172.21.15.5:0/1861788479 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116809ee80 con 0x7f116809d0e0 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116cb2b640 1 -- 172.21.15.5:0/1861788479 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138426217 0 0) 0x7f116809e2e0 con 0x7f116809da50 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.920+0000 7f116d32c640 1 --2- 172.21.15.5:0/1861788479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168138fe0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c185fc0180d9ace server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116cb2b640 1 -- 172.21.15.5:0/1861788479 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1158009e50 con 0x7f116809d0e0 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116cb2b640 1 -- 172.21.15.5:0/1861788479 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f115800e230 con 0x7f116809d0e0 2024-09-21T21:39:40.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116cb2b640 1 -- 172.21.15.5:0/1861788479 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f115800e4d0 con 0x7f116809d0e0 2024-09-21T21:39:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116fd91640 1 -- 172.21.15.5:0/1861788479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 msgr2=0x7f1168138fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116fd91640 1 --2- 172.21.15.5:0/1861788479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168138fe0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116fd91640 1 -- 172.21.15.5:0/1861788479 shutdown_connections 2024-09-21T21:39:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116fd91640 1 --2- 172.21.15.5:0/1861788479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168138fe0 unknown :-1 s=CLOSED pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116fd91640 1 -- 172.21.15.5:0/1861788479 >> 172.21.15.5:0/1861788479 conn(0x7f11680a42d0 msgr2=0x7f1168073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.921+0000 7f116fd91640 1 -- 172.21.15.5:0/1861788479 shutdown_connections 2024-09-21T21:39:40.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.922+0000 7f116fd91640 1 -- 172.21.15.5:0/1861788479 wait complete. 2024-09-21T21:39:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.922+0000 7f116fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.924+0000 7f116fd91640 1 Processor -- start 2024-09-21T21:39:40.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.924+0000 7f116fd91640 1 -- start start 2024-09-21T21:39:40.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.925+0000 7f116fd91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168121ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.925+0000 7f116fd91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1168121510 con 0x7f116809d0e0 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.925+0000 7f116db2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168121ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.925+0000 7f116db2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168121ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35926/0 (socket says 172.21.15.5:35926) 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.925+0000 7f116db2d640 1 -- 172.21.15.5:0/2737960178 learned_addr learned my addr 172.21.15.5:0/2737960178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.926+0000 7f116db2d640 1 -- 172.21.15.5:0/2737960178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1168121aa0 con 0x7f116809d0e0 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.926+0000 7f116db2d640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168121ff0 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.926+0000 7f115e7fc640 1 -- 172.21.15.5:0/2737960178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f11640059a0 con 0x7f116809d0e0 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.926+0000 7f115e7fc640 1 -- 172.21.15.5:0/2737960178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1164005b00 con 0x7f116809d0e0 2024-09-21T21:39:40.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.926+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1168123900 con 0x7f116809d0e0 2024-09-21T21:39:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.926+0000 7f115e7fc640 1 -- 172.21.15.5:0/2737960178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1164005da0 con 0x7f116809d0e0 2024-09-21T21:39:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.926+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1168121700 con 0x7f116809d0e0 2024-09-21T21:39:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.927+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f116809c9d0 con 0x7f116809d0e0 2024-09-21T21:39:40.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.927+0000 7f115e7fc640 1 -- 172.21.15.5:0/2737960178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f11640070b0 con 0x7f116809d0e0 2024-09-21T21:39:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.927+0000 7f115e7fc640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f114c03ead0 0x7f114c040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.927+0000 7f115e7fc640 1 -- 172.21.15.5:0/2737960178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7f116404fb60 con 0x7f116809d0e0 2024-09-21T21:39:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.928+0000 7f116d32c640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f114c03ead0 0x7f114c040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:40.931 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.928+0000 7f116d32c640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f114c03ead0 0x7f114c040fe0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:40.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:40.933+0000 7f115e7fc640 1 -- 172.21.15.5:0/2737960178 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f116400dc10 con 0x7f116809d0e0 2024-09-21T21:39:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.123+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f116806a8d0 con 0x7f116809d0e0 2024-09-21T21:39:41.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.124+0000 7f115e7fc640 1 -- 172.21.15.5:0/2737960178 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v724) ==== 74+0+11257 (crc 0 0 0) 0x7f116400d610 con 0x7f116809d0e0 2024-09-21T21:39:41.127 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:39:41.127 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":724,"fsid":"ad0a953a-14f9-495f-aee8-909b91df1365","created":"2024-09-21T21:20:15.771330+0000","modified":"2024-09-21T21:39:39.080369+0000","last_up_change":"2024-09-21T21:20:24.128887+0000","last_in_change":"2024-09-21T21:20:17.888469+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":200,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T21:20:25.091063+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-21T21:20:26.074228+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-09-21T21:25:31.988402+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d775b7f-81e2-4b8c-9603-a1de80d82d23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6801","nonce":1340303177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":1340303177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6807","nonce":1340303177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":1340303177}]},"public_addr":"172.21.15.5:6801/1340303177","cluster_addr":"172.21.15.5:6800/1340303177","heartbeat_back_addr":"172.21.15.5:6807/1340303177","heartbeat_front_addr":"172.21.15.5:6806/1340303177","state":["exists","up"]},{"osd":1,"uuid":"bedebb15-7f73-41ce-8112-42af3e421377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":1102615197}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6803","nonce":1102615197}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6805","nonce":1102615197}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":1102615197}]},"public_addr":"172.21.15.5:6804/1102615197","cluster_addr":"172.21.15.5:6803/1102615197","heartbeat_back_addr":"172.21.15.5:6805/1102615197","heartbeat_front_addr":"172.21.15.5:6802/1102615197","state":["exists","up"]},{"osd":2,"uuid":"8dc8116d-5b9c-4ba3-8c5d-cf140b5f8fba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6803","nonce":877610312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":877610312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6815","nonce":877610312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":877610312}]},"public_addr":"172.21.15.148:6803/877610312","cluster_addr":"172.21.15.148:6804/877610312","heartbeat_back_addr":"172.21.15.148:6815/877610312","heartbeat_front_addr":"172.21.15.148:6816/877610312","state":["exists","up"]},{"osd":3,"uuid":"14b1cc33-c87a-4e37-b778-3005207ab080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":711,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6805","nonce":1161645252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":1161645252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1161645252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6809","nonce":1161645252}]},"public_addr":"172.21.15.148:6805/1161645252","cluster_addr":"172.21.15.148:6802/1161645252","heartbeat_back_addr":"172.21.15.148:6808/1161645252","heartbeat_front_addr":"172.21.15.148:6809/1161645252","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]},{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":9},{"begin":14,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":179,"snaps":[{"begin":1,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":182,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":2}]},{"pool":184,"snaps":[{"begin":3,"length":1}]},{"pool":187,"snaps":[{"begin":2,"length":2}]},{"pool":189,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f114c03ead0 msgr2=0x7f114c040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f114c03ead0 0x7f114c040fe0 crc :-1 s=READY pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 msgr2=0x7f1168121ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168121ff0 crc :-1 s=READY pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 shutdown_connections 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f114c03ead0 0x7f114c040fe0 unknown :-1 s=CLOSED pgs=3849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 --2- 172.21.15.5:0/2737960178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f116809d0e0 0x7f1168121ff0 unknown :-1 s=CLOSED pgs=12981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:41.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 >> 172.21.15.5:0/2737960178 conn(0x7f11680a42d0 msgr2=0x7f11680a0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:41.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 shutdown_connections 2024-09-21T21:39:41.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:41.126+0000 7f116fd91640 1 -- 172.21.15.5:0/2737960178 wait complete. 2024-09-21T21:39:42.141 INFO:tasks.ceph:Scrubbing osd.0 2024-09-21T21:39:42.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-21T21:39:42.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.260+0000 7f20a0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.272+0000 7f20a0afd640 1 Processor -- start 2024-09-21T21:39:42.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.272+0000 7f20a0afd640 1 -- start start 2024-09-21T21:39:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.274+0000 7f20a0afd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f209c09c9d0 0x7f209c09cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.274+0000 7f20a0afd640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c09ea10 con 0x7f209c09d320 2024-09-21T21:39:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.274+0000 7f20a0afd640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f209c09fe80 con 0x7f209c09c9d0 2024-09-21T21:39:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.274+0000 7f209a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f209c09c9d0 0x7f209c09cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.274+0000 7f209a59c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f209c09c9d0 0x7f209c09cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35928/0 (socket says 172.21.15.5:35928) 2024-09-21T21:39:42.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.274+0000 7f2093fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f209c09d320 0x7f209c135e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42390/0 (socket says 172.21.15.5:42390) 2024-09-21T21:39:42.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.274+0000 7f209a59c640 1 -- 172.21.15.5:0/1108426443 learned_addr learned my addr 172.21.15.5:0/1108426443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.275+0000 7f209a59c640 1 -- 172.21.15.5:0/1108426443 >> v1:172.21.15.5:6789/0 conn(0x7f209c09d320 legacy=0x7f209c135e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.275+0000 7f209a59c640 1 -- 172.21.15.5:0/1108426443 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c06fd80 con 0x7f209c09c9d0 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.275+0000 7f209a59c640 1 --2- 172.21.15.5:0/1108426443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c09cde0 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1633ef40fead845 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.275+0000 7f2099d9b640 1 -- 172.21.15.5:0/1108426443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f208c009e50 con 0x7f209c09c9d0 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.275+0000 7f2099d9b640 1 -- 172.21.15.5:0/1108426443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f208c00e230 con 0x7f209c09c9d0 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.275+0000 7f2099d9b640 1 -- 172.21.15.5:0/1108426443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f208c00e4d0 con 0x7f209c09c9d0 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 1 -- 172.21.15.5:0/1108426443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 msgr2=0x7f209c09cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 1 --2- 172.21.15.5:0/1108426443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c09cde0 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 1 -- 172.21.15.5:0/1108426443 shutdown_connections 2024-09-21T21:39:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 1 --2- 172.21.15.5:0/1108426443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c09cde0 unknown :-1 s=CLOSED pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 1 -- 172.21.15.5:0/1108426443 >> 172.21.15.5:0/1108426443 conn(0x7f209c0a5550 msgr2=0x7f209c0a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 1 -- 172.21.15.5:0/1108426443 shutdown_connections 2024-09-21T21:39:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 1 -- 172.21.15.5:0/1108426443 wait complete. 2024-09-21T21:39:42.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.276+0000 7f20a0afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.278+0000 7f20a0afd640 1 Processor -- start 2024-09-21T21:39:42.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.278+0000 7f20a0afd640 1 -- start start 2024-09-21T21:39:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f20a0afd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c1241e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f20a0afd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f209c123890 con 0x7f209c09c9d0 2024-09-21T21:39:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f209a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c1241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f209a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c1241e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35944/0 (socket says 172.21.15.5:35944) 2024-09-21T21:39:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f209a59c640 1 -- 172.21.15.5:0/651272483 learned_addr learned my addr 172.21.15.5:0/651272483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:42.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f209a59c640 1 -- 172.21.15.5:0/651272483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c123e20 con 0x7f209c09c9d0 2024-09-21T21:39:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f209a59c640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c1241e0 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f208c00ee30 con 0x7f209c09c9d0 2024-09-21T21:39:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.280+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f208c015420 con 0x7f209c09c9d0 2024-09-21T21:39:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.281+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c125380 con 0x7f209c09c9d0 2024-09-21T21:39:42.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.281+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f208c0156c0 con 0x7f209c09c9d0 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.281+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c127800 con 0x7f209c09c9d0 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.281+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f209c09e240 con 0x7f209c09c9d0 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.282+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f208c015870 con 0x7f209c09c9d0 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.282+0000 7f2092ffd640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f207c03ead0 0x7f207c040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.282+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7f208c051360 con 0x7f209c09c9d0 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.282+0000 7f2092ffd640 1 --2- 172.21.15.5:0/651272483 >> v2:172.21.15.5:6801/1340303177 conn(0x7f207c044c10 0x7f207c047100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.282+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 --> v2:172.21.15.5:6801/1340303177 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f207c047790 con 0x7f207c044c10 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.282+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7f208c053850 con 0x7f209c09c9d0 2024-09-21T21:39:42.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.282+0000 7f2093fff640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f207c03ead0 0x7f207c040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.283+0000 7f2093fff640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f207c03ead0 0x7f207c040fe0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.283+0000 7f209ad9d640 1 --2- 172.21.15.5:0/651272483 >> v2:172.21.15.5:6801/1340303177 conn(0x7f207c044c10 0x7f207c047100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:39:42.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.287+0000 7f209ad9d640 1 --2- 172.21.15.5:0/651272483 >> v2:172.21.15.5:6801/1340303177 conn(0x7f207c044c10 0x7f207c047100 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.288+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== osd.0 v2:172.21.15.5:6801/1340303177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f207c047790 con 0x7f207c044c10 2024-09-21T21:39:42.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.293+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 --> v2:172.21.15.5:6801/1340303177 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f209c09f310 con 0x7f207c044c10 2024-09-21T21:39:42.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.296+0000 7f2092ffd640 1 -- 172.21.15.5:0/651272483 <== osd.0 v2:172.21.15.5:6801/1340303177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f209400a820 con 0x7f207c044c10 2024-09-21T21:39:42.299 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-21T21:39:42.299 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "" 2024-09-21T21:39:42.299 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-21T21:39:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.296+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 >> v2:172.21.15.5:6801/1340303177 conn(0x7f207c044c10 msgr2=0x7f207c047100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.296+0000 7f20a0afd640 1 --2- 172.21.15.5:0/651272483 >> v2:172.21.15.5:6801/1340303177 conn(0x7f207c044c10 0x7f207c047100 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.296+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f207c03ead0 msgr2=0x7f207c040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.296+0000 7f20a0afd640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f207c03ead0 0x7f207c040fe0 crc :-1 s=READY pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.296+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 msgr2=0x7f209c1241e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c1241e0 crc :-1 s=READY pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 shutdown_connections 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 --2- 172.21.15.5:0/651272483 >> v2:172.21.15.5:6801/1340303177 conn(0x7f207c044c10 0x7f207c047100 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f207c03ead0 0x7f207c040fe0 unknown :-1 s=CLOSED pgs=3850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 --2- 172.21.15.5:0/651272483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f209c09c9d0 0x7f209c1241e0 unknown :-1 s=CLOSED pgs=12984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 >> 172.21.15.5:0/651272483 conn(0x7f209c0a5550 msgr2=0x7f209c0a1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 shutdown_connections 2024-09-21T21:39:42.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.297+0000 7f20a0afd640 1 -- 172.21.15.5:0/651272483 wait complete. 2024-09-21T21:39:42.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-21T21:39:42.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.416+0000 7f572b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.423+0000 7f572b591640 1 Processor -- start 2024-09-21T21:39:42.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.423+0000 7f572b591640 1 -- start start 2024-09-21T21:39:42.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.424+0000 7f572b591640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f572409fae0 0x7f572406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.424+0000 7f572b591640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f572409f390 con 0x7f572406eff0 2024-09-21T21:39:42.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.424+0000 7f572b591640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f57240a03a0 con 0x7f572409fae0 2024-09-21T21:39:42.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f572932d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f572409fae0 0x7f572406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f572932d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f572409fae0 0x7f572406eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35954/0 (socket says 172.21.15.5:35954) 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f5728b2c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f572406eff0 0x7f5724135e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42406/0 (socket says 172.21.15.5:42406) 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f572932d640 1 -- 172.21.15.5:0/3303685405 learned_addr learned my addr 172.21.15.5:0/3303685405 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f572932d640 1 -- 172.21.15.5:0/3303685405 >> v1:172.21.15.5:6789/0 conn(0x7f572406eff0 legacy=0x7f5724135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f572932d640 1 -- 172.21.15.5:0/3303685405 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57240a0090 con 0x7f572409fae0 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f572932d640 1 --2- 172.21.15.5:0/3303685405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409fae0 0x7f572406eab0 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef72e60902f0e15a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f571bfff640 1 -- 172.21.15.5:0/3303685405 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5720009e50 con 0x7f572409fae0 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f571bfff640 1 -- 172.21.15.5:0/3303685405 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f572000e230 con 0x7f572409fae0 2024-09-21T21:39:42.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.425+0000 7f571bfff640 1 -- 172.21.15.5:0/3303685405 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f572000e4d0 con 0x7f572409fae0 2024-09-21T21:39:42.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 1 -- 172.21.15.5:0/3303685405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409fae0 msgr2=0x7f572406eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 1 --2- 172.21.15.5:0/3303685405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409fae0 0x7f572406eab0 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 1 -- 172.21.15.5:0/3303685405 shutdown_connections 2024-09-21T21:39:42.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 1 --2- 172.21.15.5:0/3303685405 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572409fae0 0x7f572406eab0 unknown :-1 s=CLOSED pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 1 -- 172.21.15.5:0/3303685405 >> 172.21.15.5:0/3303685405 conn(0x7f57240a76f0 msgr2=0x7f57240a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:42.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 1 -- 172.21.15.5:0/3303685405 shutdown_connections 2024-09-21T21:39:42.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 1 -- 172.21.15.5:0/3303685405 wait complete. 2024-09-21T21:39:42.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.426+0000 7f572b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.428+0000 7f572b591640 1 Processor -- start 2024-09-21T21:39:42.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.428+0000 7f572b591640 1 -- start start 2024-09-21T21:39:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572b591640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572406eff0 0x7f5724123ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572b591640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5724125530 con 0x7f572406eff0 2024-09-21T21:39:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572932d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572406eff0 0x7f5724123ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572932d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572406eff0 0x7f5724123ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35966/0 (socket says 172.21.15.5:35966) 2024-09-21T21:39:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572932d640 1 -- 172.21.15.5:0/3407662673 learned_addr learned my addr 172.21.15.5:0/3407662673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572932d640 1 -- 172.21.15.5:0/3407662673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5724124cf0 con 0x7f572406eff0 2024-09-21T21:39:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572932d640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572406eff0 0x7f5724123ab0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f5719ffb640 1 -- 172.21.15.5:0/3407662673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f572000edd0 con 0x7f572406eff0 2024-09-21T21:39:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f5719ffb640 1 -- 172.21.15.5:0/3407662673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5720015420 con 0x7f572406eff0 2024-09-21T21:39:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5724125de0 con 0x7f572406eff0 2024-09-21T21:39:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.430+0000 7f5719ffb640 1 -- 172.21.15.5:0/3407662673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57200156c0 con 0x7f572406eff0 2024-09-21T21:39:42.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.431+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5724126560 con 0x7f572406eff0 2024-09-21T21:39:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.431+0000 7f5719ffb640 1 -- 172.21.15.5:0/3407662673 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f5720015870 con 0x7f572406eff0 2024-09-21T21:39:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.431+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5724127b90 con 0x7f572406eff0 2024-09-21T21:39:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.432+0000 7f5719ffb640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f570803eb20 0x7f5708041030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.432+0000 7f5719ffb640 1 -- 172.21.15.5:0/3407662673 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7f5720051450 con 0x7f572406eff0 2024-09-21T21:39:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.432+0000 7f5728b2c640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f570803eb20 0x7f5708041030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.432+0000 7f5728b2c640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f570803eb20 0x7f5708041030 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.437+0000 7f5719ffb640 1 -- 172.21.15.5:0/3407662673 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f5724127b90 con 0x7f572406eff0 2024-09-21T21:39:42.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.628+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5724124e80 con 0x7f570803eb20 2024-09-21T21:39:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.628+0000 7f5719ffb640 1 -- 172.21.15.5:0/3407662673 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f5714001270 con 0x7f570803eb20 2024-09-21T21:39:42.631 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-09-21T21:39:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f570803eb20 msgr2=0x7f5708041030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f570803eb20 0x7f5708041030 crc :-1 s=READY pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572406eff0 msgr2=0x7f5724123ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572406eff0 0x7f5724123ab0 crc :-1 s=READY pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 shutdown_connections 2024-09-21T21:39:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f570803eb20 0x7f5708041030 unknown :-1 s=CLOSED pgs=3851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 --2- 172.21.15.5:0/3407662673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f572406eff0 0x7f5724123ab0 unknown :-1 s=CLOSED pgs=12987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 >> 172.21.15.5:0/3407662673 conn(0x7f57240a76f0 msgr2=0x7f57241bbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 shutdown_connections 2024-09-21T21:39:42.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.631+0000 7f572b591640 1 -- 172.21.15.5:0/3407662673 wait complete. 2024-09-21T21:39:42.651 INFO:tasks.ceph:Scrubbing osd.1 2024-09-21T21:39:42.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-21T21:39:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.763+0000 7f362f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.773+0000 7f362f191640 1 Processor -- start 2024-09-21T21:39:42.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.773+0000 7f362f191640 1 -- start start 2024-09-21T21:39:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.774+0000 7f362f191640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f362809ecd0 0x7f362809c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f362f191640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362809fcf0 con 0x7f362809cf10 2024-09-21T21:39:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f362f191640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f362809e420 con 0x7f362809ecd0 2024-09-21T21:39:42.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f362cf2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f362809ecd0 0x7f362809c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f3627fff640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f362809cf10 0x7f3628135e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42412/0 (socket says 172.21.15.5:42412) 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f362cf2d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f362809ecd0 0x7f362809c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35970/0 (socket says 172.21.15.5:35970) 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f3627fff640 1 -- 172.21.15.5:0/4025697796 learned_addr learned my addr 172.21.15.5:0/4025697796 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f362cf2d640 1 -- 172.21.15.5:0/4025697796 >> v1:172.21.15.5:6789/0 conn(0x7f362809cf10 legacy=0x7f3628135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f362cf2d640 1 -- 172.21.15.5:0/4025697796 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362809f9e0 con 0x7f362809ecd0 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f36277fe640 1 -- 172.21.15.5:0/4025697796 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957036644 0 0) 0x7f362809fcf0 con 0x7f362809cf10 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f362cf2d640 1 --2- 172.21.15.5:0/4025697796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809ecd0 0x7f362809c9d0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad14f403c120907 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f36277fe640 1 -- 172.21.15.5:0/4025697796 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f361c009d90 con 0x7f362809ecd0 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f36277fe640 1 -- 172.21.15.5:0/4025697796 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f361c00e230 con 0x7f362809ecd0 2024-09-21T21:39:42.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.775+0000 7f36277fe640 1 -- 172.21.15.5:0/4025697796 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f361c00e4d0 con 0x7f362809ecd0 2024-09-21T21:39:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 1 -- 172.21.15.5:0/4025697796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809ecd0 msgr2=0x7f362809c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 1 --2- 172.21.15.5:0/4025697796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809ecd0 0x7f362809c9d0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 1 -- 172.21.15.5:0/4025697796 shutdown_connections 2024-09-21T21:39:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 1 --2- 172.21.15.5:0/4025697796 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809ecd0 0x7f362809c9d0 unknown :-1 s=CLOSED pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 1 -- 172.21.15.5:0/4025697796 >> 172.21.15.5:0/4025697796 conn(0x7f36280a5140 msgr2=0x7f36280a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:42.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 1 -- 172.21.15.5:0/4025697796 shutdown_connections 2024-09-21T21:39:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 1 -- 172.21.15.5:0/4025697796 wait complete. 2024-09-21T21:39:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.776+0000 7f362f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.778+0000 7f362f191640 1 Processor -- start 2024-09-21T21:39:42.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.778+0000 7f362f191640 1 -- start start 2024-09-21T21:39:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f362f191640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809cf10 0x7f36281239f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f362f191640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3628136d30 con 0x7f362809cf10 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f362cf2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809cf10 0x7f36281239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f362cf2d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809cf10 0x7f36281239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35980/0 (socket says 172.21.15.5:35980) 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f362cf2d640 1 -- 172.21.15.5:0/2398159394 learned_addr learned my addr 172.21.15.5:0/2398159394 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f362cf2d640 1 -- 172.21.15.5:0/2398159394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3628125470 con 0x7f362809cf10 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f362cf2d640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809cf10 0x7f36281239f0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f361c014620 con 0x7f362809cf10 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.780+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f361c014780 con 0x7f362809cf10 2024-09-21T21:39:42.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.781+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3628124c30 con 0x7f362809cf10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.781+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f361c014a20 con 0x7f362809cf10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.781+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3628126300 con 0x7f362809cf10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.781+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f362806c360 con 0x7f362809cf10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.782+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f361c014bd0 con 0x7f362809cf10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.782+0000 7f36257fa640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f360c03ead0 0x7f360c040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.782+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7f361c019040 con 0x7f362809cf10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.782+0000 7f36257fa640 1 --2- 172.21.15.5:0/2398159394 >> v2:172.21.15.5:6804/1102615197 conn(0x7f360c044c10 0x7f360c047100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.782+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 --> v2:172.21.15.5:6804/1102615197 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f360c047790 con 0x7f360c044c10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.782+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7f361c0538a0 con 0x7f362809cf10 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.782+0000 7f3627fff640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f360c03ead0 0x7f360c040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.783+0000 7f3627fff640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f360c03ead0 0x7f360c040fe0 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.783+0000 7f362d72e640 1 --2- 172.21.15.5:0/2398159394 >> v2:172.21.15.5:6804/1102615197 conn(0x7f360c044c10 0x7f360c047100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:39:42.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.787+0000 7f362d72e640 1 --2- 172.21.15.5:0/2398159394 >> v2:172.21.15.5:6804/1102615197 conn(0x7f360c044c10 0x7f360c047100 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.788+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== osd.1 v2:172.21.15.5:6804/1102615197 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f360c047790 con 0x7f360c044c10 2024-09-21T21:39:42.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.792+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 --> v2:172.21.15.5:6804/1102615197 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f36280a5ec0 con 0x7f360c044c10 2024-09-21T21:39:42.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.793+0000 7f36257fa640 1 -- 172.21.15.5:0/2398159394 <== osd.1 v2:172.21.15.5:6804/1102615197 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f362000a820 con 0x7f360c044c10 2024-09-21T21:39:42.796 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-21T21:39:42.796 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "" 2024-09-21T21:39:42.797 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-21T21:39:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.793+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 >> v2:172.21.15.5:6804/1102615197 conn(0x7f360c044c10 msgr2=0x7f360c047100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.793+0000 7f362f191640 1 --2- 172.21.15.5:0/2398159394 >> v2:172.21.15.5:6804/1102615197 conn(0x7f360c044c10 0x7f360c047100 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f360c03ead0 msgr2=0x7f360c040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f360c03ead0 0x7f360c040fe0 crc :-1 s=READY pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809cf10 msgr2=0x7f36281239f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809cf10 0x7f36281239f0 crc :-1 s=READY pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 shutdown_connections 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 --2- 172.21.15.5:0/2398159394 >> v2:172.21.15.5:6804/1102615197 conn(0x7f360c044c10 0x7f360c047100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f360c03ead0 0x7f360c040fe0 unknown :-1 s=CLOSED pgs=3852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 --2- 172.21.15.5:0/2398159394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f362809cf10 0x7f36281239f0 unknown :-1 s=CLOSED pgs=12990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 >> 172.21.15.5:0/2398159394 conn(0x7f36280a5140 msgr2=0x7f36281bbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 shutdown_connections 2024-09-21T21:39:42.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.794+0000 7f362f191640 1 -- 172.21.15.5:0/2398159394 wait complete. 2024-09-21T21:39:42.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-21T21:39:42.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.915+0000 7fe23cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.922+0000 7fe23cd91640 1 Processor -- start 2024-09-21T21:39:42.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.922+0000 7fe23cd91640 1 -- start start 2024-09-21T21:39:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.923+0000 7fe23cd91640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe23806f1c0 0x7fe23813b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.923+0000 7fe23cd91640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23809f390 con 0x7fe23809fae0 2024-09-21T21:39:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.923+0000 7fe23cd91640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe2380a03a0 con 0x7fe23806f1c0 2024-09-21T21:39:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.923+0000 7fe23659c640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe23809fae0 0x7fe23806eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42414/0 (socket says 172.21.15.5:42414) 2024-09-21T21:39:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe23659c640 1 -- 172.21.15.5:0/739429965 learned_addr learned my addr 172.21.15.5:0/739429965 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe235d9b640 1 --2- 172.21.15.5:0/739429965 >> v2:172.21.15.5:3300/0 conn(0x7fe23806f1c0 0x7fe23813b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe23559a640 1 -- 172.21.15.5:0/739429965 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235847331 0 0) 0x7fe23809f390 con 0x7fe23809fae0 2024-09-21T21:39:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe23559a640 1 -- 172.21.15.5:0/739429965 --> v1:172.21.15.5:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe220003580 con 0x7fe23809fae0 2024-09-21T21:39:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe235d9b640 1 -- 172.21.15.5:0/739429965 >> v1:172.21.15.5:6789/0 conn(0x7fe23809fae0 legacy=0x7fe23806eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe235d9b640 1 -- 172.21.15.5:0/739429965 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2380a0090 con 0x7fe23806f1c0 2024-09-21T21:39:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe235d9b640 1 --2- 172.21.15.5:0/739429965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe23813b250 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b9f50ba6292284 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe23559a640 1 -- 172.21.15.5:0/739429965 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe22c009d90 con 0x7fe23806f1c0 2024-09-21T21:39:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe23559a640 1 -- 172.21.15.5:0/739429965 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe22c00e230 con 0x7fe23806f1c0 2024-09-21T21:39:42.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.924+0000 7fe23559a640 1 -- 172.21.15.5:0/739429965 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe22c00e4d0 con 0x7fe23806f1c0 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 1 -- 172.21.15.5:0/739429965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 msgr2=0x7fe23813b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 1 --2- 172.21.15.5:0/739429965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe23813b250 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 1 -- 172.21.15.5:0/739429965 shutdown_connections 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 1 --2- 172.21.15.5:0/739429965 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe23813b250 unknown :-1 s=CLOSED pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 1 -- 172.21.15.5:0/739429965 >> 172.21.15.5:0/739429965 conn(0x7fe2380a76f0 msgr2=0x7fe2380a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 1 -- 172.21.15.5:0/739429965 shutdown_connections 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 1 -- 172.21.15.5:0/739429965 wait complete. 2024-09-21T21:39:42.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.925+0000 7fe23cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:42.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.927+0000 7fe23cd91640 1 Processor -- start 2024-09-21T21:39:42.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.927+0000 7fe23cd91640 1 -- start start 2024-09-21T21:39:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe23cd91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe238123940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe23cd91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe2381253c0 con 0x7fe23806f1c0 2024-09-21T21:39:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe23659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe238123940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe23659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe238123940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35998/0 (socket says 172.21.15.5:35998) 2024-09-21T21:39:42.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe23659c640 1 -- 172.21.15.5:0/834155498 learned_addr learned my addr 172.21.15.5:0/834155498 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:42.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe23659c640 1 -- 172.21.15.5:0/834155498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238124b80 con 0x7fe23806f1c0 2024-09-21T21:39:42.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe23659c640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe238123940 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe226ffd640 1 -- 172.21.15.5:0/834155498 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe228005a60 con 0x7fe23806f1c0 2024-09-21T21:39:42.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.929+0000 7fe226ffd640 1 -- 172.21.15.5:0/834155498 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe228005bc0 con 0x7fe23806f1c0 2024-09-21T21:39:42.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.930+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe238125c70 con 0x7fe23806f1c0 2024-09-21T21:39:42.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.930+0000 7fe226ffd640 1 -- 172.21.15.5:0/834155498 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe228005e60 con 0x7fe23806f1c0 2024-09-21T21:39:42.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.930+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2381263f0 con 0x7fe23806f1c0 2024-09-21T21:39:42.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.931+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe238127810 con 0x7fe23806f1c0 2024-09-21T21:39:42.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.931+0000 7fe226ffd640 1 -- 172.21.15.5:0/834155498 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fe22800c7f0 con 0x7fe23806f1c0 2024-09-21T21:39:42.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.931+0000 7fe226ffd640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe21803ead0 0x7fe218040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:42.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.931+0000 7fe226ffd640 1 -- 172.21.15.5:0/834155498 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7fe22804fb40 con 0x7fe23806f1c0 2024-09-21T21:39:42.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.932+0000 7fe235d9b640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe21803ead0 0x7fe218040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:42.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.932+0000 7fe235d9b640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe21803ead0 0x7fe218040fe0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:42.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:42.936+0000 7fe226ffd640 1 -- 172.21.15.5:0/834155498 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fe22800f230 con 0x7fe23806f1c0 2024-09-21T21:39:43.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.130+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe23806eab0 con 0x7fe21803ead0 2024-09-21T21:39:43.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.131+0000 7fe226ffd640 1 -- 172.21.15.5:0/834155498 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fe23806eab0 con 0x7fe21803ead0 2024-09-21T21:39:43.133 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-09-21T21:39:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe21803ead0 msgr2=0x7fe218040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe21803ead0 0x7fe218040fe0 crc :-1 s=READY pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 msgr2=0x7fe238123940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe238123940 crc :-1 s=READY pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 shutdown_connections 2024-09-21T21:39:43.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe21803ead0 0x7fe218040fe0 unknown :-1 s=CLOSED pgs=3853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 --2- 172.21.15.5:0/834155498 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe23806f1c0 0x7fe238123940 unknown :-1 s=CLOSED pgs=12993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 >> 172.21.15.5:0/834155498 conn(0x7fe2380a76f0 msgr2=0x7fe2381bbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 shutdown_connections 2024-09-21T21:39:43.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.133+0000 7fe23cd91640 1 -- 172.21.15.5:0/834155498 wait complete. 2024-09-21T21:39:43.160 INFO:tasks.ceph:Scrubbing osd.2 2024-09-21T21:39:43.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-21T21:39:43.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.268+0000 7f5e25791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.278+0000 7f5e25791640 1 Processor -- start 2024-09-21T21:39:43.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.278+0000 7f5e25791640 1 -- start start 2024-09-21T21:39:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e25791640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e2009e600 0x7f5e201384e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e25791640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2009ee80 con 0x7f5e2009dae0 2024-09-21T21:39:43.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e25791640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f5e200a0d30 con 0x7f5e2009e600 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e1e7fc640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f5e2009e600 0x7f5e201384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e1effd640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7f5e2009dae0 0x7f5e2009def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42422/0 (socket says 172.21.15.5:42422) 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e1effd640 1 -- 172.21.15.5:0/624370018 learned_addr learned my addr 172.21.15.5:0/624370018 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e1e7fc640 1 -- 172.21.15.5:0/624370018 >> v1:172.21.15.5:6789/0 conn(0x7f5e2009dae0 legacy=0x7f5e2009def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.280+0000 7f5e1e7fc640 1 -- 172.21.15.5:0/624370018 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e200a12e0 con 0x7f5e2009e600 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e1e7fc640 1 --2- 172.21.15.5:0/624370018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009e600 0x7f5e201384e0 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb48dd6bac9db86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e1dffb640 1 -- 172.21.15.5:0/624370018 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e14010570 con 0x7f5e2009e600 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e1dffb640 1 -- 172.21.15.5:0/624370018 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5e140106d0 con 0x7f5e2009e600 2024-09-21T21:39:43.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e1dffb640 1 -- 172.21.15.5:0/624370018 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e14010970 con 0x7f5e2009e600 2024-09-21T21:39:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e25791640 1 -- 172.21.15.5:0/624370018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009e600 msgr2=0x7f5e201384e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e25791640 1 --2- 172.21.15.5:0/624370018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009e600 0x7f5e201384e0 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e25791640 1 -- 172.21.15.5:0/624370018 shutdown_connections 2024-09-21T21:39:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.281+0000 7f5e25791640 1 --2- 172.21.15.5:0/624370018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009e600 0x7f5e201384e0 unknown :-1 s=CLOSED pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.282+0000 7f5e25791640 1 -- 172.21.15.5:0/624370018 >> 172.21.15.5:0/624370018 conn(0x7f5e200a19a0 msgr2=0x7f5e200a1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.282+0000 7f5e25791640 1 -- 172.21.15.5:0/624370018 shutdown_connections 2024-09-21T21:39:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.282+0000 7f5e25791640 1 -- 172.21.15.5:0/624370018 wait complete. 2024-09-21T21:39:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.282+0000 7f5e25791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.284+0000 7f5e25791640 1 Processor -- start 2024-09-21T21:39:43.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.284+0000 7f5e25791640 1 -- start start 2024-09-21T21:39:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.285+0000 7f5e25791640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009dae0 0x7f5e20121350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.285+0000 7f5e25791640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5e201210c0 con 0x7f5e2009dae0 2024-09-21T21:39:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.285+0000 7f5e1effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009dae0 0x7f5e20121350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.285+0000 7f5e1effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009dae0 0x7f5e20121350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36016/0 (socket says 172.21.15.5:36016) 2024-09-21T21:39:43.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.285+0000 7f5e1effd640 1 -- 172.21.15.5:0/661747422 learned_addr learned my addr 172.21.15.5:0/661747422 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.286+0000 7f5e1effd640 1 -- 172.21.15.5:0/661747422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e20120a80 con 0x7f5e2009dae0 2024-09-21T21:39:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.286+0000 7f5e1effd640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009dae0 0x7f5e20121350 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.286+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e10005a60 con 0x7f5e2009dae0 2024-09-21T21:39:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.286+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5e10005bc0 con 0x7f5e2009dae0 2024-09-21T21:39:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.286+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e20122500 con 0x7f5e2009dae0 2024-09-21T21:39:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.286+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5e10005e60 con 0x7f5e2009dae0 2024-09-21T21:39:43.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.286+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e20120d20 con 0x7f5e2009dae0 2024-09-21T21:39:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.287+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e20070730 con 0x7f5e2009dae0 2024-09-21T21:39:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.287+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f5e1000c7f0 con 0x7f5e2009dae0 2024-09-21T21:39:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.287+0000 7f5e077fe640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e0c03ead0 0x7f5e0c040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.287+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7f5e1004fb60 con 0x7f5e2009dae0 2024-09-21T21:39:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.287+0000 7f5e077fe640 1 --2- 172.21.15.5:0/661747422 >> v2:172.21.15.148:6803/877610312 conn(0x7f5e0c044c10 0x7f5e0c047100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.287+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 --> v2:172.21.15.148:6803/877610312 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e0c047790 con 0x7f5e0c044c10 2024-09-21T21:39:43.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.287+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7f5e1004ff70 con 0x7f5e2009dae0 2024-09-21T21:39:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.288+0000 7f5e1e7fc640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e0c03ead0 0x7f5e0c040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.288+0000 7f5e1e7fc640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e0c03ead0 0x7f5e0c040fe0 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.289+0000 7f5e1f7fe640 1 --2- 172.21.15.5:0/661747422 >> v2:172.21.15.148:6803/877610312 conn(0x7f5e0c044c10 0x7f5e0c047100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:39:43.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.294+0000 7f5e1f7fe640 1 --2- 172.21.15.5:0/661747422 >> v2:172.21.15.148:6803/877610312 conn(0x7f5e0c044c10 0x7f5e0c047100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.296+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== osd.2 v2:172.21.15.148:6803/877610312 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7f5e0c047790 con 0x7f5e0c044c10 2024-09-21T21:39:43.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.299+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 --> v2:172.21.15.148:6803/877610312 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5e2006ffc0 con 0x7f5e0c044c10 2024-09-21T21:39:43.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e077fe640 1 -- 172.21.15.5:0/661747422 <== osd.2 v2:172.21.15.148:6803/877610312 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f5e1800a820 con 0x7f5e0c044c10 2024-09-21T21:39:43.304 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-21T21:39:43.304 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "" 2024-09-21T21:39:43.304 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 >> v2:172.21.15.148:6803/877610312 conn(0x7f5e0c044c10 msgr2=0x7f5e0c047100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 --2- 172.21.15.5:0/661747422 >> v2:172.21.15.148:6803/877610312 conn(0x7f5e0c044c10 0x7f5e0c047100 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e0c03ead0 msgr2=0x7f5e0c040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e0c03ead0 0x7f5e0c040fe0 crc :-1 s=READY pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009dae0 msgr2=0x7f5e20121350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009dae0 0x7f5e20121350 crc :-1 s=READY pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 shutdown_connections 2024-09-21T21:39:43.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 --2- 172.21.15.5:0/661747422 >> v2:172.21.15.148:6803/877610312 conn(0x7f5e0c044c10 0x7f5e0c047100 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f5e0c03ead0 0x7f5e0c040fe0 unknown :-1 s=CLOSED pgs=3854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 --2- 172.21.15.5:0/661747422 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5e2009dae0 0x7f5e20121350 unknown :-1 s=CLOSED pgs=12996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 >> 172.21.15.5:0/661747422 conn(0x7f5e200a19a0 msgr2=0x7f5e200a28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 shutdown_connections 2024-09-21T21:39:43.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.301+0000 7f5e25791640 1 -- 172.21.15.5:0/661747422 wait complete. 2024-09-21T21:39:43.315 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-21T21:39:43.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.421+0000 7faea9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.427+0000 7faea9991640 1 Processor -- start 2024-09-21T21:39:43.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.427+0000 7faea9991640 1 -- start start 2024-09-21T21:39:43.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea9991640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faea40704e0 0x7faea4068d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea9991640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea4070990 con 0x7faea4069280 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea9991640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7faea4050fc0 con 0x7faea40704e0 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faea40704e0 0x7faea4068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea2ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7faea40704e0 0x7faea4068d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36030/0 (socket says 172.21.15.5:36030) 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea2ffd640 1 -- 172.21.15.5:0/3087265592 learned_addr learned my addr 172.21.15.5:0/3087265592 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea27fc640 1 --1- 172.21.15.5:0/3087265592 >> v1:172.21.15.5:6789/0 conn(0x7faea4069280 0x7faea41343e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42432/0 (socket says 172.21.15.5:42432) 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea2ffd640 1 -- 172.21.15.5:0/3087265592 >> v1:172.21.15.5:6789/0 conn(0x7faea4069280 legacy=0x7faea41343e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea2ffd640 1 -- 172.21.15.5:0/3087265592 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea406c740 con 0x7faea40704e0 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.429+0000 7faea1ffb640 1 -- 172.21.15.5:0/3087265592 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077585251 0 0) 0x7faea4070990 con 0x7faea4069280 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea2ffd640 1 --2- 172.21.15.5:0/3087265592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea40704e0 0x7faea4068d40 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69359ef4d9d947b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea1ffb640 1 -- 172.21.15.5:0/3087265592 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae94009e50 con 0x7faea40704e0 2024-09-21T21:39:43.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea1ffb640 1 -- 172.21.15.5:0/3087265592 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fae9400e230 con 0x7faea40704e0 2024-09-21T21:39:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea1ffb640 1 -- 172.21.15.5:0/3087265592 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae9400e4d0 con 0x7faea40704e0 2024-09-21T21:39:43.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea9991640 1 -- 172.21.15.5:0/3087265592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea40704e0 msgr2=0x7faea4068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea9991640 1 --2- 172.21.15.5:0/3087265592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea40704e0 0x7faea4068d40 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea9991640 1 -- 172.21.15.5:0/3087265592 shutdown_connections 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea9991640 1 --2- 172.21.15.5:0/3087265592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea40704e0 0x7faea4068d40 unknown :-1 s=CLOSED pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.430+0000 7faea9991640 1 -- 172.21.15.5:0/3087265592 >> 172.21.15.5:0/3087265592 conn(0x7faea40a3520 msgr2=0x7faea40a3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.431+0000 7faea9991640 1 -- 172.21.15.5:0/3087265592 shutdown_connections 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.431+0000 7faea9991640 1 -- 172.21.15.5:0/3087265592 wait complete. 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.431+0000 7faea9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.432+0000 7faea9991640 1 Processor -- start 2024-09-21T21:39:43.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.433+0000 7faea9991640 1 -- start start 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.434+0000 7faea9991640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4069280 0x7faea4130250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.434+0000 7faea9991640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faea4132d40 con 0x7faea4069280 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.434+0000 7faea2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4069280 0x7faea4130250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.434+0000 7faea2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4069280 0x7faea4130250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36034/0 (socket says 172.21.15.5:36034) 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.434+0000 7faea2ffd640 1 -- 172.21.15.5:0/547854958 learned_addr learned my addr 172.21.15.5:0/547854958 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.435+0000 7faea2ffd640 1 -- 172.21.15.5:0/547854958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea40754a0 con 0x7faea4069280 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.435+0000 7faea2ffd640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4069280 0x7faea4130250 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.435+0000 7fae8bfff640 1 -- 172.21.15.5:0/547854958 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae9400ee50 con 0x7faea4069280 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.435+0000 7fae8bfff640 1 -- 172.21.15.5:0/547854958 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fae94015420 con 0x7faea4069280 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.435+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea41313e0 con 0x7faea4069280 2024-09-21T21:39:43.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.435+0000 7fae8bfff640 1 -- 172.21.15.5:0/547854958 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fae940156c0 con 0x7faea4069280 2024-09-21T21:39:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.435+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea4132a70 con 0x7faea4069280 2024-09-21T21:39:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.436+0000 7fae8bfff640 1 -- 172.21.15.5:0/547854958 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fae94015870 con 0x7faea4069280 2024-09-21T21:39:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.436+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea406a4b0 con 0x7faea4069280 2024-09-21T21:39:43.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.436+0000 7fae8bfff640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fae9003eb00 0x7fae90041010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.436+0000 7fae8bfff640 1 -- 172.21.15.5:0/547854958 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7fae940510d0 con 0x7faea4069280 2024-09-21T21:39:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.437+0000 7faea27fc640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fae9003eb00 0x7fae90041010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.437+0000 7faea27fc640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fae9003eb00 0x7fae90041010 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.442+0000 7fae8bfff640 1 -- 172.21.15.5:0/547854958 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fae9400f2a0 con 0x7faea4069280 2024-09-21T21:39:43.634 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.631+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7faea41340a0 con 0x7fae9003eb00 2024-09-21T21:39:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.632+0000 7fae8bfff640 1 -- 172.21.15.5:0/547854958 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fae980070b0 con 0x7fae9003eb00 2024-09-21T21:39:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fae9003eb00 msgr2=0x7fae90041010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fae9003eb00 0x7fae90041010 crc :-1 s=READY pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4069280 msgr2=0x7faea4130250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4069280 0x7faea4130250 crc :-1 s=READY pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 shutdown_connections 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fae9003eb00 0x7fae90041010 unknown :-1 s=CLOSED pgs=3855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 --2- 172.21.15.5:0/547854958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faea4069280 0x7faea4130250 unknown :-1 s=CLOSED pgs=12999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 >> 172.21.15.5:0/547854958 conn(0x7faea40a3520 msgr2=0x7faea4073200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 shutdown_connections 2024-09-21T21:39:43.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.635+0000 7faea9991640 1 -- 172.21.15.5:0/547854958 wait complete. 2024-09-21T21:39:43.651 INFO:tasks.ceph:Scrubbing osd.3 2024-09-21T21:39:43.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-21T21:39:43.769 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.758+0000 7fcf1c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.770 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.768+0000 7fcf1c991640 1 Processor -- start 2024-09-21T21:39:43.771 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.768+0000 7fcf1c991640 1 -- start start 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.769+0000 7fcf1c991640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf180a2920 0x7fcf1809d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.769+0000 7fcf1c991640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf1809fef0 con 0x7fcf1809dd00 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.769+0000 7fcf1c991640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fcf180a2340 con 0x7fcf180a2920 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf1659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf180a2920 0x7fcf1809d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf1659c640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fcf180a2920 0x7fcf1809d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36046/0 (socket says 172.21.15.5:36046) 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf0dd9b640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fcf1809dd00 0x7fcf18132a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42442/0 (socket says 172.21.15.5:42442) 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf1659c640 1 -- 172.21.15.5:0/313603719 learned_addr learned my addr 172.21.15.5:0/313603719 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:43.773 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf1659c640 1 -- 172.21.15.5:0/313603719 >> v1:172.21.15.5:6789/0 conn(0x7fcf1809dd00 legacy=0x7fcf18132a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf15d9b640 1 -- 172.21.15.5:0/313603719 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444811637 0 0) 0x7fcf1809fef0 con 0x7fcf1809dd00 2024-09-21T21:39:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf1659c640 1 -- 172.21.15.5:0/313603719 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf1809fae0 con 0x7fcf180a2920 2024-09-21T21:39:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf1659c640 1 --2- 172.21.15.5:0/313603719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf180a2920 0x7fcf1809d7c0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d025027d1cb943 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf15d9b640 1 -- 172.21.15.5:0/313603719 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf08009e50 con 0x7fcf180a2920 2024-09-21T21:39:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf15d9b640 1 -- 172.21.15.5:0/313603719 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcf0800e230 con 0x7fcf180a2920 2024-09-21T21:39:43.774 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.770+0000 7fcf15d9b640 1 -- 172.21.15.5:0/313603719 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf0800e4d0 con 0x7fcf180a2920 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 1 -- 172.21.15.5:0/313603719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf180a2920 msgr2=0x7fcf1809d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 1 --2- 172.21.15.5:0/313603719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf180a2920 0x7fcf1809d7c0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 1 -- 172.21.15.5:0/313603719 shutdown_connections 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 1 --2- 172.21.15.5:0/313603719 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf180a2920 0x7fcf1809d7c0 unknown :-1 s=CLOSED pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 1 -- 172.21.15.5:0/313603719 >> 172.21.15.5:0/313603719 conn(0x7fcf180a3160 msgr2=0x7fcf180a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 1 -- 172.21.15.5:0/313603719 shutdown_connections 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 1 -- 172.21.15.5:0/313603719 wait complete. 2024-09-21T21:39:43.775 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.771+0000 7fcf1c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.773+0000 7fcf1c991640 1 Processor -- start 2024-09-21T21:39:43.776 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.773+0000 7fcf1c991640 1 -- start start 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.775+0000 7fcf1c991640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1809dd00 0x7fcf18123bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.775+0000 7fcf1c991640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcf18123270 con 0x7fcf1809dd00 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.775+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1809dd00 0x7fcf18123bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.775+0000 7fcf1659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1809dd00 0x7fcf18123bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36054/0 (socket says 172.21.15.5:36054) 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.775+0000 7fcf1659c640 1 -- 172.21.15.5:0/3442252504 learned_addr learned my addr 172.21.15.5:0/3442252504 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.775+0000 7fcf1659c640 1 -- 172.21.15.5:0/3442252504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf18123800 con 0x7fcf1809dd00 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.775+0000 7fcf1659c640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1809dd00 0x7fcf18123bc0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.776+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf0800ee50 con 0x7fcf1809dd00 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.776+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fcf08015420 con 0x7fcf1809dd00 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.776+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf18124cf0 con 0x7fcf1809dd00 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.776+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fcf080156c0 con 0x7fcf1809dd00 2024-09-21T21:39:43.779 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.776+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf181255a0 con 0x7fcf1809dd00 2024-09-21T21:39:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.777+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf18123600 con 0x7fcf1809dd00 2024-09-21T21:39:43.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.777+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fcf08015870 con 0x7fcf1809dd00 2024-09-21T21:39:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.777+0000 7fcf0f7fe640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcef803ead0 0x7fcef8040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.777+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7fcf080510d0 con 0x7fcf1809dd00 2024-09-21T21:39:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.777+0000 7fcf0f7fe640 1 --2- 172.21.15.5:0/3442252504 >> v2:172.21.15.148:6805/1161645252 conn(0x7fcef8044c10 0x7fcef8047100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.777+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 --> v2:172.21.15.148:6805/1161645252 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcef8047790 con 0x7fcef8044c10 2024-09-21T21:39:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.777+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=724) ==== 24+0+0 (crc 0 0 0) 0x7fcf080535c0 con 0x7fcf1809dd00 2024-09-21T21:39:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.778+0000 7fcf0dd9b640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcef803ead0 0x7fcef8040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.778+0000 7fcf0dd9b640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcef803ead0 0x7fcef8040fe0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.778+0000 7fcf16d9d640 1 --2- 172.21.15.5:0/3442252504 >> v2:172.21.15.148:6805/1161645252 conn(0x7fcef8044c10 0x7fcef8047100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-09-21T21:39:43.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.784+0000 7fcf16d9d640 1 --2- 172.21.15.5:0/3442252504 >> v2:172.21.15.148:6805/1161645252 conn(0x7fcef8044c10 0x7fcef8047100 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.786+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== osd.3 v2:172.21.15.148:6805/1161645252 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5790 (crc 0 0 0) 0x7fcef8047790 con 0x7fcef8044c10 2024-09-21T21:39:43.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.788+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 --> v2:172.21.15.148:6805/1161645252 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcf1809ef90 con 0x7fcef8044c10 2024-09-21T21:39:43.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf0f7fe640 1 -- 172.21.15.5:0/3442252504 <== osd.3 v2:172.21.15.148:6805/1161645252 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7fcf1000a820 con 0x7fcef8044c10 2024-09-21T21:39:43.793 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-21T21:39:43.793 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "" 2024-09-21T21:39:43.793 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-21T21:39:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 >> v2:172.21.15.148:6805/1161645252 conn(0x7fcef8044c10 msgr2=0x7fcef8047100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 --2- 172.21.15.5:0/3442252504 >> v2:172.21.15.148:6805/1161645252 conn(0x7fcef8044c10 0x7fcef8047100 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcef803ead0 msgr2=0x7fcef8040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcef803ead0 0x7fcef8040fe0 crc :-1 s=READY pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1809dd00 msgr2=0x7fcf18123bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1809dd00 0x7fcf18123bc0 crc :-1 s=READY pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 shutdown_connections 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 --2- 172.21.15.5:0/3442252504 >> v2:172.21.15.148:6805/1161645252 conn(0x7fcef8044c10 0x7fcef8047100 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fcef803ead0 0x7fcef8040fe0 unknown :-1 s=CLOSED pgs=3856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 --2- 172.21.15.5:0/3442252504 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcf1809dd00 0x7fcf18123bc0 unknown :-1 s=CLOSED pgs=13002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.790+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 >> 172.21.15.5:0/3442252504 conn(0x7fcf180a3160 msgr2=0x7fcf1811c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.791+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 shutdown_connections 2024-09-21T21:39:43.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.791+0000 7fcf1c991640 1 -- 172.21.15.5:0/3442252504 wait complete. 2024-09-21T21:39:43.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-21T21:39:43.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.911+0000 7fd3a76a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.917+0000 7fd3a76a3640 1 Processor -- start 2024-09-21T21:39:43.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.917+0000 7fd3a76a3640 1 -- start start 2024-09-21T21:39:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a76a3640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fd3a009d0e0 0x7fd3a0138fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a76a3640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a009e2e0 con 0x7fd3a009da50 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a76a3640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a0073d20 con 0x7fd3a009d0e0 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a543f640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fd3a009da50 0x7fd3a009c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42454/0 (socket says 172.21.15.5:42454) 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a543f640 1 -- 172.21.15.5:0/927070855 learned_addr learned my addr 172.21.15.5:0/927070855 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a4c3e640 1 --2- 172.21.15.5:0/927070855 >> v2:172.21.15.5:3300/0 conn(0x7fd3a009d0e0 0x7fd3a0138fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a4c3e640 1 -- 172.21.15.5:0/927070855 >> v1:172.21.15.5:6789/0 conn(0x7fd3a009da50 legacy=0x7fd3a009c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd397fff640 1 -- 172.21.15.5:0/927070855 <== mon.0 v1:172.21.15.5:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397137828 0 0) 0x7fd3a009e2e0 con 0x7fd3a009da50 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.919+0000 7fd3a4c3e640 1 -- 172.21.15.5:0/927070855 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a009ee80 con 0x7fd3a009d0e0 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.920+0000 7fd3a4c3e640 1 --2- 172.21.15.5:0/927070855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0138fe0 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e97ddb86e5ddea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.920+0000 7fd397fff640 1 -- 172.21.15.5:0/927070855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd390009d90 con 0x7fd3a009d0e0 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.920+0000 7fd397fff640 1 -- 172.21.15.5:0/927070855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd39000e230 con 0x7fd3a009d0e0 2024-09-21T21:39:43.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.920+0000 7fd397fff640 1 -- 172.21.15.5:0/927070855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd39000e4d0 con 0x7fd3a009d0e0 2024-09-21T21:39:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.920+0000 7fd3a76a3640 1 -- 172.21.15.5:0/927070855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 msgr2=0x7fd3a0138fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.920+0000 7fd3a76a3640 1 --2- 172.21.15.5:0/927070855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0138fe0 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.921+0000 7fd3a76a3640 1 -- 172.21.15.5:0/927070855 shutdown_connections 2024-09-21T21:39:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.921+0000 7fd3a76a3640 1 --2- 172.21.15.5:0/927070855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0138fe0 unknown :-1 s=CLOSED pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.921+0000 7fd3a76a3640 1 -- 172.21.15.5:0/927070855 >> 172.21.15.5:0/927070855 conn(0x7fd3a00a42d0 msgr2=0x7fd3a0073440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:43.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.921+0000 7fd3a76a3640 1 -- 172.21.15.5:0/927070855 shutdown_connections 2024-09-21T21:39:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.921+0000 7fd3a76a3640 1 -- 172.21.15.5:0/927070855 wait complete. 2024-09-21T21:39:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.921+0000 7fd3a76a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.923+0000 7fd3a76a3640 1 Processor -- start 2024-09-21T21:39:43.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.923+0000 7fd3a76a3640 1 -- start start 2024-09-21T21:39:43.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.924+0000 7fd3a76a3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0121ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.924+0000 7fd3a76a3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a0121510 con 0x7fd3a009d0e0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.924+0000 7fd3a543f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0121ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.924+0000 7fd3a543f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0121ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36060/0 (socket says 172.21.15.5:36060) 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.924+0000 7fd3a543f640 1 -- 172.21.15.5:0/3293910727 learned_addr learned my addr 172.21.15.5:0/3293910727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.925+0000 7fd3a543f640 1 -- 172.21.15.5:0/3293910727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a0121aa0 con 0x7fd3a009d0e0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.925+0000 7fd3a543f640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0121ff0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.925+0000 7fd395ffb640 1 -- 172.21.15.5:0/3293910727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd39c005a60 con 0x7fd3a009d0e0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.925+0000 7fd395ffb640 1 -- 172.21.15.5:0/3293910727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd39c005bc0 con 0x7fd3a009d0e0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.925+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a0123900 con 0x7fd3a009d0e0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.925+0000 7fd395ffb640 1 -- 172.21.15.5:0/3293910727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd39c005e60 con 0x7fd3a009d0e0 2024-09-21T21:39:43.928 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.925+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a0121700 con 0x7fd3a009d0e0 2024-09-21T21:39:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.926+0000 7fd395ffb640 1 -- 172.21.15.5:0/3293910727 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fd39c0070b0 con 0x7fd3a009d0e0 2024-09-21T21:39:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.926+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a009c9d0 con 0x7fd3a009d0e0 2024-09-21T21:39:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.926+0000 7fd395ffb640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd38403ead0 0x7fd384040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:43.929 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.926+0000 7fd395ffb640 1 -- 172.21.15.5:0/3293910727 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7fd39c04fb50 con 0x7fd3a009d0e0 2024-09-21T21:39:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.927+0000 7fd3a4c3e640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd38403ead0 0x7fd384040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:43.930 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.927+0000 7fd3a4c3e640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd38403ead0 0x7fd384040fe0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:43.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:43.932+0000 7fd395ffb640 1 -- 172.21.15.5:0/3293910727 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fd39c00dc60 con 0x7fd3a009d0e0 2024-09-21T21:39:44.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.123+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd3a009eac0 con 0x7fd38403ead0 2024-09-21T21:39:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.123+0000 7fd395ffb640 1 -- 172.21.15.5:0/3293910727 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fd39000e3a0 con 0x7fd38403ead0 2024-09-21T21:39:44.126 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-09-21T21:39:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd38403ead0 msgr2=0x7fd384040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd38403ead0 0x7fd384040fe0 crc :-1 s=READY pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 msgr2=0x7fd3a0121ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0121ff0 crc :-1 s=READY pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 shutdown_connections 2024-09-21T21:39:44.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fd38403ead0 0x7fd384040fe0 unknown :-1 s=CLOSED pgs=3857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 --2- 172.21.15.5:0/3293910727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd3a009d0e0 0x7fd3a0121ff0 unknown :-1 s=CLOSED pgs=13005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 >> 172.21.15.5:0/3293910727 conn(0x7fd3a00a42d0 msgr2=0x7fd3a00a0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 shutdown_connections 2024-09-21T21:39:44.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.126+0000 7fd3a76a3640 1 -- 172.21.15.5:0/3293910727 wait complete. 2024-09-21T21:39:44.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T21:39:44.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.249+0000 7fe8dde74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.255+0000 7fe8dde74640 1 Processor -- start 2024-09-21T21:39:44.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.255+0000 7fe8dde74640 1 -- start start 2024-09-21T21:39:44.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8d806f1c0 0x7fe8d813b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d809f390 con 0x7fe8d809fae0 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d80a03a0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8d806f1c0 0x7fe8d813b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d77fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fe8d809fae0 0x7fe8d806eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:42456/0 (socket says 172.21.15.5:42456) 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d6ffd640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fe8d806f1c0 0x7fe8d813b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36062/0 (socket says 172.21.15.5:36062) 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d77fe640 1 -- 172.21.15.5:0/265206777 learned_addr learned my addr 172.21.15.5:0/265206777 (peer_addr_for_me v1:172.21.15.5:0/0) 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d6ffd640 1 -- 172.21.15.5:0/265206777 >> v1:172.21.15.5:6789/0 conn(0x7fe8d809fae0 legacy=0x7fe8d806eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d6ffd640 1 -- 172.21.15.5:0/265206777 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d80a0090 con 0x7fe8d806f1c0 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d6ffd640 1 --2- 172.21.15.5:0/265206777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d813b250 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae5c910dc523c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d67fc640 1 -- 172.21.15.5:0/265206777 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8cc009d90 con 0x7fe8d806f1c0 2024-09-21T21:39:44.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d67fc640 1 -- 172.21.15.5:0/265206777 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe8cc00e230 con 0x7fe8d806f1c0 2024-09-21T21:39:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8d67fc640 1 -- 172.21.15.5:0/265206777 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8cc00e4d0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 -- 172.21.15.5:0/265206777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 msgr2=0x7fe8d813b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:44.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 --2- 172.21.15.5:0/265206777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d813b250 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 -- 172.21.15.5:0/265206777 shutdown_connections 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 --2- 172.21.15.5:0/265206777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d813b250 unknown :-1 s=CLOSED pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 -- 172.21.15.5:0/265206777 >> 172.21.15.5:0/265206777 conn(0x7fe8d80a76f0 msgr2=0x7fe8d80a7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 -- 172.21.15.5:0/265206777 shutdown_connections 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.257+0000 7fe8dde74640 1 -- 172.21.15.5:0/265206777 wait complete. 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.258+0000 7fe8dde74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.259+0000 7fe8dde74640 1 Processor -- start 2024-09-21T21:39:44.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.260+0000 7fe8dde74640 1 -- start start 2024-09-21T21:39:44.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.261+0000 7fe8dde74640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d81ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:44.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.261+0000 7fe8dde74640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d8125ca0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.261+0000 7fe8d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d81ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.261+0000 7fe8d77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d81ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36068/0 (socket says 172.21.15.5:36068) 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.261+0000 7fe8d77fe640 1 -- 172.21.15.5:0/2969848402 learned_addr learned my addr 172.21.15.5:0/2969848402 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.261+0000 7fe8d77fe640 1 -- 172.21.15.5:0/2969848402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d8125af0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.262+0000 7fe8d77fe640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d81ca7e0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.262+0000 7fe8bffff640 1 -- 172.21.15.5:0/2969848402 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8c8005a60 con 0x7fe8d806f1c0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.262+0000 7fe8bffff640 1 -- 172.21.15.5:0/2969848402 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe8c8005bc0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.262+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d8123840 con 0x7fe8d806f1c0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.262+0000 7fe8bffff640 1 -- 172.21.15.5:0/2969848402 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe8c8005e60 con 0x7fe8d806f1c0 2024-09-21T21:39:44.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.262+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d8127390 con 0x7fe8d806f1c0 2024-09-21T21:39:44.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.263+0000 7fe8bffff640 1 -- 172.21.15.5:0/2969848402 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fe8c80070b0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.263+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d806eab0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.264+0000 7fe8bffff640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe8c403ead0 0x7fe8c4040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:39:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.264+0000 7fe8bffff640 1 -- 172.21.15.5:0/2969848402 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7fe8c804fbf0 con 0x7fe8d806f1c0 2024-09-21T21:39:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.264+0000 7fe8d6ffd640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe8c403ead0 0x7fe8c4040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:39:44.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.265+0000 7fe8d6ffd640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe8c403ead0 0x7fe8c4040fe0 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:39:44.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.269+0000 7fe8bffff640 1 -- 172.21.15.5:0/2969848402 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fe8c800d840 con 0x7fe8d806f1c0 2024-09-21T21:39:44.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.454+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe8d81276d0 con 0x7fe8c403ead0 2024-09-21T21:39:44.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.457+0000 7fe8bffff640 1 -- 172.21.15.5:0/2969848402 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109225 (crc 0 0 0) 0x7fe8cc009db0 con 0x7fe8c403ead0 2024-09-21T21:39:44.460 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:39:44.461 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-21T21:39:44.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe8c403ead0 msgr2=0x7fe8c4040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:44.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe8c403ead0 0x7fe8c4040fe0 crc :-1 s=READY pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 msgr2=0x7fe8d81ca7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:39:44.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d81ca7e0 crc :-1 s=READY pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 shutdown_connections 2024-09-21T21:39:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fe8c403ead0 0x7fe8c4040fe0 unknown :-1 s=CLOSED pgs=3858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 --2- 172.21.15.5:0/2969848402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8d806f1c0 0x7fe8d81ca7e0 unknown :-1 s=CLOSED pgs=13008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:39:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 >> 172.21.15.5:0/2969848402 conn(0x7fe8d80a76f0 msgr2=0x7fe8d81bbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:39:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 shutdown_connections 2024-09-21T21:39:44.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:39:44.459+0000 7fe8dde74640 1 -- 172.21.15.5:0/2969848402 wait complete. 2024-09-21T21:39:44.473 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1297,"stamp":"2024-09-21T21:39:43.351921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":275808,"kb_used_data":26912,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377211552,"statfs":{"total":386547056640,"available":386264629248,"internally_reserved":0,"allocated":27557888,"data_stored":12610310,"data_compressed":154182,"data_compressed_allocated":212992,"data_compressed_original":1343488,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-321875,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002345"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.148024+0000","last_change":"2024-09-21T21:39:43.164348+0000","last_active":"2024-09-21T21:39:43.148024+0000","last_peered":"2024-09-21T21:39:43.148024+0000","last_clean":"2024-09-21T21:39:43.148024+0000","last_became_active":"2024-09-21T21:25:34.012471+0000","last_became_peered":"2024-09-21T21:25:34.012471+0000","last_unstale":"2024-09-21T21:39:43.148024+0000","last_undegraded":"2024-09-21T21:39:43.148024+0000","last_fullsized":"2024-09-21T21:39:43.148024+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.164111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.164111+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130941+0000","last_change":"2024-09-21T21:25:34.106122+0000","last_active":"2024-09-21T21:39:39.130941+0000","last_peered":"2024-09-21T21:39:39.130941+0000","last_clean":"2024-09-21T21:39:39.130941+0000","last_became_active":"2024-09-21T21:25:34.089828+0000","last_became_peered":"2024-09-21T21:25:34.089828+0000","last_unstale":"2024-09-21T21:39:39.130941+0000","last_undegraded":"2024-09-21T21:39:39.130941+0000","last_fullsized":"2024-09-21T21:39:39.130941+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118711+0000","last_change":"2024-09-21T21:25:34.128590+0000","last_active":"2024-09-21T21:39:39.118711+0000","last_peered":"2024-09-21T21:39:39.118711+0000","last_clean":"2024-09-21T21:39:39.118711+0000","last_became_active":"2024-09-21T21:25:34.123143+0000","last_became_peered":"2024-09-21T21:25:34.123143+0000","last_unstale":"2024-09-21T21:39:39.118711+0000","last_undegraded":"2024-09-21T21:39:39.118711+0000","last_fullsized":"2024-09-21T21:39:39.118711+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101148+0000","last_change":"2024-09-21T21:25:34.040888+0000","last_active":"2024-09-21T21:39:39.101148+0000","last_peered":"2024-09-21T21:39:39.101148+0000","last_clean":"2024-09-21T21:39:39.101148+0000","last_became_active":"2024-09-21T21:25:34.018004+0000","last_became_peered":"2024-09-21T21:25:34.018004+0000","last_unstale":"2024-09-21T21:39:39.101148+0000","last_undegraded":"2024-09-21T21:39:39.101148+0000","last_fullsized":"2024-09-21T21:39:39.101148+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.141369+0000","last_change":"2024-09-21T21:39:43.157402+0000","last_active":"2024-09-21T21:39:43.141369+0000","last_peered":"2024-09-21T21:39:43.141369+0000","last_clean":"2024-09-21T21:39:43.141369+0000","last_became_active":"2024-09-21T21:25:34.080013+0000","last_became_peered":"2024-09-21T21:25:34.080013+0000","last_unstale":"2024-09-21T21:39:43.141369+0000","last_undegraded":"2024-09-21T21:39:43.141369+0000","last_fullsized":"2024-09-21T21:39:43.141369+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.157077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.157077+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.128637+0000","last_change":"2024-09-21T21:25:34.056398+0000","last_active":"2024-09-21T21:39:39.128637+0000","last_peered":"2024-09-21T21:39:39.128637+0000","last_clean":"2024-09-21T21:39:39.128637+0000","last_became_active":"2024-09-21T21:25:34.025780+0000","last_became_peered":"2024-09-21T21:25:34.025780+0000","last_unstale":"2024-09-21T21:39:39.128637+0000","last_undegraded":"2024-09-21T21:39:39.128637+0000","last_fullsized":"2024-09-21T21:39:39.128637+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130249+0000","last_change":"2024-09-21T21:25:34.149489+0000","last_active":"2024-09-21T21:39:39.130249+0000","last_peered":"2024-09-21T21:39:39.130249+0000","last_clean":"2024-09-21T21:39:39.130249+0000","last_became_active":"2024-09-21T21:25:34.139437+0000","last_became_peered":"2024-09-21T21:25:34.139437+0000","last_unstale":"2024-09-21T21:39:39.130249+0000","last_undegraded":"2024-09-21T21:39:39.130249+0000","last_fullsized":"2024-09-21T21:39:39.130249+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.130207+0000","last_change":"2024-09-21T21:25:34.213148+0000","last_active":"2024-09-21T21:39:39.130207+0000","last_peered":"2024-09-21T21:39:39.130207+0000","last_clean":"2024-09-21T21:39:39.130207+0000","last_became_active":"2024-09-21T21:25:34.201780+0000","last_became_peered":"2024-09-21T21:25:34.201780+0000","last_unstale":"2024-09-21T21:39:39.130207+0000","last_undegraded":"2024-09-21T21:39:39.130207+0000","last_fullsized":"2024-09-21T21:39:39.130207+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105208+0000","last_change":"2024-09-21T21:25:34.073687+0000","last_active":"2024-09-21T21:39:39.105208+0000","last_peered":"2024-09-21T21:39:39.105208+0000","last_clean":"2024-09-21T21:39:39.105208+0000","last_became_active":"2024-09-21T21:25:34.064521+0000","last_became_peered":"2024-09-21T21:25:34.064521+0000","last_unstale":"2024-09-21T21:39:39.105208+0000","last_undegraded":"2024-09-21T21:39:39.105208+0000","last_fullsized":"2024-09-21T21:39:39.105208+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.091873+0000","last_change":"2024-09-21T21:25:34.085317+0000","last_active":"2024-09-21T21:39:39.091873+0000","last_peered":"2024-09-21T21:39:39.091873+0000","last_clean":"2024-09-21T21:39:39.091873+0000","last_became_active":"2024-09-21T21:25:34.067565+0000","last_became_peered":"2024-09-21T21:25:34.067565+0000","last_unstale":"2024-09-21T21:39:39.091873+0000","last_undegraded":"2024-09-21T21:39:39.091873+0000","last_fullsized":"2024-09-21T21:39:39.091873+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.093009+0000","last_change":"2024-09-21T21:25:34.077035+0000","last_active":"2024-09-21T21:39:39.093009+0000","last_peered":"2024-09-21T21:39:39.093009+0000","last_clean":"2024-09-21T21:39:39.093009+0000","last_became_active":"2024-09-21T21:25:34.062261+0000","last_became_peered":"2024-09-21T21:25:34.062261+0000","last_unstale":"2024-09-21T21:39:39.093009+0000","last_undegraded":"2024-09-21T21:39:39.093009+0000","last_fullsized":"2024-09-21T21:39:39.093009+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.129644+0000","last_change":"2024-09-21T21:25:34.111175+0000","last_active":"2024-09-21T21:39:39.129644+0000","last_peered":"2024-09-21T21:39:39.129644+0000","last_clean":"2024-09-21T21:39:39.129644+0000","last_became_active":"2024-09-21T21:25:34.089008+0000","last_became_peered":"2024-09-21T21:25:34.089008+0000","last_unstale":"2024-09-21T21:39:39.129644+0000","last_undegraded":"2024-09-21T21:39:39.129644+0000","last_fullsized":"2024-09-21T21:39:39.129644+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.105956+0000","last_change":"2024-09-21T21:25:34.090272+0000","last_active":"2024-09-21T21:39:39.105956+0000","last_peered":"2024-09-21T21:39:39.105956+0000","last_clean":"2024-09-21T21:39:39.105956+0000","last_became_active":"2024-09-21T21:25:34.079561+0000","last_became_peered":"2024-09-21T21:25:34.079561+0000","last_unstale":"2024-09-21T21:39:39.105956+0000","last_undegraded":"2024-09-21T21:39:39.105956+0000","last_fullsized":"2024-09-21T21:39:39.105956+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.118060+0000","last_change":"2024-09-21T21:25:34.131274+0000","last_active":"2024-09-21T21:39:39.118060+0000","last_peered":"2024-09-21T21:39:39.118060+0000","last_clean":"2024-09-21T21:39:39.118060+0000","last_became_active":"2024-09-21T21:25:34.124318+0000","last_became_peered":"2024-09-21T21:25:34.124318+0000","last_unstale":"2024-09-21T21:39:39.118060+0000","last_undegraded":"2024-09-21T21:39:39.118060+0000","last_fullsized":"2024-09-21T21:39:39.118060+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.135902+0000","last_change":"2024-09-21T21:25:34.231684+0000","last_active":"2024-09-21T21:39:39.135902+0000","last_peered":"2024-09-21T21:39:39.135902+0000","last_clean":"2024-09-21T21:39:39.135902+0000","last_became_active":"2024-09-21T21:25:34.226528+0000","last_became_peered":"2024-09-21T21:25:34.226528+0000","last_unstale":"2024-09-21T21:39:39.135902+0000","last_undegraded":"2024-09-21T21:39:39.135902+0000","last_fullsized":"2024-09-21T21:39:39.135902+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124409+0000","last_change":"2024-09-21T21:25:34.067759+0000","last_active":"2024-09-21T21:39:39.124409+0000","last_peered":"2024-09-21T21:39:39.124409+0000","last_clean":"2024-09-21T21:39:39.124409+0000","last_became_active":"2024-09-21T21:25:34.050600+0000","last_became_peered":"2024-09-21T21:25:34.050600+0000","last_unstale":"2024-09-21T21:39:39.124409+0000","last_undegraded":"2024-09-21T21:39:39.124409+0000","last_fullsized":"2024-09-21T21:39:39.124409+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.103595+0000","last_change":"2024-09-21T21:25:34.133956+0000","last_active":"2024-09-21T21:39:39.103595+0000","last_peered":"2024-09-21T21:39:39.103595+0000","last_clean":"2024-09-21T21:39:39.103595+0000","last_became_active":"2024-09-21T21:25:34.100820+0000","last_became_peered":"2024-09-21T21:25:34.100820+0000","last_unstale":"2024-09-21T21:39:39.103595+0000","last_undegraded":"2024-09-21T21:39:39.103595+0000","last_fullsized":"2024-09-21T21:39:39.103595+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.109680+0000","last_change":"2024-09-21T21:25:34.044370+0000","last_active":"2024-09-21T21:39:39.109680+0000","last_peered":"2024-09-21T21:39:39.109680+0000","last_clean":"2024-09-21T21:39:39.109680+0000","last_became_active":"2024-09-21T21:25:34.027204+0000","last_became_peered":"2024-09-21T21:25:34.027204+0000","last_unstale":"2024-09-21T21:39:39.109680+0000","last_undegraded":"2024-09-21T21:39:39.109680+0000","last_fullsized":"2024-09-21T21:39:39.109680+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119701+0000","last_change":"2024-09-21T21:25:34.073415+0000","last_active":"2024-09-21T21:39:39.119701+0000","last_peered":"2024-09-21T21:39:39.119701+0000","last_clean":"2024-09-21T21:39:39.119701+0000","last_became_active":"2024-09-21T21:25:34.065857+0000","last_became_peered":"2024-09-21T21:25:34.065857+0000","last_unstale":"2024-09-21T21:39:39.119701+0000","last_undegraded":"2024-09-21T21:39:39.119701+0000","last_fullsized":"2024-09-21T21:39:39.119701+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.145616+0000","last_change":"2024-09-21T21:39:43.162361+0000","last_active":"2024-09-21T21:39:43.145616+0000","last_peered":"2024-09-21T21:39:43.145616+0000","last_clean":"2024-09-21T21:39:43.145616+0000","last_became_active":"2024-09-21T21:25:34.152022+0000","last_became_peered":"2024-09-21T21:25:34.152022+0000","last_unstale":"2024-09-21T21:39:43.145616+0000","last_undegraded":"2024-09-21T21:39:43.145616+0000","last_fullsized":"2024-09-21T21:39:43.145616+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.162045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.162045+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.140078+0000","last_change":"2024-09-21T21:39:43.166660+0000","last_active":"2024-09-21T21:39:43.140078+0000","last_peered":"2024-09-21T21:39:43.140078+0000","last_clean":"2024-09-21T21:39:43.140078+0000","last_became_active":"2024-09-21T21:25:34.081214+0000","last_became_peered":"2024-09-21T21:25:34.081214+0000","last_unstale":"2024-09-21T21:39:43.140078+0000","last_undegraded":"2024-09-21T21:39:43.140078+0000","last_fullsized":"2024-09-21T21:39:43.140078+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.166481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.166481+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.137541+0000","last_change":"2024-09-21T21:39:43.151882+0000","last_active":"2024-09-21T21:39:43.137541+0000","last_peered":"2024-09-21T21:39:43.137541+0000","last_clean":"2024-09-21T21:39:43.137541+0000","last_became_active":"2024-09-21T21:25:34.040136+0000","last_became_peered":"2024-09-21T21:25:34.040136+0000","last_unstale":"2024-09-21T21:39:43.137541+0000","last_undegraded":"2024-09-21T21:39:43.137541+0000","last_fullsized":"2024-09-21T21:39:43.137541+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.151595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.151595+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113523+0000","last_change":"2024-09-21T21:25:34.148087+0000","last_active":"2024-09-21T21:39:39.113523+0000","last_peered":"2024-09-21T21:39:39.113523+0000","last_clean":"2024-09-21T21:39:39.113523+0000","last_became_active":"2024-09-21T21:25:34.141821+0000","last_became_peered":"2024-09-21T21:25:34.141821+0000","last_unstale":"2024-09-21T21:39:39.113523+0000","last_undegraded":"2024-09-21T21:39:39.113523+0000","last_fullsized":"2024-09-21T21:39:39.113523+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.120082+0000","last_change":"2024-09-21T21:25:34.040107+0000","last_active":"2024-09-21T21:39:39.120082+0000","last_peered":"2024-09-21T21:39:39.120082+0000","last_clean":"2024-09-21T21:39:39.120082+0000","last_became_active":"2024-09-21T21:25:34.023200+0000","last_became_peered":"2024-09-21T21:25:34.023200+0000","last_unstale":"2024-09-21T21:39:39.120082+0000","last_undegraded":"2024-09-21T21:39:39.120082+0000","last_fullsized":"2024-09-21T21:39:39.120082+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107419+0000","last_change":"2024-09-21T21:25:34.094490+0000","last_active":"2024-09-21T21:39:39.107419+0000","last_peered":"2024-09-21T21:39:39.107419+0000","last_clean":"2024-09-21T21:39:39.107419+0000","last_became_active":"2024-09-21T21:25:34.085139+0000","last_became_peered":"2024-09-21T21:25:34.085139+0000","last_unstale":"2024-09-21T21:39:39.107419+0000","last_undegraded":"2024-09-21T21:39:39.107419+0000","last_fullsized":"2024-09-21T21:39:39.107419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.112703+0000","last_change":"2024-09-21T21:25:34.072314+0000","last_active":"2024-09-21T21:39:39.112703+0000","last_peered":"2024-09-21T21:39:39.112703+0000","last_clean":"2024-09-21T21:39:39.112703+0000","last_became_active":"2024-09-21T21:25:34.040364+0000","last_became_peered":"2024-09-21T21:25:34.040364+0000","last_unstale":"2024-09-21T21:39:39.112703+0000","last_undegraded":"2024-09-21T21:39:39.112703+0000","last_fullsized":"2024-09-21T21:39:39.112703+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.107433+0000","last_change":"2024-09-21T21:25:34.119092+0000","last_active":"2024-09-21T21:39:39.107433+0000","last_peered":"2024-09-21T21:39:39.107433+0000","last_clean":"2024-09-21T21:39:39.107433+0000","last_became_active":"2024-09-21T21:25:34.108210+0000","last_became_peered":"2024-09-21T21:25:34.108210+0000","last_unstale":"2024-09-21T21:39:39.107433+0000","last_undegraded":"2024-09-21T21:39:39.107433+0000","last_fullsized":"2024-09-21T21:39:39.107433+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.123968+0000","last_change":"2024-09-21T21:25:34.180232+0000","last_active":"2024-09-21T21:39:39.123968+0000","last_peered":"2024-09-21T21:39:39.123968+0000","last_clean":"2024-09-21T21:39:39.123968+0000","last_became_active":"2024-09-21T21:25:34.175298+0000","last_became_peered":"2024-09-21T21:25:34.175298+0000","last_unstale":"2024-09-21T21:39:39.123968+0000","last_undegraded":"2024-09-21T21:39:39.123968+0000","last_fullsized":"2024-09-21T21:39:39.123968+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.111596+0000","last_change":"2024-09-21T21:25:34.174441+0000","last_active":"2024-09-21T21:39:39.111596+0000","last_peered":"2024-09-21T21:39:39.111596+0000","last_clean":"2024-09-21T21:39:39.111596+0000","last_became_active":"2024-09-21T21:25:34.167932+0000","last_became_peered":"2024-09-21T21:25:34.167932+0000","last_unstale":"2024-09-21T21:39:39.111596+0000","last_undegraded":"2024-09-21T21:39:39.111596+0000","last_fullsized":"2024-09-21T21:39:39.111596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.096596+0000","last_change":"2024-09-21T21:25:34.139852+0000","last_active":"2024-09-21T21:39:39.096596+0000","last_peered":"2024-09-21T21:39:39.096596+0000","last_clean":"2024-09-21T21:39:39.096596+0000","last_became_active":"2024-09-21T21:25:34.117704+0000","last_became_peered":"2024-09-21T21:25:34.117704+0000","last_unstale":"2024-09-21T21:39:39.096596+0000","last_undegraded":"2024-09-21T21:39:39.096596+0000","last_fullsized":"2024-09-21T21:39:39.096596+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1484,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.139281+0000","last_change":"2024-09-21T21:39:43.169657+0000","last_active":"2024-09-21T21:39:43.139281+0000","last_peered":"2024-09-21T21:39:43.139281+0000","last_clean":"2024-09-21T21:39:43.139281+0000","last_became_active":"2024-09-21T21:25:34.022737+0000","last_became_peered":"2024-09-21T21:25:34.022737+0000","last_unstale":"2024-09-21T21:39:43.139281+0000","last_undegraded":"2024-09-21T21:39:43.139281+0000","last_fullsized":"2024-09-21T21:39:43.139281+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-09-21T21:39:43.169469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.169469+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1469,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.113573+0000","last_change":"2024-09-21T21:25:34.053451+0000","last_active":"2024-09-21T21:39:39.113573+0000","last_peered":"2024-09-21T21:39:39.113573+0000","last_clean":"2024-09-21T21:39:39.113573+0000","last_became_active":"2024-09-21T21:25:34.042008+0000","last_became_peered":"2024-09-21T21:25:34.042008+0000","last_unstale":"2024-09-21T21:39:39.113573+0000","last_undegraded":"2024-09-21T21:39:39.113573+0000","last_fullsized":"2024-09-21T21:39:39.113573+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:25:32.894011+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.137304+0000","last_change":"2024-09-21T21:39:43.161185+0000","last_active":"2024-09-21T21:39:43.137304+0000","last_peered":"2024-09-21T21:39:43.137304+0000","last_clean":"2024-09-21T21:39:43.137304+0000","last_became_active":"2024-09-21T21:20:27.209536+0000","last_became_peered":"2024-09-21T21:20:27.209536+0000","last_unstale":"2024-09-21T21:39:43.137304+0000","last_undegraded":"2024-09-21T21:39:43.137304+0000","last_fullsized":"2024-09-21T21:39:43.137304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.161005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.161005+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.106177+0000","last_change":"2024-09-21T21:20:29.168730+0000","last_active":"2024-09-21T21:39:39.106177+0000","last_peered":"2024-09-21T21:39:39.106177+0000","last_clean":"2024-09-21T21:39:39.106177+0000","last_became_active":"2024-09-21T21:20:27.208215+0000","last_became_peered":"2024-09-21T21:20:27.208215+0000","last_unstale":"2024-09-21T21:39:39.106177+0000","last_undegraded":"2024-09-21T21:39:39.106177+0000","last_fullsized":"2024-09-21T21:39:39.106177+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.119386+0000","last_change":"2024-09-21T21:20:29.169143+0000","last_active":"2024-09-21T21:39:39.119386+0000","last_peered":"2024-09-21T21:39:39.119386+0000","last_clean":"2024-09-21T21:39:39.119386+0000","last_became_active":"2024-09-21T21:20:27.191527+0000","last_became_peered":"2024-09-21T21:20:27.191527+0000","last_unstale":"2024-09-21T21:39:39.119386+0000","last_undegraded":"2024-09-21T21:39:39.119386+0000","last_fullsized":"2024-09-21T21:39:39.119386+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.101535+0000","last_change":"2024-09-21T21:20:29.167100+0000","last_active":"2024-09-21T21:39:39.101535+0000","last_peered":"2024-09-21T21:39:39.101535+0000","last_clean":"2024-09-21T21:39:39.101535+0000","last_became_active":"2024-09-21T21:20:27.193527+0000","last_became_peered":"2024-09-21T21:20:27.193527+0000","last_unstale":"2024-09-21T21:39:39.101535+0000","last_undegraded":"2024-09-21T21:39:39.101535+0000","last_fullsized":"2024-09-21T21:39:39.101535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.124842+0000","last_change":"2024-09-21T21:20:29.169124+0000","last_active":"2024-09-21T21:39:39.124842+0000","last_peered":"2024-09-21T21:39:39.124842+0000","last_clean":"2024-09-21T21:39:39.124842+0000","last_became_active":"2024-09-21T21:20:27.194367+0000","last_became_peered":"2024-09-21T21:20:27.194367+0000","last_unstale":"2024-09-21T21:39:39.124842+0000","last_undegraded":"2024-09-21T21:39:39.124842+0000","last_fullsized":"2024-09-21T21:39:39.124842+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.135342+0000","last_change":"2024-09-21T21:39:43.149221+0000","last_active":"2024-09-21T21:39:43.135342+0000","last_peered":"2024-09-21T21:39:43.135342+0000","last_clean":"2024-09-21T21:39:43.135342+0000","last_became_active":"2024-09-21T21:20:27.194446+0000","last_became_peered":"2024-09-21T21:20:27.194446+0000","last_unstale":"2024-09-21T21:39:43.135342+0000","last_undegraded":"2024-09-21T21:39:43.135342+0000","last_fullsized":"2024-09-21T21:39:43.135342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.149000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.149000+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2142,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.125600+0000","last_change":"2024-09-21T21:20:29.170643+0000","last_active":"2024-09-21T21:39:39.125600+0000","last_peered":"2024-09-21T21:39:39.125600+0000","last_clean":"2024-09-21T21:39:39.125600+0000","last_became_active":"2024-09-21T21:20:27.204212+0000","last_became_peered":"2024-09-21T21:20:27.204212+0000","last_unstale":"2024-09-21T21:39:39.125600+0000","last_undegraded":"2024-09-21T21:39:39.125600+0000","last_fullsized":"2024-09-21T21:39:39.125600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:26.139501+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2145,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.137309+0000","last_change":"2024-09-21T21:39:43.168534+0000","last_active":"2024-09-21T21:39:43.137309+0000","last_peered":"2024-09-21T21:39:43.137309+0000","last_clean":"2024-09-21T21:39:43.137309+0000","last_became_active":"2024-09-21T21:20:27.211878+0000","last_became_peered":"2024-09-21T21:20:27.211878+0000","last_unstale":"2024-09-21T21:39:43.137309+0000","last_undegraded":"2024-09-21T21:39:43.137309+0000","last_fullsized":"2024-09-21T21:39:43.137309+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-21T21:39:43.168332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.168332+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2211,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:39.102375+0000","last_change":"2024-09-21T21:20:26.198858+0000","last_active":"2024-09-21T21:39:39.102375+0000","last_peered":"2024-09-21T21:39:39.102375+0000","last_clean":"2024-09-21T21:39:39.102375+0000","last_became_active":"2024-09-21T21:20:26.190843+0000","last_became_peered":"2024-09-21T21:20:26.190843+0000","last_unstale":"2024-09-21T21:39:39.102375+0000","last_undegraded":"2024-09-21T21:39:39.102375+0000","last_fullsized":"2024-09-21T21:39:39.102375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:20:25.135404+0000","last_clean_scrub_stamp":"2024-09-21T21:20:25.135404+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64120,"kb_used_data":6760,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307720,"statfs":{"total":96636764160,"available":96571105280,"internally_reserved":0,"allocated":6922240,"data_stored":3458617,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949674114,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69648,"kb_used_data":6720,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94302192,"statfs":{"total":96636764160,"available":96565444608,"internally_reserved":0,"allocated":6881280,"data_stored":2881148,"data_compressed":35328,"data_compressed_allocated":49152,"data_compressed_original":73728,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706823,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68176,"kb_used_data":6656,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94303664,"statfs":{"total":96636764160,"available":96566951936,"internally_reserved":0,"allocated":6815744,"data_stored":2807894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706819,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73864,"kb_used_data":6776,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94297976,"statfs":{"total":96636764160,"available":96561127424,"internally_reserved":0,"allocated":6938624,"data_stored":3462651,"data_compressed":59427,"data_compressed_allocated":81920,"data_compressed_original":634880,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T21:39:44.477 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.477 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.477 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.478 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.479 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-09-21T21:25:32.894011+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=25, tm_sec=32, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-21T21:20:26.139501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=20, tm_sec=26, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-21T21:20:26.139501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=20, tm_sec=26, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.480 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-21T21:20:26.139501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=20, tm_sec=26, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.481 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-21T21:20:26.139501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=20, tm_sec=26, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.481 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-21T21:20:26.139501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=20, tm_sec=26, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.481 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-21T21:20:25.135404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=20, tm_sec=25, tm_wday=5, tm_yday=265, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=21, tm_hour=21, tm_min=39, tm_sec=41, tm_wday=5, tm_yday=265, tm_isdst=0) 2024-09-21T21:39:44.481 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-21T21:40:04.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T21:40:04.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.606+0000 7fbfc2311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:40:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.611+0000 7fbfc2311640 1 Processor -- start 2024-09-21T21:40:04.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.611+0000 7fbfc2311640 1 -- start start 2024-09-21T21:40:04.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfc2311640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfbc132d60 0x7fbfbc133170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfc2311640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfbc0742a0 con 0x7fbfbc1336b0 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfc2311640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7fbfbc0a1fd0 con 0x7fbfbc132d60 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfbbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfbc132d60 0x7fbfbc133170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfbbfff640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7fbfbc132d60 0x7fbfbc133170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47284/0 (socket says 172.21.15.5:47284) 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfbb7fe640 1 --1- >> v1:172.21.15.5:6789/0 conn(0x7fbfbc1336b0 0x7fbfbc072fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37950/0 (socket says 172.21.15.5:37950) 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfbbfff640 1 -- 172.21.15.5:0/698158304 learned_addr learned my addr 172.21.15.5:0/698158304 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfbbfff640 1 -- 172.21.15.5:0/698158304 >> v1:172.21.15.5:6789/0 conn(0x7fbfbc1336b0 legacy=0x7fbfbc072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.613+0000 7fbfbbfff640 1 -- 172.21.15.5:0/698158304 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc09de20 con 0x7fbfbc132d60 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.614+0000 7fbfbbfff640 1 --2- 172.21.15.5:0/698158304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc133170 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d27def734a02e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.614+0000 7fbfbaffd640 1 -- 172.21.15.5:0/698158304 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfac009e50 con 0x7fbfbc132d60 2024-09-21T21:40:04.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.614+0000 7fbfbaffd640 1 -- 172.21.15.5:0/698158304 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbfac00e230 con 0x7fbfbc132d60 2024-09-21T21:40:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.614+0000 7fbfbaffd640 1 -- 172.21.15.5:0/698158304 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfac00e4d0 con 0x7fbfbc132d60 2024-09-21T21:40:04.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 1 -- 172.21.15.5:0/698158304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 msgr2=0x7fbfbc133170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 1 --2- 172.21.15.5:0/698158304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc133170 crc :-1 s=READY pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 1 -- 172.21.15.5:0/698158304 shutdown_connections 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 1 --2- 172.21.15.5:0/698158304 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc133170 unknown :-1 s=CLOSED pgs=13010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 1 -- 172.21.15.5:0/698158304 >> 172.21.15.5:0/698158304 conn(0x7fbfbc0a2490 msgr2=0x7fbfbc0a28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 1 -- 172.21.15.5:0/698158304 shutdown_connections 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 1 -- 172.21.15.5:0/698158304 wait complete. 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.615+0000 7fbfc2311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:40:04.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.617+0000 7fbfc2311640 1 Processor -- start 2024-09-21T21:40:04.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.617+0000 7fbfc2311640 1 -- start start 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.618+0000 7fbfc2311640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc123a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.618+0000 7fbfc2311640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc127770 con 0x7fbfbc132d60 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc123a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc123a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47286/0 (socket says 172.21.15.5:47286) 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfbbfff640 1 -- 172.21.15.5:0/3658079534 learned_addr learned my addr 172.21.15.5:0/3658079534 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfbbfff640 1 -- 172.21.15.5:0/3658079534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc132bd0 con 0x7fbfbc132d60 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfbbfff640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc123a30 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/3658079534 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfac00ede0 con 0x7fbfbc132d60 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/3658079534 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbfac015420 con 0x7fbfbc132d60 2024-09-21T21:40:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc1254b0 con 0x7fbfbc132d60 2024-09-21T21:40:04.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/3658079534 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbfac0156c0 con 0x7fbfbc132d60 2024-09-21T21:40:04.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.619+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc125d60 con 0x7fbfbc132d60 2024-09-21T21:40:04.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.620+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfbc0717b0 con 0x7fbfbc132d60 2024-09-21T21:40:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.620+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/3658079534 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7fbfac015870 con 0x7fbfbc132d60 2024-09-21T21:40:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.620+0000 7fbfb8ff9640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbfa803ead0 0x7fbfa8040fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:40:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.621+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/3658079534 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7fbfac051190 con 0x7fbfbc132d60 2024-09-21T21:40:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.621+0000 7fbfbb7fe640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbfa803ead0 0x7fbfa8040fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:40:04.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.622+0000 7fbfbb7fe640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbfa803ead0 0x7fbfa8040fe0 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:40:04.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.626+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/3658079534 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7fbfac00f2a0 con 0x7fbfbc132d60 2024-09-21T21:40:04.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.816+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 --> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfbc09c9d0 con 0x7fbfa803ead0 2024-09-21T21:40:04.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.819+0000 7fbfb8ff9640 1 -- 172.21.15.5:0/3658079534 <== mgr.4102 v2:172.21.15.148:6800/377023394 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109200 (crc 0 0 0) 0x7fbfb00012b0 con 0x7fbfa803ead0 2024-09-21T21:40:04.821 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-21T21:40:04.822 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-21T21:40:04.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbfa803ead0 msgr2=0x7fbfa8040fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbfa803ead0 0x7fbfa8040fe0 crc :-1 s=READY pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 msgr2=0x7fbfbc123a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc123a30 crc :-1 s=READY pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 shutdown_connections 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7fbfa803ead0 0x7fbfa8040fe0 unknown :-1 s=CLOSED pgs=3859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 --2- 172.21.15.5:0/3658079534 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbfbc132d60 0x7fbfbc123a30 unknown :-1 s=CLOSED pgs=13011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 >> 172.21.15.5:0/3658079534 conn(0x7fbfbc0a2490 msgr2=0x7fbfbc06f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 shutdown_connections 2024-09-21T21:40:04.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.822+0000 7fbfc2311640 1 -- 172.21.15.5:0/3658079534 wait complete. 2024-09-21T21:40:04.835 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":1307,"stamp":"2024-09-21T21:40:03.357656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":52,"num_write":88,"num_write_kb":1115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":275640,"kb_used_data":26744,"kb_used_omap":0,"kb_used_meta":248832,"kb_avail":377211720,"statfs":{"total":386547056640,"available":386264801280,"internally_reserved":0,"allocated":27385856,"data_stored":12412340,"data_compressed":59974,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":254803968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003333"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.148024+0000","last_change":"2024-09-21T21:39:43.164348+0000","last_active":"2024-09-21T21:39:43.148024+0000","last_peered":"2024-09-21T21:39:43.148024+0000","last_clean":"2024-09-21T21:39:43.148024+0000","last_became_active":"2024-09-21T21:25:34.012471+0000","last_became_peered":"2024-09-21T21:25:34.012471+0000","last_unstale":"2024-09-21T21:39:43.148024+0000","last_undegraded":"2024-09-21T21:39:43.148024+0000","last_fullsized":"2024-09-21T21:39:43.148024+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.164111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.164111+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.651819+0000","last_change":"2024-09-21T21:39:42.664869+0000","last_active":"2024-09-21T21:39:42.651819+0000","last_peered":"2024-09-21T21:39:42.651819+0000","last_clean":"2024-09-21T21:39:42.651819+0000","last_became_active":"2024-09-21T21:25:34.089828+0000","last_became_peered":"2024-09-21T21:25:34.089828+0000","last_unstale":"2024-09-21T21:39:42.651819+0000","last_undegraded":"2024-09-21T21:39:42.651819+0000","last_fullsized":"2024-09-21T21:39:42.651819+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.664691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.664691+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.643103+0000","last_change":"2024-09-21T21:39:43.661368+0000","last_active":"2024-09-21T21:39:43.643103+0000","last_peered":"2024-09-21T21:39:43.643103+0000","last_clean":"2024-09-21T21:39:43.643103+0000","last_became_active":"2024-09-21T21:25:34.123143+0000","last_became_peered":"2024-09-21T21:25:34.123143+0000","last_unstale":"2024-09-21T21:39:43.643103+0000","last_undegraded":"2024-09-21T21:39:43.643103+0000","last_fullsized":"2024-09-21T21:39:43.643103+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.661156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.661156+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.139599+0000","last_change":"2024-09-21T21:39:44.167013+0000","last_active":"2024-09-21T21:39:44.139599+0000","last_peered":"2024-09-21T21:39:44.139599+0000","last_clean":"2024-09-21T21:39:44.139599+0000","last_became_active":"2024-09-21T21:25:34.018004+0000","last_became_peered":"2024-09-21T21:25:34.018004+0000","last_unstale":"2024-09-21T21:39:44.139599+0000","last_undegraded":"2024-09-21T21:39:44.139599+0000","last_fullsized":"2024-09-21T21:39:44.139599+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.166817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.166817+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.141369+0000","last_change":"2024-09-21T21:39:43.157402+0000","last_active":"2024-09-21T21:39:43.141369+0000","last_peered":"2024-09-21T21:39:43.141369+0000","last_clean":"2024-09-21T21:39:43.141369+0000","last_became_active":"2024-09-21T21:25:34.080013+0000","last_became_peered":"2024-09-21T21:25:34.080013+0000","last_unstale":"2024-09-21T21:39:43.141369+0000","last_undegraded":"2024-09-21T21:39:43.141369+0000","last_fullsized":"2024-09-21T21:39:43.141369+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.157077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.157077+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.649668+0000","last_change":"2024-09-21T21:39:42.662718+0000","last_active":"2024-09-21T21:39:42.649668+0000","last_peered":"2024-09-21T21:39:42.649668+0000","last_clean":"2024-09-21T21:39:42.649668+0000","last_became_active":"2024-09-21T21:25:34.025780+0000","last_became_peered":"2024-09-21T21:25:34.025780+0000","last_unstale":"2024-09-21T21:39:42.649668+0000","last_undegraded":"2024-09-21T21:39:42.649668+0000","last_fullsized":"2024-09-21T21:39:42.649668+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.662427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.662427+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.650746+0000","last_change":"2024-09-21T21:39:42.673958+0000","last_active":"2024-09-21T21:39:42.650746+0000","last_peered":"2024-09-21T21:39:42.650746+0000","last_clean":"2024-09-21T21:39:42.650746+0000","last_became_active":"2024-09-21T21:25:34.139437+0000","last_became_peered":"2024-09-21T21:25:34.139437+0000","last_unstale":"2024-09-21T21:39:42.650746+0000","last_undegraded":"2024-09-21T21:39:42.650746+0000","last_fullsized":"2024-09-21T21:39:42.650746+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.673665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.673665+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.645475+0000","last_change":"2024-09-21T21:39:42.670677+0000","last_active":"2024-09-21T21:39:42.645475+0000","last_peered":"2024-09-21T21:39:42.645475+0000","last_clean":"2024-09-21T21:39:42.645475+0000","last_became_active":"2024-09-21T21:25:34.201780+0000","last_became_peered":"2024-09-21T21:25:34.201780+0000","last_unstale":"2024-09-21T21:39:42.645475+0000","last_undegraded":"2024-09-21T21:39:42.645475+0000","last_fullsized":"2024-09-21T21:39:42.645475+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.670502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.670502+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.143168+0000","last_change":"2024-09-21T21:39:44.167235+0000","last_active":"2024-09-21T21:39:44.143168+0000","last_peered":"2024-09-21T21:39:44.143168+0000","last_clean":"2024-09-21T21:39:44.143168+0000","last_became_active":"2024-09-21T21:25:34.064521+0000","last_became_peered":"2024-09-21T21:25:34.064521+0000","last_unstale":"2024-09-21T21:39:44.143168+0000","last_undegraded":"2024-09-21T21:39:44.143168+0000","last_fullsized":"2024-09-21T21:39:44.143168+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.167051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.167051+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.639901+0000","last_change":"2024-09-21T21:39:43.656543+0000","last_active":"2024-09-21T21:39:43.639901+0000","last_peered":"2024-09-21T21:39:43.639901+0000","last_clean":"2024-09-21T21:39:43.639901+0000","last_became_active":"2024-09-21T21:25:34.067565+0000","last_became_peered":"2024-09-21T21:25:34.067565+0000","last_unstale":"2024-09-21T21:39:43.639901+0000","last_undegraded":"2024-09-21T21:39:43.639901+0000","last_fullsized":"2024-09-21T21:39:43.639901+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.656345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.656345+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.136806+0000","last_change":"2024-09-21T21:39:44.151007+0000","last_active":"2024-09-21T21:39:44.136806+0000","last_peered":"2024-09-21T21:39:44.136806+0000","last_clean":"2024-09-21T21:39:44.136806+0000","last_became_active":"2024-09-21T21:25:34.062261+0000","last_became_peered":"2024-09-21T21:25:34.062261+0000","last_unstale":"2024-09-21T21:39:44.136806+0000","last_undegraded":"2024-09-21T21:39:44.136806+0000","last_fullsized":"2024-09-21T21:39:44.136806+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.150686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.150686+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.644427+0000","last_change":"2024-09-21T21:39:42.669485+0000","last_active":"2024-09-21T21:39:42.644427+0000","last_peered":"2024-09-21T21:39:42.644427+0000","last_clean":"2024-09-21T21:39:42.644427+0000","last_became_active":"2024-09-21T21:25:34.089008+0000","last_became_peered":"2024-09-21T21:25:34.089008+0000","last_unstale":"2024-09-21T21:39:42.644427+0000","last_undegraded":"2024-09-21T21:39:42.644427+0000","last_fullsized":"2024-09-21T21:39:42.644427+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.669305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.669305+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.136146+0000","last_change":"2024-09-21T21:39:44.164741+0000","last_active":"2024-09-21T21:39:44.136146+0000","last_peered":"2024-09-21T21:39:44.136146+0000","last_clean":"2024-09-21T21:39:44.136146+0000","last_became_active":"2024-09-21T21:25:34.079561+0000","last_became_peered":"2024-09-21T21:25:34.079561+0000","last_unstale":"2024-09-21T21:39:44.136146+0000","last_undegraded":"2024-09-21T21:39:44.136146+0000","last_fullsized":"2024-09-21T21:39:44.136146+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.164551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.164551+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.135229+0000","last_change":"2024-09-21T21:39:44.158118+0000","last_active":"2024-09-21T21:39:44.135229+0000","last_peered":"2024-09-21T21:39:44.135229+0000","last_clean":"2024-09-21T21:39:44.135229+0000","last_became_active":"2024-09-21T21:25:34.124318+0000","last_became_peered":"2024-09-21T21:25:34.124318+0000","last_unstale":"2024-09-21T21:39:44.135229+0000","last_undegraded":"2024-09-21T21:39:44.135229+0000","last_fullsized":"2024-09-21T21:39:44.135229+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.157778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.157778+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.649839+0000","last_change":"2024-09-21T21:39:42.671840+0000","last_active":"2024-09-21T21:39:42.649839+0000","last_peered":"2024-09-21T21:39:42.649839+0000","last_clean":"2024-09-21T21:39:42.649839+0000","last_became_active":"2024-09-21T21:25:34.226528+0000","last_became_peered":"2024-09-21T21:25:34.226528+0000","last_unstale":"2024-09-21T21:39:42.649839+0000","last_undegraded":"2024-09-21T21:39:42.649839+0000","last_fullsized":"2024-09-21T21:39:42.649839+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.671541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.671541+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.640423+0000","last_change":"2024-09-21T21:39:42.667197+0000","last_active":"2024-09-21T21:39:42.640423+0000","last_peered":"2024-09-21T21:39:42.640423+0000","last_clean":"2024-09-21T21:39:42.640423+0000","last_became_active":"2024-09-21T21:25:34.050600+0000","last_became_peered":"2024-09-21T21:25:34.050600+0000","last_unstale":"2024-09-21T21:39:42.640423+0000","last_undegraded":"2024-09-21T21:39:42.640423+0000","last_fullsized":"2024-09-21T21:39:42.640423+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.667024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.667024+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.638244+0000","last_change":"2024-09-21T21:39:42.671628+0000","last_active":"2024-09-21T21:39:42.638244+0000","last_peered":"2024-09-21T21:39:42.638244+0000","last_clean":"2024-09-21T21:39:42.638244+0000","last_became_active":"2024-09-21T21:25:34.100820+0000","last_became_peered":"2024-09-21T21:25:34.100820+0000","last_unstale":"2024-09-21T21:39:42.638244+0000","last_undegraded":"2024-09-21T21:39:42.638244+0000","last_fullsized":"2024-09-21T21:39:42.638244+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.671461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.671461+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.131783+0000","last_change":"2024-09-21T21:39:44.160176+0000","last_active":"2024-09-21T21:39:44.131783+0000","last_peered":"2024-09-21T21:39:44.131783+0000","last_clean":"2024-09-21T21:39:44.131783+0000","last_became_active":"2024-09-21T21:25:34.027204+0000","last_became_peered":"2024-09-21T21:25:34.027204+0000","last_unstale":"2024-09-21T21:39:44.131783+0000","last_undegraded":"2024-09-21T21:39:44.131783+0000","last_fullsized":"2024-09-21T21:39:44.131783+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.159904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.159904+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.641634+0000","last_change":"2024-09-21T21:39:43.658481+0000","last_active":"2024-09-21T21:39:43.641634+0000","last_peered":"2024-09-21T21:39:43.641634+0000","last_clean":"2024-09-21T21:39:43.641634+0000","last_became_active":"2024-09-21T21:25:34.065857+0000","last_became_peered":"2024-09-21T21:25:34.065857+0000","last_unstale":"2024-09-21T21:39:43.641634+0000","last_undegraded":"2024-09-21T21:39:43.641634+0000","last_fullsized":"2024-09-21T21:39:43.641634+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.658262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.658262+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.145616+0000","last_change":"2024-09-21T21:39:43.162361+0000","last_active":"2024-09-21T21:39:43.145616+0000","last_peered":"2024-09-21T21:39:43.145616+0000","last_clean":"2024-09-21T21:39:43.145616+0000","last_became_active":"2024-09-21T21:25:34.152022+0000","last_became_peered":"2024-09-21T21:25:34.152022+0000","last_unstale":"2024-09-21T21:39:43.145616+0000","last_undegraded":"2024-09-21T21:39:43.145616+0000","last_fullsized":"2024-09-21T21:39:43.145616+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.162045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.162045+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.140078+0000","last_change":"2024-09-21T21:39:43.166660+0000","last_active":"2024-09-21T21:39:43.140078+0000","last_peered":"2024-09-21T21:39:43.140078+0000","last_clean":"2024-09-21T21:39:43.140078+0000","last_became_active":"2024-09-21T21:25:34.081214+0000","last_became_peered":"2024-09-21T21:25:34.081214+0000","last_unstale":"2024-09-21T21:39:43.140078+0000","last_undegraded":"2024-09-21T21:39:43.140078+0000","last_fullsized":"2024-09-21T21:39:43.140078+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.166481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.166481+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.137541+0000","last_change":"2024-09-21T21:39:43.151882+0000","last_active":"2024-09-21T21:39:43.137541+0000","last_peered":"2024-09-21T21:39:43.137541+0000","last_clean":"2024-09-21T21:39:43.137541+0000","last_became_active":"2024-09-21T21:25:34.040136+0000","last_became_peered":"2024-09-21T21:25:34.040136+0000","last_unstale":"2024-09-21T21:39:43.137541+0000","last_undegraded":"2024-09-21T21:39:43.137541+0000","last_fullsized":"2024-09-21T21:39:43.137541+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.151595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.151595+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.640075+0000","last_change":"2024-09-21T21:39:43.660183+0000","last_active":"2024-09-21T21:39:43.640075+0000","last_peered":"2024-09-21T21:39:43.640075+0000","last_clean":"2024-09-21T21:39:43.640075+0000","last_became_active":"2024-09-21T21:25:34.141821+0000","last_became_peered":"2024-09-21T21:25:34.141821+0000","last_unstale":"2024-09-21T21:39:43.640075+0000","last_undegraded":"2024-09-21T21:39:43.640075+0000","last_fullsized":"2024-09-21T21:39:43.640075+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.659974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.659974+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.133863+0000","last_change":"2024-09-21T21:39:44.161017+0000","last_active":"2024-09-21T21:39:44.133863+0000","last_peered":"2024-09-21T21:39:44.133863+0000","last_clean":"2024-09-21T21:39:44.133863+0000","last_became_active":"2024-09-21T21:25:34.023200+0000","last_became_peered":"2024-09-21T21:25:34.023200+0000","last_unstale":"2024-09-21T21:39:44.133863+0000","last_undegraded":"2024-09-21T21:39:44.133863+0000","last_fullsized":"2024-09-21T21:39:44.133863+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.160837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.160837+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.131341+0000","last_change":"2024-09-21T21:39:44.160229+0000","last_active":"2024-09-21T21:39:44.131341+0000","last_peered":"2024-09-21T21:39:44.131341+0000","last_clean":"2024-09-21T21:39:44.131341+0000","last_became_active":"2024-09-21T21:25:34.085139+0000","last_became_peered":"2024-09-21T21:25:34.085139+0000","last_unstale":"2024-09-21T21:39:44.131341+0000","last_undegraded":"2024-09-21T21:39:44.131341+0000","last_fullsized":"2024-09-21T21:39:44.131341+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.160050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.160050+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.635925+0000","last_change":"2024-09-21T21:39:42.665424+0000","last_active":"2024-09-21T21:39:42.635925+0000","last_peered":"2024-09-21T21:39:42.635925+0000","last_clean":"2024-09-21T21:39:42.635925+0000","last_became_active":"2024-09-21T21:25:34.040364+0000","last_became_peered":"2024-09-21T21:25:34.040364+0000","last_unstale":"2024-09-21T21:39:42.635925+0000","last_undegraded":"2024-09-21T21:39:42.635925+0000","last_fullsized":"2024-09-21T21:39:42.635925+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.665242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.665242+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.132847+0000","last_change":"2024-09-21T21:39:44.155668+0000","last_active":"2024-09-21T21:39:44.132847+0000","last_peered":"2024-09-21T21:39:44.132847+0000","last_clean":"2024-09-21T21:39:44.132847+0000","last_became_active":"2024-09-21T21:25:34.108210+0000","last_became_peered":"2024-09-21T21:25:34.108210+0000","last_unstale":"2024-09-21T21:39:44.132847+0000","last_undegraded":"2024-09-21T21:39:44.132847+0000","last_fullsized":"2024-09-21T21:39:44.132847+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.155347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.155347+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.636331+0000","last_change":"2024-09-21T21:39:42.658995+0000","last_active":"2024-09-21T21:39:42.636331+0000","last_peered":"2024-09-21T21:39:42.636331+0000","last_clean":"2024-09-21T21:39:42.636331+0000","last_became_active":"2024-09-21T21:25:34.175298+0000","last_became_peered":"2024-09-21T21:25:34.175298+0000","last_unstale":"2024-09-21T21:39:42.636331+0000","last_undegraded":"2024-09-21T21:39:42.636331+0000","last_fullsized":"2024-09-21T21:39:42.636331+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.658805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.658805+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.636519+0000","last_change":"2024-09-21T21:39:42.663440+0000","last_active":"2024-09-21T21:39:42.636519+0000","last_peered":"2024-09-21T21:39:42.636519+0000","last_clean":"2024-09-21T21:39:42.636519+0000","last_became_active":"2024-09-21T21:25:34.167932+0000","last_became_peered":"2024-09-21T21:25:34.167932+0000","last_unstale":"2024-09-21T21:39:42.636519+0000","last_undegraded":"2024-09-21T21:39:42.636519+0000","last_fullsized":"2024-09-21T21:39:42.636519+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.663269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.663269+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.633795+0000","last_change":"2024-09-21T21:39:42.660578+0000","last_active":"2024-09-21T21:39:42.633795+0000","last_peered":"2024-09-21T21:39:42.633795+0000","last_clean":"2024-09-21T21:39:42.633795+0000","last_became_active":"2024-09-21T21:25:34.117704+0000","last_became_peered":"2024-09-21T21:25:34.117704+0000","last_unstale":"2024-09-21T21:39:42.633795+0000","last_undegraded":"2024-09-21T21:39:42.633795+0000","last_fullsized":"2024-09-21T21:39:42.633795+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.660269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.660269+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1484,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.139281+0000","last_change":"2024-09-21T21:39:43.169657+0000","last_active":"2024-09-21T21:39:43.139281+0000","last_peered":"2024-09-21T21:39:43.139281+0000","last_clean":"2024-09-21T21:39:43.139281+0000","last_became_active":"2024-09-21T21:25:34.022737+0000","last_became_peered":"2024-09-21T21:25:34.022737+0000","last_unstale":"2024-09-21T21:39:43.139281+0000","last_undegraded":"2024-09-21T21:39:43.139281+0000","last_fullsized":"2024-09-21T21:39:43.139281+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-09-21T21:39:43.169469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.169469+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1471,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.639936+0000","last_change":"2024-09-21T21:39:43.656962+0000","last_active":"2024-09-21T21:39:43.639936+0000","last_peered":"2024-09-21T21:39:43.639936+0000","last_clean":"2024-09-21T21:39:43.639936+0000","last_became_active":"2024-09-21T21:25:34.042008+0000","last_became_peered":"2024-09-21T21:25:34.042008+0000","last_unstale":"2024-09-21T21:39:43.639936+0000","last_undegraded":"2024-09-21T21:39:43.639936+0000","last_fullsized":"2024-09-21T21:39:43.639936+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.656751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.656751+0000","last_clean_scrub_stamp":"2024-09-21T21:25:32.894011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.137304+0000","last_change":"2024-09-21T21:39:43.161185+0000","last_active":"2024-09-21T21:39:43.137304+0000","last_peered":"2024-09-21T21:39:43.137304+0000","last_clean":"2024-09-21T21:39:43.137304+0000","last_became_active":"2024-09-21T21:20:27.209536+0000","last_became_peered":"2024-09-21T21:20:27.209536+0000","last_unstale":"2024-09-21T21:39:43.137304+0000","last_undegraded":"2024-09-21T21:39:43.137304+0000","last_fullsized":"2024-09-21T21:39:43.137304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.161005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.161005+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.638614+0000","last_change":"2024-09-21T21:39:43.655753+0000","last_active":"2024-09-21T21:39:43.638614+0000","last_peered":"2024-09-21T21:39:43.638614+0000","last_clean":"2024-09-21T21:39:43.638614+0000","last_became_active":"2024-09-21T21:20:27.208215+0000","last_became_peered":"2024-09-21T21:20:27.208215+0000","last_unstale":"2024-09-21T21:39:43.638614+0000","last_undegraded":"2024-09-21T21:39:43.638614+0000","last_fullsized":"2024-09-21T21:39:43.638614+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.655519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.655519+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.131505+0000","last_change":"2024-09-21T21:39:44.163785+0000","last_active":"2024-09-21T21:39:44.131505+0000","last_peered":"2024-09-21T21:39:44.131505+0000","last_clean":"2024-09-21T21:39:44.131505+0000","last_became_active":"2024-09-21T21:20:27.191527+0000","last_became_peered":"2024-09-21T21:20:27.191527+0000","last_unstale":"2024-09-21T21:39:44.131505+0000","last_undegraded":"2024-09-21T21:39:44.131505+0000","last_fullsized":"2024-09-21T21:39:44.131505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:44.163543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.163543+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.637035+0000","last_change":"2024-09-21T21:39:43.651330+0000","last_active":"2024-09-21T21:39:43.637035+0000","last_peered":"2024-09-21T21:39:43.637035+0000","last_clean":"2024-09-21T21:39:43.637035+0000","last_became_active":"2024-09-21T21:20:27.193527+0000","last_became_peered":"2024-09-21T21:20:27.193527+0000","last_unstale":"2024-09-21T21:39:43.637035+0000","last_undegraded":"2024-09-21T21:39:43.637035+0000","last_fullsized":"2024-09-21T21:39:43.637035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.650936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.650936+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":2146,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.633793+0000","last_change":"2024-09-21T21:39:42.657025+0000","last_active":"2024-09-21T21:39:42.633793+0000","last_peered":"2024-09-21T21:39:42.633793+0000","last_clean":"2024-09-21T21:39:42.633793+0000","last_became_active":"2024-09-21T21:20:27.194367+0000","last_became_peered":"2024-09-21T21:20:27.194367+0000","last_unstale":"2024-09-21T21:39:42.633793+0000","last_undegraded":"2024-09-21T21:39:42.633793+0000","last_fullsized":"2024-09-21T21:39:42.633793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-21T21:39:42.656711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.656711+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.135342+0000","last_change":"2024-09-21T21:39:43.149221+0000","last_active":"2024-09-21T21:39:43.135342+0000","last_peered":"2024-09-21T21:39:43.135342+0000","last_clean":"2024-09-21T21:39:43.135342+0000","last_became_active":"2024-09-21T21:20:27.194446+0000","last_became_peered":"2024-09-21T21:20:27.194446+0000","last_unstale":"2024-09-21T21:39:43.135342+0000","last_undegraded":"2024-09-21T21:39:43.135342+0000","last_fullsized":"2024-09-21T21:39:43.135342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:43.149000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.149000+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2144,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:42.633826+0000","last_change":"2024-09-21T21:39:42.657960+0000","last_active":"2024-09-21T21:39:42.633826+0000","last_peered":"2024-09-21T21:39:42.633826+0000","last_clean":"2024-09-21T21:39:42.633826+0000","last_became_active":"2024-09-21T21:20:27.204212+0000","last_became_peered":"2024-09-21T21:20:27.204212+0000","last_unstale":"2024-09-21T21:39:42.633826+0000","last_undegraded":"2024-09-21T21:39:42.633826+0000","last_fullsized":"2024-09-21T21:39:42.633826+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T21:39:42.657768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:42.657768+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":2145,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:43.137309+0000","last_change":"2024-09-21T21:39:43.168534+0000","last_active":"2024-09-21T21:39:43.137309+0000","last_peered":"2024-09-21T21:39:43.137309+0000","last_clean":"2024-09-21T21:39:43.137309+0000","last_became_active":"2024-09-21T21:20:27.211878+0000","last_became_peered":"2024-09-21T21:20:27.211878+0000","last_unstale":"2024-09-21T21:39:43.137309+0000","last_undegraded":"2024-09-21T21:39:43.137309+0000","last_fullsized":"2024-09-21T21:39:43.137309+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-21T21:39:43.168332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:43.168332+0000","last_clean_scrub_stamp":"2024-09-21T21:20:26.139501+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'52","reported_seq":2213,"reported_epoch":724,"state":"active+clean","last_fresh":"2024-09-21T21:39:44.128874+0000","last_change":"2024-09-21T21:39:44.169429+0000","last_active":"2024-09-21T21:39:44.128874+0000","last_peered":"2024-09-21T21:39:44.128874+0000","last_clean":"2024-09-21T21:39:44.128874+0000","last_became_active":"2024-09-21T21:20:26.190843+0000","last_became_peered":"2024-09-21T21:20:26.190843+0000","last_unstale":"2024-09-21T21:39:44.128874+0000","last_undegraded":"2024-09-21T21:39:44.128874+0000","last_fullsized":"2024-09-21T21:39:44.128874+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'52","last_scrub_stamp":"2024-09-21T21:39:44.169214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T21:39:44.169214+0000","last_clean_scrub_stamp":"2024-09-21T21:20:25.135404+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949674134,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64072,"kb_used_data":6712,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307768,"statfs":{"total":96636764160,"available":96571154432,"internally_reserved":0,"allocated":6873088,"data_stored":3398257,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949674134,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69588,"kb_used_data":6660,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94302252,"statfs":{"total":96636764160,"available":96565506048,"internally_reserved":0,"allocated":6819840,"data_stored":2807913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68176,"kb_used_data":6656,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94303664,"statfs":{"total":96636764160,"available":96566951936,"internally_reserved":0,"allocated":6815744,"data_stored":2807894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706839,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73804,"kb_used_data":6716,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94298036,"statfs":{"total":96636764160,"available":96561188864,"internally_reserved":0,"allocated":6877184,"data_stored":3398276,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29987,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T21:40:04.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-21T21:40:04.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.942+0000 7f93cb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:40:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.951+0000 7f93cb991640 1 Processor -- start 2024-09-21T21:40:04.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.951+0000 7f93cb991640 1 -- start start 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.952+0000 7f93cb991640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93c40715a0 0x7f93c40719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.952+0000 7f93cb991640 1 -- --> v1:172.21.15.5:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c409cd50 con 0x7f93c4071ef0 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.952+0000 7f93cb991640 1 -- --> v2:172.21.15.5:3300/0 -- mon_getmap magic: 0 -- 0x7f93c4072f50 con 0x7f93c40715a0 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.952+0000 7f93c972d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93c40715a0 0x7f93c40719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93c972d640 1 --2- >> v2:172.21.15.5:3300/0 conn(0x7f93c40715a0 0x7f93c40719b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47290/0 (socket says 172.21.15.5:47290) 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93c972d640 1 -- 172.21.15.5:0/4028516151 learned_addr learned my addr 172.21.15.5:0/4028516151 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93c8f2c640 1 --1- 172.21.15.5:0/4028516151 >> v1:172.21.15.5:6789/0 conn(0x7f93c4071ef0 0x7f93c41360f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.5:6789/0 says I am v1:172.21.15.5:37956/0 (socket says 172.21.15.5:37956) 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93c972d640 1 -- 172.21.15.5:0/4028516151 >> v1:172.21.15.5:6789/0 conn(0x7f93c4071ef0 legacy=0x7f93c41360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:04.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93c972d640 1 -- 172.21.15.5:0/4028516151 --> v2:172.21.15.5:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c40746d0 con 0x7f93c40715a0 2024-09-21T21:40:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93c972d640 1 --2- 172.21.15.5:0/4028516151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c40719b0 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ec05bc4b2a8801 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:40:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93bbfff640 1 -- 172.21.15.5:0/4028516151 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93c0009e50 con 0x7f93c40715a0 2024-09-21T21:40:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93bbfff640 1 -- 172.21.15.5:0/4028516151 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f93c000e230 con 0x7f93c40715a0 2024-09-21T21:40:04.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.953+0000 7f93bbfff640 1 -- 172.21.15.5:0/4028516151 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93c000e4d0 con 0x7f93c40715a0 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 1 -- 172.21.15.5:0/4028516151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 msgr2=0x7f93c40719b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 1 --2- 172.21.15.5:0/4028516151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c40719b0 crc :-1 s=READY pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 1 -- 172.21.15.5:0/4028516151 shutdown_connections 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 1 --2- 172.21.15.5:0/4028516151 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c40719b0 unknown :-1 s=CLOSED pgs=13013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 1 -- 172.21.15.5:0/4028516151 >> 172.21.15.5:0/4028516151 conn(0x7f93c40a2420 msgr2=0x7f93c40a2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 1 -- 172.21.15.5:0/4028516151 shutdown_connections 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 1 -- 172.21.15.5:0/4028516151 wait complete. 2024-09-21T21:40:04.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.954+0000 7f93cb991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-21T21:40:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.956+0000 7f93cb991640 1 Processor -- start 2024-09-21T21:40:04.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.956+0000 7f93cb991640 1 -- start start 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93cb991640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c4135c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93cb991640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41236d0 con 0x7f93c40715a0 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93c972d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c4135c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93c972d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c4135c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47306/0 (socket says 172.21.15.5:47306) 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93c972d640 1 -- 172.21.15.5:0/4198358176 learned_addr learned my addr 172.21.15.5:0/4198358176 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93c972d640 1 -- 172.21.15.5:0/4198358176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c4123080 con 0x7f93c40715a0 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93c972d640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c4135c50 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93c000ede0 con 0x7f93c40715a0 2024-09-21T21:40:04.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f93c0015420 con 0x7f93c40715a0 2024-09-21T21:40:04.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c4123f80 con 0x7f93c40715a0 2024-09-21T21:40:04.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f93c00156c0 con 0x7f93c40715a0 2024-09-21T21:40:04.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.958+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c4125070 con 0x7f93c40715a0 2024-09-21T21:40:04.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.959+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (crc 0 0 0) 0x7f93c00158b0 con 0x7f93c40715a0 2024-09-21T21:40:04.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.959+0000 7f93b9ffb640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f93a803eb20 0x7f93a8041030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T21:40:04.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.960+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(724..724 src has 1..724) ==== 3431+0+0 (crc 0 0 0) 0x7f93c00512e0 con 0x7f93c40715a0 2024-09-21T21:40:04.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.960+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c4125b20 con 0x7f93c40715a0 2024-09-21T21:40:04.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.960+0000 7f93c8f2c640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f93a803eb20 0x7f93a8041030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T21:40:04.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.961+0000 7f93c8f2c640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f93a803eb20 0x7f93a8041030 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T21:40:04.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:04.965+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197276 (crc 0 0 0) 0x7f93c0014c60 con 0x7f93c40715a0 2024-09-21T21:40:05.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.155+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f93c4074020 con 0x7f93c40715a0 2024-09-21T21:40:05.159 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.158+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f93c0013df0 con 0x7f93c40715a0 2024-09-21T21:40:05.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.159+0000 7f93b9ffb640 1 -- 172.21.15.5:0/4198358176 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f93c00094e0 con 0x7f93c40715a0 2024-09-21T21:40:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.160+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f93a803eb20 msgr2=0x7f93a8041030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.160+0000 7f93cb991640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f93a803eb20 0x7f93a8041030 crc :-1 s=READY pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:05.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.160+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 msgr2=0x7f93c4135c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T21:40:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.160+0000 7f93cb991640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c4135c50 crc :-1 s=READY pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.161+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 shutdown_connections 2024-09-21T21:40:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.161+0000 7f93cb991640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.148:6800/377023394,v1:172.21.15.148:6801/377023394] conn(0x7f93a803eb20 0x7f93a8041030 unknown :-1 s=CLOSED pgs=3860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.161+0000 7f93cb991640 1 --2- 172.21.15.5:0/4198358176 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f93c40715a0 0x7f93c4135c50 unknown :-1 s=CLOSED pgs=13014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T21:40:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.161+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 >> 172.21.15.5:0/4198358176 conn(0x7f93c40a2420 msgr2=0x7f93c41be1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T21:40:05.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.161+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 shutdown_connections 2024-09-21T21:40:05.165 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-21T21:40:05.161+0000 7f93cb991640 1 -- 172.21.15.5:0/4198358176 wait complete. 2024-09-21T21:40:05.175 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-21T21:40:05.175 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-21T21:40:05.175 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-21T21:40:05.176 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T21:40:05.266 INFO:tasks.ceph.osd.0:Stopped 2024-09-21T21:40:05.267 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-21T21:40:05.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T21:40:05.343 INFO:tasks.ceph.osd.1:Stopped 2024-09-21T21:40:05.343 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-21T21:40:05.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T21:40:05.424 INFO:tasks.ceph.osd.2:Stopped 2024-09-21T21:40:05.424 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-21T21:40:05.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T21:40:05.506 INFO:tasks.ceph.osd.3:Stopped 2024-09-21T21:40:05.506 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-21T21:40:05.506 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-21T21:40:05.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T21:40:05.535 INFO:tasks.ceph.mgr.x:Stopped 2024-09-21T21:40:05.535 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-21T21:40:05.536 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-21T21:40:05.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T21:40:05.550 INFO:tasks.ceph.mon.a:Stopped 2024-09-21T21:40:05.551 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-21T21:40:05.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-09-21T21:40:05.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-21T21:40:05.622 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-21T21:40:05.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-21T21:40:05.795 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-21T21:40:05.881 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T21:40:05.881 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-21T21:40:05.961 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T21:40:05.961 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-21T21:40:06.063 INFO:tasks.ceph:Archiving mon data... 2024-09-21T21:40:06.064 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329/data/mon.a.tgz 2024-09-21T21:40:06.064 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-21T21:40:06.080 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.NMU85lSaqZ 2024-09-21T21:40:06.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NMU85lSaqZ 2024-09-21T21:40:06.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.NMU85lSaqZ 2024-09-21T21:40:06.361 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.NMU85lSaqZ is 390KB 2024-09-21T21:40:06.456 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.NMU85lSaqZ 2024-09-21T21:40:06.472 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-21T21:40:06.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T21:40:06.514 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-21T21:40:06.593 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T21:40:06.609 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-21T21:40:06.609 INFO:tasks.ceph:Archiving crash dumps... 2024-09-21T21:40:06.611 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329/remote/smithi005/crash 2024-09-21T21:40:06.612 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T21:40:06.659 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329/remote/smithi148/crash 2024-09-21T21:40:06.660 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-21T21:40:06.704 INFO:tasks.ceph:Compressing logs... 2024-09-21T21:40:06.704 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T21:40:06.706 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T21:40:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-21T21:40:06.729 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28529.log 2024-09-21T21:40:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96352.log 2024-09-21T21:40:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.28529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94960.log 2024-09-21T21:40:06.733 INFO:teuthology.orchestra.run.smithi005.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.28529.log.gz 2024-09-21T21:40:06.733 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95933.log 2024-09-21T21:40:06.733 INFO:teuthology.orchestra.run.smithi005.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96352.log.gz 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96946.log 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94960.log: /var/log/ceph/ceph-client.admin.95933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96465.log 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96946.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95933.log.gz 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97240.log 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96946.log.gz 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29125.log 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97240.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.96465.log.gz 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31266.log 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97240.log.gz 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29167.log 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29125.log.gz 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95975.log 2024-09-21T21:40:06.734 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29167.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31266.log.gz 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29167.log.gz 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.95975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96059.log 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95975.log.gz 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96145.log 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29478.log 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96059.log.gz 2024-09-21T21:40:06.735 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96280.log 2024-09-21T21:40:06.778 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28722.log 2024-09-21T21:40:06.778 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28631.log 2024-09-21T21:40:06.778 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-21T21:40:06.778 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28722.log: /var/log/ceph/ceph-client.admin.28631.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-21T21:40:06.778 INFO:teuthology.orchestra.run.smithi148.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.28722.log.gz 2024-09-21T21:40:06.778 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.2.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28631.log.gz 2024-09-21T21:40:06.779 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28671.log 2024-09-21T21:40:06.779 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28762.log 2024-09-21T21:40:06.779 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28671.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-21T21:40:06.779 INFO:teuthology.orchestra.run.smithi148.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.28671.log.gz 2024-09-21T21:40:06.779 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.28762.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.28762.log.gz 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96145.log.gz 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96570.log 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29478.log: /var/log/ceph/ceph-client.admin.96280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96528.log 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29478.log.gz 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96570.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96280.log.gz 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28999.log 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96570.log.gz 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29083.log 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94730.log 2024-09-21T21:40:06.796 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96528.log.gz 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28999.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.28999.log.gz 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94436.log 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29083.log.gz 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.94730.log: -- /var/log/ceph/ceph-client.admin.93488.log 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29308.log 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.94730.log.gz 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95508.log 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.94960.log.gz 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94436.log.gz 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95996.log 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29308.log.gz 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.95508.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96507.log 2024-09-21T21:40:06.797 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.95996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93556.log 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95996.log.gz 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93258.log 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93488.log.gz 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28943.log 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96507.log.gz 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94249.log 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93296.log 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr: 85.9%/var/log/ceph/ceph-client.admin.94249.log: -- replaced with /var/log/ceph/ceph-client.admin.28943.log.gz 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 91.1% -- replaced with /var/log/ceph/ceph-client.admin.93556.log.gz 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94355.log 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.93258.log.gz 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.95508.log.gz 2024-09-21T21:40:06.798 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96017.log 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94249.log.gz 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93296.log: /var/log/ceph/ceph-client.admin.94355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94066.log 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94302.log 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96017.log.gz 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.94355.log.gz 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93430.log 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94066.log: /var/log/ceph/ceph-client.admin.94302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94214.log 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97072.log 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94214.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94302.log.gz 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93430.log.gz 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93077.log 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93296.log.gz 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94214.log.gz 2024-09-21T21:40:06.799 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log/var/log/ceph/ceph-client.admin.97072.log: 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94193.log 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93077.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97072.log.gz 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94666.log 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97367.log 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94577.log 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.94666.log.gz 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97367.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.94193.log.gz 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.93077.log.gz 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97367.log.gz 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94540.log 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94212.log 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96904.log 2024-09-21T21:40:06.800 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94212.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94577.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94251.log 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94540.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.94212.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96658.log 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.96904.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96591.log 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96144.log 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96658.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.94251.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96591.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96658.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97282.log 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29311.log 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96144.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96591.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96144.log.gz 2024-09-21T21:40:06.801 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96038.log 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28685.log 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.97282.log.gz 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29311.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29311.log.gz 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96376.log 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95678.log 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.96038.log.gz 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28685.log: /var/log/ceph/ceph-client.admin.96376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93411.log 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28685.log.gz 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96376.log.gz 2024-09-21T21:40:06.802 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93449.log 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.95678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29024.log/var/log/ceph/ceph-client.admin.93411.log: 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93449.log: gzip -5 --verbose -- 89.0% -- replaced with /var/log/ceph/ceph-client.admin.95678.log.gz 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.94353.log 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% 92.9% -- replaced with /var/log/ceph/ceph-client.admin.93411.log.gz 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94066.log.gz 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94614.log 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29024.log.gz 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.93449.log.gz 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97030.log 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30360.log 2024-09-21T21:40:06.803 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96549.log 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97030.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.94614.log.gz 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94353.log.gz 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.30360.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97030.log.gz 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94683.log 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96236.log 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96549.log.gzgzip 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96210.log 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94683.log: /var/log/ceph/ceph-client.admin.96236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93469.log 2024-09-21T21:40:06.804 INFO:teuthology.orchestra.run.smithi005.stderr: 86.4%/var/log/ceph/ceph-client.admin.96210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94578.log 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96236.log.gz 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.96210.log.gz 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96820.log 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96304.log 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94683.log.gz 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94578.log: /var/log/ceph/ceph-client.admin.96820.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94578.log.gz 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.96820.log.gz 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.93469.log.gz 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94747.log 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94352.log 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96304.log: /var/log/ceph/ceph-client.admin.94747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96189.log 2024-09-21T21:40:06.805 INFO:teuthology.orchestra.run.smithi005.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96304.log.gz 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96707.log 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96189.log: 90.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96486.log 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94352.log.gz 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96189.log.gz 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97408.log 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr: 86.1%/var/log/ceph/ceph-client.admin.96486.log: -- replaced with /var/log/ceph/ceph-client.admin.96707.log.gz 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96486.log.gz 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29891.log 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97408.log.gz 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29476.log 91.9% -- replaced with /var/log/ceph/ceph-client.admin.94747.log.gz 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:06.806 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94615.log 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31136.log 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr: 85.6%/var/log/ceph/ceph-client.admin.94615.log: -- replaced with /var/log/ceph/ceph-client.admin.29476.log.gz 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95296.log 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96080.log 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.94615.log.gz 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31136.log: /var/log/ceph/ceph-client.admin.95296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28450.log 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96080.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.31136.log.gz 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96080.log.gz 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96122.log 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96423.log 84.3% 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28450.log.gz 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96122.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96122.log.gz 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95007.log 2024-09-21T21:40:06.807 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94504.log 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.30360.log.gz/var/log/ceph/ceph-client.admin.95007.log: 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96423.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95296.log.gz 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96423.log.gz 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96683.log 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.29891.log.gz 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5/var/log/ceph/ceph-client.admin.94504.log: --verbose -- /var/log/ceph/ceph-client.admin.93957.log 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97324.log 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr: 86.4%/var/log/ceph/ceph-client.admin.93957.log: -- replaced with /var/log/ceph/ceph-client.admin.96683.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94504.log.gz 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29587.log 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.97324.log: /var/log/ceph/ceph-client.admin.31228.log 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29587.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.95007.log.gz 2024-09-21T21:40:06.808 INFO:teuthology.orchestra.run.smithi005.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.97324.log.gz 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96613.log 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29587.log.gz 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.93957.log.gz 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27385.log 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31228.log: gzip/var/log/ceph/ceph-client.admin.96613.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29629.log 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.27385.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96613.log.gz 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96862.log 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr: 68.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27385.log.gz 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95954.log 85.5% -- replaced with /var/log/ceph/ceph-client.admin.29629.log.gz 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97114.log 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.96862.log.gz 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.95954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96101.log 2024-09-21T21:40:06.809 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97114.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95954.log.gz 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96444.log 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.97114.log.gz 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94300.log 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 87.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.95189.log 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96444.log: -- replaced with /var/log/ceph/ceph-client.admin.96101.log.gz 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94300.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96444.log.gz 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94301.log/var/log/ceph/ceph-client.admin.95189.log: 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94300.log.gz 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29671.log 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96235.log 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29671.log: /var/log/ceph/ceph-client.admin.94301.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.95189.log.gz 2024-09-21T21:40:06.810 INFO:teuthology.orchestra.run.smithi005.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29671.log.gz 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.94301.log.gz 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96988.log 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94351.log 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96988.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96235.log.gz 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29479.log 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.96988.log.gz 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5/var/log/ceph/ceph-client.admin.94351.log: --verbose -- /var/log/ceph/ceph-client.admin.93607.log 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29479.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95858.log 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29479.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94351.log.gz 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29477.log 2024-09-21T21:40:06.811 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93607.log: /var/log/ceph/ceph-client.admin.95858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94613.log 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr: 94.1% 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31228.log.gz 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95858.log.gz/var/log/ceph/ceph-client.admin.29477.log: 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29209.log 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29477.log.gz 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95710.log 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29209.log: gzip -5 --verbose -- 85.9% /var/log/ceph/ceph-client.admin.95908.log 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94613.log.gz 2024-09-21T21:40:06.812 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29209.log.gz 2024-09-21T21:40:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.95710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94437.log 2024-09-21T21:40:06.813 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.95908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31189.log 2024-09-21T21:40:06.814 INFO:teuthology.orchestra.run.smithi005.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.95908.log.gz/var/log/ceph/ceph-client.admin.94437.log: 2024-09-21T21:40:06.814 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96326.log 2024-09-21T21:40:06.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31189.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.94437.log.gz 2024-09-21T21:40:06.814 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28713.log 2024-09-21T21:40:06.814 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96326.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.31189.log.gz 2024-09-21T21:40:06.814 INFO:teuthology.orchestra.run.smithi005.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.93607.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94505.log 2024-09-21T21:40:06.814 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96326.log.gz 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.28713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97198.log 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr: 84.9%/var/log/ceph/ceph-client.admin.94505.log: -- replaced with /var/log/ceph/ceph-client.admin.28713.log.gzgzip 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94438.log 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.94505.log.gz 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.97198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94541.log 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97198.log.gz 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31170.log 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94438.log: /var/log/ceph/ceph-client.admin.94541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94354.log 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94541.log.gz 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:06.815 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31170.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94438.log.gz 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92950.log 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96634.log 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.92950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31285.log 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94354.log.gz 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94250.log 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31285.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.96634.log.gz 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31170.log.gz 2024-09-21T21:40:06.816 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31285.log.gz 2024-09-21T21:40:06.817 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.94213.log 2024-09-21T21:40:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97156.log 2024-09-21T21:40:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.94213.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.94250.log.gz 2024-09-21T21:40:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95884.log 2024-09-21T21:40:06.817 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29310.log 2024-09-21T21:40:06.817 INFO:teuthology.orchestra.run.smithi005.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94213.log.gz/var/log/ceph/ceph-client.admin.95884.log: /var/log/ceph/ceph-client.admin.97156.log: 2024-09-21T21:40:06.818 INFO:teuthology.orchestra.run.smithi005.stderr: 86.1% 86.3% -- replaced with /var/log/ceph/ceph-client.admin.97156.log.gz 2024-09-21T21:40:06.818 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95884.log.gz 2024-09-21T21:40:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96402.log 2024-09-21T21:40:06.818 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.95710.log.gz 2024-09-21T21:40:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31304.log 2024-09-21T21:40:06.818 INFO:teuthology.orchestra.run.smithi005.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29310.log.gz 2024-09-21T21:40:06.818 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.96402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93039.log 2024-09-21T21:40:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.31304.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96402.log.gz 2024-09-21T21:40:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29309.log 2024-09-21T21:40:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.93039.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.93039.log.gz 2024-09-21T21:40:06.819 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.29309.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29309.log.gz 2024-09-21T21:40:06.819 INFO:teuthology.orchestra.run.smithi005.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.92950.log.gz 2024-09-21T21:40:06.983 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.3.log: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-21T21:40:07.212 INFO:teuthology.orchestra.run.smithi005.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31304.log.gz 2024-09-21T21:40:08.349 INFO:teuthology.orchestra.run.smithi005.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-21T21:40:12.996 INFO:teuthology.orchestra.run.smithi148.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-21T21:40:13.022 INFO:teuthology.orchestra.run.smithi148.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-21T21:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T21:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m6.262s 2024-09-21T21:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m12.117s 2024-09-21T21:40:13.024 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.528s 2024-09-21T21:40:13.239 INFO:teuthology.orchestra.run.smithi005.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-21T21:40:14.000 INFO:teuthology.orchestra.run.smithi005.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-21T21:40:14.002 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-21T21:40:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m7.283s 2024-09-21T21:40:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m15.395s 2024-09-21T21:40:14.002 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.637s 2024-09-21T21:40:14.002 INFO:tasks.ceph:Archiving logs... 2024-09-21T21:40:14.002 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329/remote/smithi005/log 2024-09-21T21:40:14.004 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T21:40:16.397 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329/remote/smithi148/log 2024-09-21T21:40:16.398 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T21:40:18.391 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T21:40:18.400 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T21:40:18.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T21:40:18.403 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T21:40:18.487 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T21:40:18.496 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T21:40:18.496 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T21:40:18.499 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T21:40:18.514 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-21T21:40:18.516 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T21:40:18.519 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T21:40:18.519 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-21T21:40:18.519 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +278us[ +270us] +/- 45ms 2024-09-21T21:40:18.519 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -959us[ -966us] +/- 62ms 2024-09-21T21:40:18.519 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +729us[ +729us] +/- 59ms 2024-09-21T21:40:18.519 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:40:18.521 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T21:40:18.521 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T21:40:18.521 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +293us[ +290us] +/- 45ms 2024-09-21T21:40:18.521 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -965us[ -965us] +/- 62ms 2024-09-21T21:40:18.521 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +737us[ +737us] +/- 59ms 2024-09-21T21:40:18.521 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T21:40:18.522 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T21:40:18.530 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T21:40:18.530 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T21:40:18.539 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T21:40:18.631 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T21:40:18.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T21:40:18.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:40:18.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-21T21:40:18.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:40:18.760 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T21:40:18.768 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T21:40:18.778 INFO:teuthology.task.internal:Duration was 1645.055705 seconds 2024-09-21T21:40:18.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T21:40:18.787 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T21:40:18.787 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T21:40:18.790 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T21:40:18.830 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T21:40:18.841 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T21:40:19.084 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T21:40:19.085 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-09-21T21:40:19.085 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T21:40:19.146 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T21:40:19.146 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T21:40:19.179 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T21:40:19.179 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T21:40:19.189 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T21:40:19.247 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T21:40:19.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T21:40:19.257 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T21:40:19.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T21:40:19.400 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T21:40:19.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T21:40:19.425 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T21:40:19.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T21:40:19.460 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T21:40:19.468 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T21:40:19.489 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-09-21T21:40:19.513 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-21T21:40:19.536 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T21:40:19.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:40:19.558 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T21:40:19.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T21:40:19.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T21:40:19.601 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T21:40:19.601 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329/remote/smithi005 2024-09-21T21:40:19.601 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T21:40:19.636 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_20:56:02-crimson-rados-main-distro-crimson-smithi/7914329/remote/smithi148 2024-09-21T21:40:19.636 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T21:40:19.669 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T21:40:19.669 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T21:40:19.673 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T21:40:19.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T21:40:19.731 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T21:40:19.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T21:40:19.740 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T21:40:19.741 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T21:40:19.743 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T21:40:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 21:40 /home/ubuntu/cephtest 2024-09-21T21:40:19.774 INFO:teuthology.orchestra.run.smithi148.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 21:40 /home/ubuntu/cephtest 2024-09-21T21:40:19.775 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T21:40:19.784 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T21:40:19.804 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore tasks/rados_api_tests} duration: 1645.0557045936584 flavor: crimson owner: scheduled_teuthology@teuthology success: true 2024-09-21T21:40:19.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T21:40:19.875 INFO:teuthology.run:pass